-- Logs begin at Fri 2022-05-27 18:44:03 UTC, end at Fri 2022-05-27 20:16:29 UTC. -- May 27 19:38:43.372678 dv-cinder-839793-12-smb systemd[1]: Starting Devstack devstack@keystone.service... May 27 19:38:43.381432 dv-cinder-839793-12-smb devstack@keystone.service[92135]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 27 19:38:43.383388 dv-cinder-839793-12-smb devstack@keystone.service[92135]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 19:38:43 2022] *** May 27 19:38:43.383388 dv-cinder-839793-12-smb devstack@keystone.service[92135]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 19:38:43.383388 dv-cinder-839793-12-smb devstack@keystone.service[92135]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 19:38:43.383388 dv-cinder-839793-12-smb devstack@keystone.service[92135]: nodename: dv-cinder-839793-12-smb May 27 19:38:43.383388 dv-cinder-839793-12-smb devstack@keystone.service[92135]: machine: x86_64 May 27 19:38:43.383388 dv-cinder-839793-12-smb devstack@keystone.service[92135]: clock source: unix May 27 19:38:43.383388 dv-cinder-839793-12-smb devstack@keystone.service[92135]: pcre jit disabled May 27 19:38:43.383388 dv-cinder-839793-12-smb devstack@keystone.service[92135]: detected number of CPU cores: 4 May 27 19:38:43.383388 dv-cinder-839793-12-smb devstack@keystone.service[92135]: current working directory: / May 27 19:38:43.383388 dv-cinder-839793-12-smb devstack@keystone.service[92135]: detected binary path: /usr/bin/uwsgi-core May 27 19:38:43.383949 dv-cinder-839793-12-smb devstack@keystone.service[92135]: your processes number limit is 47680 May 27 19:38:43.383949 dv-cinder-839793-12-smb devstack@keystone.service[92135]: your memory page size is 4096 bytes May 27 19:38:43.383949 dv-cinder-839793-12-smb devstack@keystone.service[92135]: detected max file descriptor number: 2048 May 27 19:38:43.383949 dv-cinder-839793-12-smb devstack@keystone.service[92135]: lock engine: pthread robust mutexes May 27 19:38:43.383949 dv-cinder-839793-12-smb devstack@keystone.service[92135]: thunder lock: enabled May 27 19:38:43.383949 dv-cinder-839793-12-smb devstack@keystone.service[92135]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 27 19:38:43.383949 dv-cinder-839793-12-smb devstack@keystone.service[92135]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 19:38:43.428837 dv-cinder-839793-12-smb devstack@keystone.service[92135]: Python main interpreter initialized at 0x562e459089c0 May 27 19:38:43.428837 dv-cinder-839793-12-smb devstack@keystone.service[92135]: python threads support enabled May 27 19:38:43.428837 dv-cinder-839793-12-smb devstack@keystone.service[92135]: your server socket listen backlog is limited to 100 connections May 27 19:38:43.428837 dv-cinder-839793-12-smb devstack@keystone.service[92135]: your mercy for graceful operations on workers is 90 seconds May 27 19:38:43.429211 dv-cinder-839793-12-smb devstack@keystone.service[92135]: mapped 403077 bytes (393 KB) for 2 cores May 27 19:38:43.429287 dv-cinder-839793-12-smb devstack@keystone.service[92135]: *** Operational MODE: preforking *** May 27 19:38:43.429568 dv-cinder-839793-12-smb devstack@keystone.service[92135]: *** uWSGI is running in multiple interpreter mode *** May 27 19:38:43.429568 dv-cinder-839793-12-smb devstack@keystone.service[92135]: spawned uWSGI master process (pid: 92135) May 27 19:38:43.429782 dv-cinder-839793-12-smb systemd[1]: Started Devstack devstack@keystone.service. May 27 19:38:43.431280 dv-cinder-839793-12-smb devstack@keystone.service[92135]: spawned uWSGI worker 1 (pid: 92145, cores: 1) May 27 19:38:43.431280 dv-cinder-839793-12-smb devstack@keystone.service[92135]: spawned uWSGI worker 2 (pid: 92146, cores: 1) May 27 19:38:43.431280 dv-cinder-839793-12-smb devstack@keystone.service[92135]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 19:38:49.162587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 19:38:49.162587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: from cryptography.utils import int_from_bytes May 27 19:38:49.163401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 19:38:49.163401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: from cryptography.utils import int_from_bytes May 27 19:38:49.209923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 19:38:49.209923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: from cryptography.utils import int_from_bytes May 27 19:38:49.210590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 19:38:49.210590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: from cryptography.utils import int_from_bytes May 27 19:38:49.213893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 19:38:49.214093 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 19:38:49.214292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] command line args: [] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 19:38:49.214589 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 19:38:49.214771 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ================================================================================ {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 19:38:49.215038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] admin_token = **** {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.215292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] config_dir = [] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.215480 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.215664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] config_source = [] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.215845 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] debug = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.216059 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.217221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.217221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.217221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.217221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.217462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] list_limit = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.217462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] log_config_append = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.217656 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.217823 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] log_dir = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.218008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] log_file = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.218248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.218534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.218785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.219040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.219223 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.219409 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.219657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.219904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.220141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.220406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.220640 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.220874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.221125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.221372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.221654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.222160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.222364 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] publish_errors = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.222600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.222834 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.223049 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.223251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.223493 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.223729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] standard_threads = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.223962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.224207 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.224387 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.224565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] use_journal = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.224742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] use_json = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.224919 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] use_stderr = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.225097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] use_syslog = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.225327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.225585 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.225825 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.226087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.226327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.226599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.226840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.227089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.227325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.227574 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.227822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.228074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.228308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.228555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.228792 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.229040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.229286 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.229524 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.229778 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.230033 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.230279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.230604 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.230791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.231056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.231312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.231562 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.231797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.232029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.232260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.232495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.232746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.232995 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.233226 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.233462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.233709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.233957 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.234194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.234463 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.234698 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.234935 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.235171 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.235402 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.235632 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.236400 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.236635 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.236874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.237123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.237358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.237594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.237825 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.238060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.238297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.238568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.238801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.239039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.239276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.239513 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.239749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.239984 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.240217 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.240468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.240705 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.240942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.241177 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.241436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.241674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.241906 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.242148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.242400 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.242676 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.242927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.243178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.243431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.243670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.243906 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.244141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.244394 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.244632 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.244869 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.245112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.245349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.245590 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.245829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.246065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.246298 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.246584 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.246825 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.247069 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.247309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.247552 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.247790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.248026 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.248263 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.248497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.248729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.248960 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.249196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.249427 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.249667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.249904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.250153 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.250416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.250680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.250956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.251202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.251475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] auth.external = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.252250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.252552 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.252787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.253020 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] auth.password = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.253258 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] auth.token = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.253500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.253738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.253986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.254218 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.254493 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.254744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.254977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.255212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] credential.caching = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.255461 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.255882 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.256007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.256178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.256423 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.256761 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.256921 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.257181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.257420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.257658 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.257945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.258194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.258482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.258670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 19:38:49.258670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 19:38:49.259017 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.259195 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] command line args: [] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 19:38:49.259387 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.259568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 19:38:49.259729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] federation.caching = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.259855 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ================================================================================ {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 19:38:49.259971 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.260099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] admin_token = **** {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.260294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.260491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] config_dir = [] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.260676 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.260833 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.260942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.261039 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] config_source = [] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.261039 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] debug = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.261225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.261331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.261463 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.261566 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.261668 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.261792 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.261897 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.261998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.262092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.262193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.262303 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.262458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] list_limit = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.262574 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.262687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] log_config_append = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.262687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.262898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity.caching = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.263010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] log_dir = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.263131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.263252 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] log_file = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.263365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.263478 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.263607 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.263732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.263855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.263975 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.264088 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.264200 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.264315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.264435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.264435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.264650 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.264762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.264875 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.264988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.265179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.265295 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.265408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.265520 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.265632 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.265743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.265867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.265981 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.266094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.266212 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.266332 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.266466 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.266591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.266712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.266826 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.266826 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.267039 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.267207 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.267322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] publish_errors = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.267436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.267549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.267662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.267771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.267771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.267962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.268057 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.268157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.268254 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.268355 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.268463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] standard_threads = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.268560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.268654 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.268755 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.268857 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.268952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.269058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.269154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.269255 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] use_journal = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.269363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.269460 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] use_json = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.269460 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] use_stderr = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.269643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.269746 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] use_syslog = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.269846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.269958 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 19:38:49.270071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.270185 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.270310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.270453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.270570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.270689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.270804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.270917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.271037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.271152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.271265 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.271378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.271491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.271604 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.271724 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.271839 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.271952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.272064 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.272177 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.272289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.272410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.272531 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.272644 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.272757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.272870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.272983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.273104 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.273104 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.273318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.273431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.273548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.273660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.273783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.273898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.274010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.274130 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.274243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.274421 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.274563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.274678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.274802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.274923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.275044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.275166 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.275281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.275402 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.275525 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.275640 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.275754 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.275868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.275982 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.276096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.276218 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.276333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.276453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.276567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.276694 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.276817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.276932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.277045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.277158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.277271 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.277271 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.277491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.277491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.277705 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.277818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.277931 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.277931 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.278222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.278364 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.278481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.278594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.278707 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.278821 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.278946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.279062 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.279177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.279299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.279414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.279532 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.279654 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.279769 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.279883 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.279998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.280112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.280112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.280333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.280448 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.280561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.280675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.280789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.280903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.281027 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.281143 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.281264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.281378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.281492 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.281605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.281726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.281841 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.281961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.281961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.282185 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.282299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.282438 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.282562 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.282677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.282823 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.282938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.282938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.283161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.283278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.283392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] resource.caching = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.283508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.283621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.283735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.283860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.283976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.284089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.284210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.284324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.284437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.284559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.284680 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.284680 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.284902 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.285017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.285130 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.285236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.285335 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.285430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.285526 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.285621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.285718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] role.caching = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.285822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.285920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] role.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.286015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.286111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.286206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.286503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.286628 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.286750 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.286848 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.286962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.287076 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.287180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.287285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.287384 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.287480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.287576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.287689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.287804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.287929 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.288044 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.288158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.288271 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.288385 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.288499 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.288620 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.288734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.288849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.288963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.289077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.289191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.289313 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.289313 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.289529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.289529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.289751 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.289874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.289990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.290104 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.290217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.290217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.290447 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.290578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.290694 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.290808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.290961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.291077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.291191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.291313 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.291428 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.291543 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.291656 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.291812 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.291927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.292052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.292168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.292281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.292395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.292515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.292630 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.292759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.292875 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.292988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.293120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.293234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.293347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.293472 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.293587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.293701 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.293798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.293894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.293989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] token.caching = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.294093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.294191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.294287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] auth.external = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.294408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.294509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.294606 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.294714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.294814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.294910 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.295006 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.295102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] auth.password = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.295197 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.295301 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] auth.token = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.295405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.295501 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.295597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.295692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.295809 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.295931 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.296046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.296160 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.296273 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.296386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.296500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.296621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.296736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.296851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.296964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.297078 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] credential.caching = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.297191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.297423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.297740 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.297848 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.297946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.298057 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.298170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.connection = **** {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.298295 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.299103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.299206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.299304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.299400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.299495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.299609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.299731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.299847 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.299962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.300060 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.300156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.300252 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.300356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.300356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.300555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.300669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.300782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.300896 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.301018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.301134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.301247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.301361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.301475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.301588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.301708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] federation.caching = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.301823 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.301938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.302052 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.302165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.302279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.302417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.302534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.302647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.302759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.302759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 19:38:49.302971 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.302971 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.302971 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.303277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.303277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.303523 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.303777 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.304011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity.caching = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.304261 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.304511 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.304749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.304985 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.305497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.305729 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.305967 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.306217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.306494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.306729 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.306966 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.307196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.307440 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.307689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.307935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.308191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.308439 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.308711 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.308948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.309185 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.309415 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.309651 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.309879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.310112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.310369 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.310613 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.310861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.311102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.311334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.311580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.311813 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.312057 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.312302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.312533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.312769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.313052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.313371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.313686 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.314058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.314899 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.315215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.315570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.315921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.316232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.316543 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.316930 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.317287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.317611 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.317939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.318263 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.318595 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.318943 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.319299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.319638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.320014 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.320492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.320868 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.321204 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.321524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.321842 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.322177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.322622 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.323139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.323424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.323712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.324001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.324287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.324572 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.324842 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.325130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.325440 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.325687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.325926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.326165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.326443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.326697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.326945 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.327204 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.327438 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.327685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.327924 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.328161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.328399 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.328647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.328891 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.329152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.329392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.329668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] resource.caching = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.329922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.330172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.330432 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.330685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.330936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.331173 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.331421 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.331657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.331896 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.332132 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] role.caching = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.332378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] role.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.332618 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.332867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.333116 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.333363 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.333610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.333860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.334106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.334369 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.334496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.334612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.334725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.334840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.334971 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.335087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.335298 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.335547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.335795 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.336222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.336459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.336709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.336963 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.337209 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.337459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.337694 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.337952 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.338203 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.338470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.338704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.338936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.339169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.339418 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.339670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.339918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.340153 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.340387 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.340615 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.340850 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] token.caching = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.341086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.341332 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.341565 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.341819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.342064 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.342304 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.342620 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.342864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.343111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.343346 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.343561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.343695 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.343811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.344034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.344280 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.344510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.344751 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.345070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.345389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.connection = **** {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.345653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.345920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.346179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.346470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.346780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.347019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.347255 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.347501 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.347778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.348034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.348282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.348517 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.348765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.349002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.349249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.349480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.349720 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.349955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 19:38:49.350125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 19:38:49.372867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.373098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.376247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.376540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.377281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.387544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.406432 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.406658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.428273 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.446872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.481115 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.481356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.485348 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.485581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.550928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.551159 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.551252 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.551386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.551495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.551607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.551692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.551825 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.551908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.552037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.552122 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.552250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.576593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.576784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.576894 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.576984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.577066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.577141 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.577244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.577328 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.577469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.577550 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.577660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.577743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.577875 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.577966 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.590271 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.590474 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.603473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.603707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.603834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.603929 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.604011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.604135 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.604221 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.604425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.604518 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.604645 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.604729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.604862 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.604947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.605080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 19:38:49.622521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.622690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.622772 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 19:38:49.622849 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 19:38:49.623059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.623165 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.623244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 19:38:49.623320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 19:38:49.623514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.623598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.623773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.623858 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.624031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.624115 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.624284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.624366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.635962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.636247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.636516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.636800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.637807 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.638095 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.638384 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.638668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.645536 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.647530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.648842 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.649122 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.649403 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.649685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.649969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.650231 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.650520 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.650909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.651014 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.651181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.651289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.651456 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.651540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.651724 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.651807 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.652019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.652404 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.652673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.652961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.653211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.653481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.653749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.678095 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.679938 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.680420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.680803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.682547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.682827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.685671 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.685955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.686239 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.688038 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.688323 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.688604 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.694106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.694419 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.696648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.696927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.698885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.699300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.699586 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.699865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.700138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.700410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.700680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.700947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.701362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.701767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.702048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.702331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.702629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.702904 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.703171 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.703440 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.720267 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.720556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.722845 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.723132 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.725277 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.727833 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.728947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.729325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.731478 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.731769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.734531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.736749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.738184 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.740548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.741951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.742261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.742575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.742861 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.743154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.743429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.744367 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.744667 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.744958 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.745320 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.745607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.745921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.763242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.763527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.763792 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.764055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.765693 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.765976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.766240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.766522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.772931 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.774688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.774956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.775351 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.777128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.777407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.778001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.778292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.778603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.778885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.779165 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.780508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.780788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.781065 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.781353 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.781627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.793145 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.793413 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.793697 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.793979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.794260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.794566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.794852 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.795591 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.795879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.796163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.796455 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.796731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.797001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.797280 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.813629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.816653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.816968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.819992 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.820304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.821910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.823309 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.823555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.823855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.824139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.824912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.826538 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.826825 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.827108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.831570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.833180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.834703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.836378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.836486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.836729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.837011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.837285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.839537 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.839846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.840150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.840475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.846948 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.847244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.847640 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.850321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.850635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.851044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.855521 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.855811 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.856091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.856368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.856652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.856936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.857214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.857483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.857752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.858029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.858305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.858604 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.858866 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.859124 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.859260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 19:38:49.859465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.859741 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.860020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.860295 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.860566 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.860886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.861678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.861940 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.862230 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.862542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.862832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.863098 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.863376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 19:38:49.898445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562e459089c0 pid: 92145 (default app) May 27 19:38:49.901828 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36456d9-16db-4642-a151-b83d212d852e None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:38:49.902119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36456d9-16db-4642-a151-b83d212d852e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:38:49.902269 dv-cinder-839793-12-smb devstack@keystone.service[92146]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562e459089c0 pid: 92146 (default app) May 27 19:38:49.902422 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36456d9-16db-4642-a151-b83d212d852e None None] PATH_INFO: `/v3` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:38:49.906804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Fri May 27 19:38:49 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:38:58.851990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d64bb8-4b90-42ac-9689-427639396e2a None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:38:58.852547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d64bb8-4b90-42ac-9689-427639396e2a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:38:58.852547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d64bb8-4b90-42ac-9689-427639396e2a None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:38:58.857154 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:38:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:38:58.862828 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0d371-d5d8-4490-bf7d-40ddac537463 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:38:58.863233 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0d371-d5d8-4490-bf7d-40ddac537463 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:38:58.863397 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0d371-d5d8-4490-bf7d-40ddac537463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:38:58.930952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: INFO dbcounter [None req-03b0d371-d5d8-4490-bf7d-40ddac537463 None None] Registered counter for database keystone May 27 19:38:58.951768 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG oslo_db.sqlalchemy.engines [None req-03b0d371-d5d8-4490-bf7d-40ddac537463 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:38:58.957992 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writer thread running {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:38:59.135039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG passlib.handlers.bcrypt [None req-03b0d371-d5d8-4490-bf7d-40ddac537463 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92145) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 19:38:59.135383 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG passlib.handlers.bcrypt [None req-03b0d371-d5d8-4490-bf7d-40ddac537463 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92145) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 19:38:59.191365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-03b0d371-d5d8-4490-bf7d-40ddac537463 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:38:59.192957 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-03b0d371-d5d8-4490-bf7d-40ddac537463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:38:59.316115 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:38:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 27 19:38:59.493654 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d64bb8-4b90-42ac-9689-427639396e2a None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:38:59.561016 dv-cinder-839793-12-smb devstack@keystone.service[92146]: INFO dbcounter [None req-e4d64bb8-4b90-42ac-9689-427639396e2a None None] Registered counter for database keystone May 27 19:38:59.580291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG oslo_db.sqlalchemy.engines [None req-e4d64bb8-4b90-42ac-9689-427639396e2a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 19:38:59.586366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writer thread running {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 19:38:59.706298 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d64bb8-4b90-42ac-9689-427639396e2a None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:38:59.710593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99e07e-b775-413e-8c94-377731604d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:38:59.711251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99e07e-b775-413e-8c94-377731604d98 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:38:59.711538 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99e07e-b775-413e-8c94-377731604d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:38:59.711816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99e07e-b775-413e-8c94-377731604d98 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:38:59.719862 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99e07e-b775-413e-8c94-377731604d98 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:38:59.770582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2c99e07e-b775-413e-8c94-377731604d98 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 19:38:59.770878 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99e07e-b775-413e-8c94-377731604d98 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:38:59.780389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Fri May 27 19:38:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 19:38:59.786449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0d371-d5d8-4490-bf7d-40ddac537463 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:38:59.801112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0d371-d5d8-4490-bf7d-40ddac537463 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:38:59.805826 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5531ef-540e-47dd-b428-6e895a87d9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:38:59.806975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5531ef-540e-47dd-b428-6e895a87d9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:38:59.807268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5531ef-540e-47dd-b428-6e895a87d9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:38:59.807548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5531ef-540e-47dd-b428-6e895a87d9c9 admin admin] PATH_INFO: `/v3/projects/b60b3b1e79a5473da57ed66a39a9281a` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:38:59.809079 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5531ef-540e-47dd-b428-6e895a87d9c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=b60b3b1e79a5473da57ed66a39a9281a)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:38:59.968733 dv-cinder-839793-12-smb devstack@keystone.service[92145]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8c5531ef-540e-47dd-b428-6e895a87d9c9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 19:38:59.969388 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5531ef-540e-47dd-b428-6e895a87d9c9 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:38:59.974349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Fri May 27 19:38:59 2022] GET /identity/v3/projects/b60b3b1e79a5473da57ed66a39a9281a => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:02.127384 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c20c1d-ad9f-4d0a-a214-618507f573a0 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:02.127924 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c20c1d-ad9f-4d0a-a214-618507f573a0 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:02.128013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c20c1d-ad9f-4d0a-a214-618507f573a0 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:02.132142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:02.137576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fef94f-58c6-4ce9-8544-99bac46c935f None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:02.137980 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fef94f-58c6-4ce9-8544-99bac46c935f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:02.138134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fef94f-58c6-4ce9-8544-99bac46c935f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:02.157072 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e0fef94f-58c6-4ce9-8544-99bac46c935f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:02.159251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e0fef94f-58c6-4ce9-8544-99bac46c935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:02.166887 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 27 19:39:02.188691 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c20c1d-ad9f-4d0a-a214-618507f573a0 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:02.200487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c20c1d-ad9f-4d0a-a214-618507f573a0 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:02.205725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a76ff-0bec-4b1a-b73e-0db9f30e64e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:02.206381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a76ff-0bec-4b1a-b73e-0db9f30e64e1 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:02.206668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a76ff-0bec-4b1a-b73e-0db9f30e64e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:02.206945 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a76ff-0bec-4b1a-b73e-0db9f30e64e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:02.214575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a76ff-0bec-4b1a-b73e-0db9f30e64e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:02.216480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a76ff-0bec-4b1a-b73e-0db9f30e64e1 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:02.226313 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Fri May 27 19:39:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 19:39:02.231832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fef94f-58c6-4ce9-8544-99bac46c935f None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:02.242274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fef94f-58c6-4ce9-8544-99bac46c935f None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:02.246881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64758df-8544-44e4-8e39-29ff073221ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:02.247757 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64758df-8544-44e4-8e39-29ff073221ff admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:02.248040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64758df-8544-44e4-8e39-29ff073221ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:02.248319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64758df-8544-44e4-8e39-29ff073221ff admin admin] PATH_INFO: `/v3/users/446effb9e1f24b71a4cffe88e4bce86a` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:02.249721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64758df-8544-44e4-8e39-29ff073221ff admin admin] RBAC: Authorizing `identity:get_user(user_id=446effb9e1f24b71a4cffe88e4bce86a)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:02.251588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64758df-8544-44e4-8e39-29ff073221ff admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:02.253182 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Fri May 27 19:39:02 2022] GET /identity/v3/users/446effb9e1f24b71a4cffe88e4bce86a => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:04.526114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d0c2b-47fb-4630-9888-c8f5e37e4fdc None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:04.526692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d0c2b-47fb-4630-9888-c8f5e37e4fdc None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:04.526692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d0c2b-47fb-4630-9888-c8f5e37e4fdc None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:04.528051 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:39:04.533647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec29916-e7e7-46af-b588-b48344fc198a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:04.534125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec29916-e7e7-46af-b588-b48344fc198a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:04.534209 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec29916-e7e7-46af-b588-b48344fc198a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:04.551744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-dec29916-e7e7-46af-b588-b48344fc198a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:04.552911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-dec29916-e7e7-46af-b588-b48344fc198a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:04.584378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9981ffb-75c8-4d7d-a9fb-a3ed1fba5036 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:04.584668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9981ffb-75c8-4d7d-a9fb-a3ed1fba5036 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:04.584953 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9981ffb-75c8-4d7d-a9fb-a3ed1fba5036 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:04.586302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:39:04.591614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b1a4d-627a-47f5-bf6a-ed6d738bb7ba None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:04.591905 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b1a4d-627a-47f5-bf6a-ed6d738bb7ba None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:04.592189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b1a4d-627a-47f5-bf6a-ed6d738bb7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:04.632374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG passlib.handlers.bcrypt [None req-7f0b1a4d-627a-47f5-bf6a-ed6d738bb7ba None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92146) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 19:39:04.632801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG passlib.handlers.bcrypt [None req-7f0b1a4d-627a-47f5-bf6a-ed6d738bb7ba None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92146) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 19:39:04.635312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:04.658670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec29916-e7e7-46af-b588-b48344fc198a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:04.680373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-7f0b1a4d-627a-47f5-bf6a-ed6d738bb7ba None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:04.681966 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-7f0b1a4d-627a-47f5-bf6a-ed6d738bb7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:04.682175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:04.764532 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec29916-e7e7-46af-b588-b48344fc198a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:04.785909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:04.799932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c5d6a-24e7-45eb-b80e-ef3188ffbd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:04.800736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c5d6a-24e7-45eb-b80e-ef3188ffbd19 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:04.801029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c5d6a-24e7-45eb-b80e-ef3188ffbd19 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:04.801314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c5d6a-24e7-45eb-b80e-ef3188ffbd19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:04.811120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b1a4d-627a-47f5-bf6a-ed6d738bb7ba None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:04.813393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c5d6a-24e7-45eb-b80e-ef3188ffbd19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-1c1c5d6a-24e7-45eb-b80e-ef3188ffbd19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:04.824814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:04.825843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:04.826712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:04.826712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:04.826712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:04.826712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:04.826712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:04.826712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:04.826712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:04.826712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:04.826712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:04.826712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:04.826712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:04.826712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:04.826712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:39:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:39:04.831987 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c5d6a-24e7-45eb-b80e-ef3188ffbd19 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:04.915341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:04.915615 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b1a4d-627a-47f5-bf6a-ed6d738bb7ba None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:04.917960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:04.933946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c5d6a-24e7-45eb-b80e-ef3188ffbd19 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:04.956225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb33f98-9f74-48d9-bd1e-5798980876a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:04.957193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb33f98-9f74-48d9-bd1e-5798980876a3 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:04.957520 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb33f98-9f74-48d9-bd1e-5798980876a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:04.957806 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb33f98-9f74-48d9-bd1e-5798980876a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:04.994444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091bea7-84bb-45de-8881-b39e3ed1ba24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:04.995144 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091bea7-84bb-45de-8881-b39e3ed1ba24 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:04.995431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091bea7-84bb-45de-8881-b39e3ed1ba24 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:04.995707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091bea7-84bb-45de-8881-b39e3ed1ba24 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:04.997079 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091bea7-84bb-45de-8881-b39e3ed1ba24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:04.997395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091bea7-84bb-45de-8881-b39e3ed1ba24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:04.998876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091bea7-84bb-45de-8881-b39e3ed1ba24 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:05.019113 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:05.025262 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091bea7-84bb-45de-8881-b39e3ed1ba24 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:05.043686 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb33f98-9f74-48d9-bd1e-5798980876a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:05.046515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb33f98-9f74-48d9-bd1e-5798980876a3 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:05.129050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091bea7-84bb-45de-8881-b39e3ed1ba24 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:05.147216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 19:39:05.152776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb33f98-9f74-48d9-bd1e-5798980876a3 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:05.155684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:05.165281 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc45d36-20d8-4e0b-9e6a-466f72357432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:05.166230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc45d36-20d8-4e0b-9e6a-466f72357432 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:05.166547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc45d36-20d8-4e0b-9e6a-466f72357432 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:05.166827 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc45d36-20d8-4e0b-9e6a-466f72357432 None admin] PATH_INFO: `/v3/users/446effb9e1f24b71a4cffe88e4bce86a` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:05.168114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc45d36-20d8-4e0b-9e6a-466f72357432 None admin] RBAC: Authorizing `identity:get_user(user_id=446effb9e1f24b71a4cffe88e4bce86a)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:05.169571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc45d36-20d8-4e0b-9e6a-466f72357432 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:05.171226 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:05 2022] GET /identity/v3/users/446effb9e1f24b71a4cffe88e4bce86a => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:05.176773 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc45d36-20d8-4e0b-9e6a-466f72357432 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:05.191861 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:05.257614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb33f98-9f74-48d9-bd1e-5798980876a3 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:05.288429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc45d36-20d8-4e0b-9e6a-466f72357432 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:05.309024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8beeb-fb01-4654-a607-ba850a8ce8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:05.309927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8beeb-fb01-4654-a607-ba850a8ce8b3 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:05.310272 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8beeb-fb01-4654-a607-ba850a8ce8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:05.310637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8beeb-fb01-4654-a607-ba850a8ce8b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:05.325915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e2647-dadf-417d-a10a-7c73d0299e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:05.326749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e2647-dadf-417d-a10a-7c73d0299e2b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:05.327039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e2647-dadf-417d-a10a-7c73d0299e2b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:05.327324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e2647-dadf-417d-a10a-7c73d0299e2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:05.328543 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e2647-dadf-417d-a10a-7c73d0299e2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:05.330603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e2647-dadf-417d-a10a-7c73d0299e2b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:05.332220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 10/18] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:05.333504 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8beeb-fb01-4654-a607-ba850a8ce8b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:05.335121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8beeb-fb01-4654-a607-ba850a8ce8b3 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:05.337913 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e2647-dadf-417d-a10a-7c73d0299e2b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:05.374612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-82b8beeb-fb01-4654-a607-ba850a8ce8b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:39:05.374612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:05.374612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:05.374612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:05.374612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:05.374612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:05.374612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:05.374612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:05.374612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:05.374612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:05.374612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:05.374612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:05.374612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:39:05.374612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:39:05.374612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:05.375528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:05.376922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:39:05.376922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:39:05.376922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:39:05.376922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:05.382024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 9/19] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:39:05.383543 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8beeb-fb01-4654-a607-ba850a8ce8b3 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:05.433401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:05.442951 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:05.466626 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e2647-dadf-417d-a10a-7c73d0299e2b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:05.489543 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8beeb-fb01-4654-a607-ba850a8ce8b3 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:05.513278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a8f73-9d88-4d4a-9c6c-2da8e55b5936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:05.513942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a8f73-9d88-4d4a-9c6c-2da8e55b5936 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:05.514230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a8f73-9d88-4d4a-9c6c-2da8e55b5936 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:05.514559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a8f73-9d88-4d4a-9c6c-2da8e55b5936 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:05.515407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a8f73-9d88-4d4a-9c6c-2da8e55b5936 None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.domain.id=default, user.id=446effb9e1f24b71a4cffe88e4bce86a) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:05.515721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a8f73-9d88-4d4a-9c6c-2da8e55b5936 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:05.517739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a8f73-9d88-4d4a-9c6c-2da8e55b5936 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:05.524946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1322 bytes} [Fri May 27 19:39:05 2022] GET /identity/v3/role_assignments?user.id=446effb9e1f24b71a4cffe88e4bce86a&scope.domain.id=default&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 233 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:05.525087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be189897-413f-4e73-9bf6-f98e52e67ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:05.525465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be189897-413f-4e73-9bf6-f98e52e67ffb None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:05.525751 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be189897-413f-4e73-9bf6-f98e52e67ffb None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:05.526029 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be189897-413f-4e73-9bf6-f98e52e67ffb None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:05.526795 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be189897-413f-4e73-9bf6-f98e52e67ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:05.527343 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be189897-413f-4e73-9bf6-f98e52e67ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:05.528509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be189897-413f-4e73-9bf6-f98e52e67ffb None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:05.557768 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:07.967872 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83511e-af3d-40d6-8a53-761c21d94ee0 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:07.969055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83511e-af3d-40d6-8a53-761c21d94ee0 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:07.970123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83511e-af3d-40d6-8a53-761c21d94ee0 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:07.971780 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:07.977863 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d10279-0156-4b2b-860f-688d5546031e None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:07.978462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d10279-0156-4b2b-860f-688d5546031e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:07.978542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d10279-0156-4b2b-860f-688d5546031e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:08.147861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-76d10279-0156-4b2b-860f-688d5546031e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:08.149068 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-76d10279-0156-4b2b-860f-688d5546031e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:08.259046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:08.305444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83511e-af3d-40d6-8a53-761c21d94ee0 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:08.495512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83511e-af3d-40d6-8a53-761c21d94ee0 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:08.552512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490f470-b480-4488-aa52-628f55db8e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:08.553685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490f470-b480-4488-aa52-628f55db8e5c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:08.554175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490f470-b480-4488-aa52-628f55db8e5c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:08.555028 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490f470-b480-4488-aa52-628f55db8e5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:08.574574 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490f470-b480-4488-aa52-628f55db8e5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-3490f470-b480-4488-aa52-628f55db8e5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:08.583037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:08.583917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:08.584667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:08.584667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:08.584667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:08.584667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:08.584667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:08.584667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:08.584667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:08.584667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:08.584667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:08.584667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:08.584667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:08.584667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:08.587101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 13/24] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:39:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:08.595904 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d10279-0156-4b2b-860f-688d5546031e None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:08.687279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:08.764151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d10279-0156-4b2b-860f-688d5546031e None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:08.823360 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdca659-d428-4867-ad88-f727fab3ea51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:08.823968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdca659-d428-4867-ad88-f727fab3ea51 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:08.824318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdca659-d428-4867-ad88-f727fab3ea51 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:08.824611 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdca659-d428-4867-ad88-f727fab3ea51 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:08.825499 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdca659-d428-4867-ad88-f727fab3ea51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:08.825822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdca659-d428-4867-ad88-f727fab3ea51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:08.827278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdca659-d428-4867-ad88-f727fab3ea51 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:08.846458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 12/25] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:08.852596 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490f470-b480-4488-aa52-628f55db8e5c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:08.860426 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0a7f4-2d8f-4224-be10-79df91ab4a29 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:08.860972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0a7f4-2d8f-4224-be10-79df91ab4a29 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:08.861494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0a7f4-2d8f-4224-be10-79df91ab4a29 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:08.863067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 13/26] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:39:08.863518 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:08.869470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d912e5-d1b8-418b-b345-d251a9b777ca None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:08.869978 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d912e5-d1b8-418b-b345-d251a9b777ca None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:08.870476 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d912e5-d1b8-418b-b345-d251a9b777ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:08.900602 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b4d912e5-d1b8-418b-b345-d251a9b777ca None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:08.901801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b4d912e5-d1b8-418b-b345-d251a9b777ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:09.021328 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 14/27] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:09.023445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347a97a-f5b5-455d-b06e-78b0972cbbb1 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:09.023881 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347a97a-f5b5-455d-b06e-78b0972cbbb1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:09.024261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490f470-b480-4488-aa52-628f55db8e5c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:09.024688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347a97a-f5b5-455d-b06e-78b0972cbbb1 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:09.025892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 15/28] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:09.027273 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e7c17-4896-4096-845e-1232267293d4 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:09.027559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e7c17-4896-4096-845e-1232267293d4 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:09.027842 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e7c17-4896-4096-845e-1232267293d4 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:09.030638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 16/29] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:09.032364 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25735dcd-a4a6-4507-a465-aeba5264aa40 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:09.032659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25735dcd-a4a6-4507-a465-aeba5264aa40 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:09.032939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25735dcd-a4a6-4507-a465-aeba5264aa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:09.059264 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-25735dcd-a4a6-4507-a465-aeba5264aa40 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:09.060785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-25735dcd-a4a6-4507-a465-aeba5264aa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:09.077938 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2674f1-f537-40cc-83a9-76eb7b135717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:09.079789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2674f1-f537-40cc-83a9-76eb7b135717 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:09.080388 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2674f1-f537-40cc-83a9-76eb7b135717 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:09.080831 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2674f1-f537-40cc-83a9-76eb7b135717 None admin] PATH_INFO: `/v3/users/446effb9e1f24b71a4cffe88e4bce86a` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:09.082492 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2674f1-f537-40cc-83a9-76eb7b135717 None admin] RBAC: Authorizing `identity:get_user(user_id=446effb9e1f24b71a4cffe88e4bce86a)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:09.084547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2674f1-f537-40cc-83a9-76eb7b135717 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:09.087117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 14/30] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:08 2022] GET /identity/v3/users/446effb9e1f24b71a4cffe88e4bce86a => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:09.092561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463216d-99ce-47fb-9c3e-b35caaadeb58 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:09.092561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463216d-99ce-47fb-9c3e-b35caaadeb58 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:09.092561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463216d-99ce-47fb-9c3e-b35caaadeb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:09.114367 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-5463216d-99ce-47fb-9c3e-b35caaadeb58 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:09.116477 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5463216d-99ce-47fb-9c3e-b35caaadeb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:09.140090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 17/31] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:09.140646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:09.150650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25735dcd-a4a6-4507-a465-aeba5264aa40 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:09.203587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 15/32] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:09.204695 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463216d-99ce-47fb-9c3e-b35caaadeb58 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:09.207569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:09.289266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25735dcd-a4a6-4507-a465-aeba5264aa40 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:09.327435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463216d-99ce-47fb-9c3e-b35caaadeb58 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:09.340931 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4873543-90e1-4844-95ce-fbf0c1bf8a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:09.341631 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4873543-90e1-4844-95ce-fbf0c1bf8a79 None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:09.341992 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4873543-90e1-4844-95ce-fbf0c1bf8a79 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:09.342374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4873543-90e1-4844-95ce-fbf0c1bf8a79 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:09.343457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4873543-90e1-4844-95ce-fbf0c1bf8a79 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:09.345687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4873543-90e1-4844-95ce-fbf0c1bf8a79 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:09.366625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c585ede-e72f-4bbf-ba31-684207bb7b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:09.367746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c585ede-e72f-4bbf-ba31-684207bb7b14 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:09.368247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c585ede-e72f-4bbf-ba31-684207bb7b14 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:09.368695 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c585ede-e72f-4bbf-ba31-684207bb7b14 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:09.370063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c585ede-e72f-4bbf-ba31-684207bb7b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:09.371787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c585ede-e72f-4bbf-ba31-684207bb7b14 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:09.373767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 16/33] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:09.374850 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c585ede-e72f-4bbf-ba31-684207bb7b14 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:09.453518 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:09.498562 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c585ede-e72f-4bbf-ba31-684207bb7b14 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:09.541703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d422c73-1624-424f-8c46-fdfe7d3ab6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:09.542687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d422c73-1624-424f-8c46-fdfe7d3ab6df None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:09.542974 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d422c73-1624-424f-8c46-fdfe7d3ab6df None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:09.543256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d422c73-1624-424f-8c46-fdfe7d3ab6df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:09.559309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d422c73-1624-424f-8c46-fdfe7d3ab6df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:09.561934 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d422c73-1624-424f-8c46-fdfe7d3ab6df None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:09.583187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-5d422c73-1624-424f-8c46-fdfe7d3ab6df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:39:09.583187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:09.583187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:09.583187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:09.583187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:09.583187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:09.583187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:09.583187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:09.583187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:09.583187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:09.583187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:09.583187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:09.583187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:39:09.583187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:39:09.583187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:09.584051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:09.584846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:39:09.584846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:39:09.584846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:39:09.584846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:09.587295 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 17/34] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:09.588337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d422c73-1624-424f-8c46-fdfe7d3ab6df None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:09.596338 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 18/35] 10.222.0.15 () {60 vars in 1131 bytes} [Fri May 27 19:39:09 2022] POST /identity/v3/roles => generated 219 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:39:09.597476 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4873543-90e1-4844-95ce-fbf0c1bf8a79 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:09.667899 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:09.721145 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d422c73-1624-424f-8c46-fdfe7d3ab6df None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:09.749406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:09.764898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbeabf1-dd60-4802-a380-7bb4f53bb42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:09.765588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeabf1-dd60-4802-a380-7bb4f53bb42b None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:09.766841 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeabf1-dd60-4802-a380-7bb4f53bb42b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:09.767136 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbeabf1-dd60-4802-a380-7bb4f53bb42b None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:09.768035 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbeabf1-dd60-4802-a380-7bb4f53bb42b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:09.769482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbeabf1-dd60-4802-a380-7bb4f53bb42b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:09.779959 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4873543-90e1-4844-95ce-fbf0c1bf8a79 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:09.816373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1a964-ac8f-4d71-9463-49a134a02570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:09.817273 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1a964-ac8f-4d71-9463-49a134a02570 None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:09.817567 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1a964-ac8f-4d71-9463-49a134a02570 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:09.817853 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1a964-ac8f-4d71-9463-49a134a02570 None admin] PATH_INFO: `/v3/domains/default/users/446effb9e1f24b71a4cffe88e4bce86a/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:09.820559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1a964-ac8f-4d71-9463-49a134a02570 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=446effb9e1f24b71a4cffe88e4bce86a, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:09.822174 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1a964-ac8f-4d71-9463-49a134a02570 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:09.921130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 19/36] 10.222.0.15 () {58 vars in 1361 bytes} [Fri May 27 19:39:09 2022] PUT /identity/v3/domains/default/users/446effb9e1f24b71a4cffe88e4bce86a/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:39:09.922024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1a964-ac8f-4d71-9463-49a134a02570 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:09.946411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1131 bytes} [Fri May 27 19:39:09 2022] POST /identity/v3/roles => generated 225 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:39:09.946411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99483032-45ac-4668-a8f8-a4de12c4cb98 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:09.946411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99483032-45ac-4668-a8f8-a4de12c4cb98 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:09.946411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99483032-45ac-4668-a8f8-a4de12c4cb98 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:09.946411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 19/38] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:09.947473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1699809-5cff-4486-923d-2d503341767b None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:09.947473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1699809-5cff-4486-923d-2d503341767b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:09.947643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1699809-5cff-4486-923d-2d503341767b None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:09.958416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 20/39] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:09.958416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e8305-fc7c-4d6a-a3c0-ce9898b8d380 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:09.958416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e8305-fc7c-4d6a-a3c0-ce9898b8d380 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:09.958416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e8305-fc7c-4d6a-a3c0-ce9898b8d380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:09.979922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-cf9e8305-fc7c-4d6a-a3c0-ce9898b8d380 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:09.981833 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-cf9e8305-fc7c-4d6a-a3c0-ce9898b8d380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:10.091767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:10.100242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 21/40] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:10.102853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbb6fa-47aa-4901-bcf3-0abd94810299 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:10.104630 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbb6fa-47aa-4901-bcf3-0abd94810299 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:10.104630 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbb6fa-47aa-4901-bcf3-0abd94810299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:10.120097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1a964-ac8f-4d71-9463-49a134a02570 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:10.125351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-b1fbb6fa-47aa-4901-bcf3-0abd94810299 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:10.127146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b1fbb6fa-47aa-4901-bcf3-0abd94810299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:10.176373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f14fcb-feb5-4942-a10e-aa423fb6572e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:10.176970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f14fcb-feb5-4942-a10e-aa423fb6572e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:10.177256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f14fcb-feb5-4942-a10e-aa423fb6572e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:10.177548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f14fcb-feb5-4942-a10e-aa423fb6572e None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:10.178600 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f14fcb-feb5-4942-a10e-aa423fb6572e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:10.178926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f14fcb-feb5-4942-a10e-aa423fb6572e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:10.180884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f14fcb-feb5-4942-a10e-aa423fb6572e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:10.198086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 20/41] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:10.199067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f14fcb-feb5-4942-a10e-aa423fb6572e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:10.230363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 22/42] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:10.230363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbb6fa-47aa-4901-bcf3-0abd94810299 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:10.293999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:10.333347 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f14fcb-feb5-4942-a10e-aa423fb6572e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:10.371875 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6924d-5097-4987-b0c4-f8c7f90cb806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:10.372556 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6924d-5097-4987-b0c4-f8c7f90cb806 None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:10.373203 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6924d-5097-4987-b0c4-f8c7f90cb806 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:10.373203 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6924d-5097-4987-b0c4-f8c7f90cb806 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:10.373876 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6924d-5097-4987-b0c4-f8c7f90cb806 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:10.375306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6924d-5097-4987-b0c4-f8c7f90cb806 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:10.386378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbb6fa-47aa-4901-bcf3-0abd94810299 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:10.420567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163addef-4adc-4da3-953e-37333c693c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:10.421236 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163addef-4adc-4da3-953e-37333c693c38 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:10.421525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163addef-4adc-4da3-953e-37333c693c38 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:10.421803 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163addef-4adc-4da3-953e-37333c693c38 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:10.423074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163addef-4adc-4da3-953e-37333c693c38 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:10.424663 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163addef-4adc-4da3-953e-37333c693c38 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:10.452988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 21/43] 10.222.0.15 () {60 vars in 1131 bytes} [Fri May 27 19:39:10 2022] POST /identity/v3/roles => generated 223 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:39:10.452988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6924d-5097-4987-b0c4-f8c7f90cb806 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:10.464708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:10.526373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1141 bytes} [Fri May 27 19:39:10 2022] POST /identity/v3/projects => generated 301 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:39:10.603702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6924d-5097-4987-b0c4-f8c7f90cb806 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:10.648954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1d15a-1398-4a4d-9496-470fb50a429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:10.649847 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1d15a-1398-4a4d-9496-470fb50a429c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:10.650146 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1d15a-1398-4a4d-9496-470fb50a429c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:10.650461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1d15a-1398-4a4d-9496-470fb50a429c None admin] PATH_INFO: `/v3/domains/default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:10.651841 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1d15a-1398-4a4d-9496-470fb50a429c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:10.653346 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1d15a-1398-4a4d-9496-470fb50a429c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:10.655321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 22/45] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:10.661652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163addef-4adc-4da3-953e-37333c693c38 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:10.784332 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:10.791324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163addef-4adc-4da3-953e-37333c693c38 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:10.834903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364dde4-eb53-438a-9807-75fa090b183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:10.835700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364dde4-eb53-438a-9807-75fa090b183e None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:10.836029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364dde4-eb53-438a-9807-75fa090b183e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:10.836344 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364dde4-eb53-438a-9807-75fa090b183e None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:10.837132 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364dde4-eb53-438a-9807-75fa090b183e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:10.838721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364dde4-eb53-438a-9807-75fa090b183e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:10.936978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1141 bytes} [Fri May 27 19:39:10 2022] POST /identity/v3/projects => generated 312 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:39:12.244311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9cafd-c384-4be3-b00b-768a28feb158 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:12.244832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9cafd-c384-4be3-b00b-768a28feb158 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:12.244914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9cafd-c384-4be3-b00b-768a28feb158 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:12.246264 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 23/47] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:12.252142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c070be1-7cf3-412f-adff-6d8f92208038 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:12.252544 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c070be1-7cf3-412f-adff-6d8f92208038 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:12.252706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c070be1-7cf3-412f-adff-6d8f92208038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:12.269533 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-5c070be1-7cf3-412f-adff-6d8f92208038 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:12.270802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5c070be1-7cf3-412f-adff-6d8f92208038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:12.337816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 25/48] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:12.361570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9cafd-c384-4be3-b00b-768a28feb158 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:12.440689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:12.464349 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9cafd-c384-4be3-b00b-768a28feb158 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:12.519662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec46ea-82ac-4377-b70b-576991d86082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:12.520893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec46ea-82ac-4377-b70b-576991d86082 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:12.521409 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec46ea-82ac-4377-b70b-576991d86082 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:12.521916 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec46ea-82ac-4377-b70b-576991d86082 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:12.537049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec46ea-82ac-4377-b70b-576991d86082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-38ec46ea-82ac-4377-b70b-576991d86082 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:12.545736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:12.546585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:12.547512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:12.547512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:12.547512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:12.547512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:12.547512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:12.547512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:12.547512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:12.547512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:12.547512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:12.547512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:12.547512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:12.547512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:12.547512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 24/49] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:39:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:12.552743 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c070be1-7cf3-412f-adff-6d8f92208038 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:12.626771 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:12.648750 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c070be1-7cf3-412f-adff-6d8f92208038 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:12.681962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7d381-34e0-4693-bbf4-1c0f26480398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:12.682794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7d381-34e0-4693-bbf4-1c0f26480398 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:12.682959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7d381-34e0-4693-bbf4-1c0f26480398 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:12.683242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7d381-34e0-4693-bbf4-1c0f26480398 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:12.683994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7d381-34e0-4693-bbf4-1c0f26480398 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:12.684308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7d381-34e0-4693-bbf4-1c0f26480398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:12.685694 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7d381-34e0-4693-bbf4-1c0f26480398 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:12.694695 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 26/50] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:12.700438 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec46ea-82ac-4377-b70b-576991d86082 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:12.807995 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec46ea-82ac-4377-b70b-576991d86082 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:12.845960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ef590-c4b5-4916-a334-14133c5abfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:12.847510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ef590-c4b5-4916-a334-14133c5abfe3 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:12.847966 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ef590-c4b5-4916-a334-14133c5abfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:12.848260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ef590-c4b5-4916-a334-14133c5abfe3 None admin] PATH_INFO: `/v3/users/446effb9e1f24b71a4cffe88e4bce86a` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:12.849510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ef590-c4b5-4916-a334-14133c5abfe3 None admin] RBAC: Authorizing `identity:get_user(user_id=446effb9e1f24b71a4cffe88e4bce86a)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:12.851004 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ef590-c4b5-4916-a334-14133c5abfe3 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:12.852654 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 25/51] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:12 2022] GET /identity/v3/users/446effb9e1f24b71a4cffe88e4bce86a => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:12.858034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7d381-34e0-4693-bbf4-1c0f26480398 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:12.959337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7d381-34e0-4693-bbf4-1c0f26480398 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:12.996257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351299ed-b0ff-4f7b-902f-f7d24144f6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:12.997080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351299ed-b0ff-4f7b-902f-f7d24144f6b2 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:12.997366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351299ed-b0ff-4f7b-902f-f7d24144f6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:12.997643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351299ed-b0ff-4f7b-902f-f7d24144f6b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:12.998930 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351299ed-b0ff-4f7b-902f-f7d24144f6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:13.001001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351299ed-b0ff-4f7b-902f-f7d24144f6b2 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:13.002988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 27/52] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:13.008784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ef590-c4b5-4916-a334-14133c5abfe3 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:13.012687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:13.113331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ef590-c4b5-4916-a334-14133c5abfe3 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:13.148058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e6b928-b942-426b-ba7a-996ae370e67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:13.148719 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6b928-b942-426b-ba7a-996ae370e67c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:13.149009 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6b928-b942-426b-ba7a-996ae370e67c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:13.149291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e6b928-b942-426b-ba7a-996ae370e67c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:13.150121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6b928-b942-426b-ba7a-996ae370e67c None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.domain.id=default, user.id=446effb9e1f24b71a4cffe88e4bce86a) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:13.150470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6b928-b942-426b-ba7a-996ae370e67c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:13.151952 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e6b928-b942-426b-ba7a-996ae370e67c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:13.160330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1322 bytes} [Fri May 27 19:39:13 2022] GET /identity/v3/role_assignments?user.id=446effb9e1f24b71a4cffe88e4bce86a&scope.domain.id=default&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:13.177630 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8f78f-8df5-4cd0-a42c-a19669cfe78b None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:13.178023 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8f78f-8df5-4cd0-a42c-a19669cfe78b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:13.178420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8f78f-8df5-4cd0-a42c-a19669cfe78b None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:13.180202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 28/54] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:13.186196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4742ff-1d84-45c6-94fe-37e4a18127a1 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:13.186536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4742ff-1d84-45c6-94fe-37e4a18127a1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:13.186832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4742ff-1d84-45c6-94fe-37e4a18127a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:13.206391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-3c4742ff-1d84-45c6-94fe-37e4a18127a1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:13.207976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-3c4742ff-1d84-45c6-94fe-37e4a18127a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:13.276297 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:13.282465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 27/55] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:13.307003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8f78f-8df5-4cd0-a42c-a19669cfe78b None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:13.316845 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:13.415653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8f78f-8df5-4cd0-a42c-a19669cfe78b None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:13.448567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2356190-2019-4fc0-be78-fdbc1c25b283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:13.449368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2356190-2019-4fc0-be78-fdbc1c25b283 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:13.449660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2356190-2019-4fc0-be78-fdbc1c25b283 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:13.449946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2356190-2019-4fc0-be78-fdbc1c25b283 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:13.451163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2356190-2019-4fc0-be78-fdbc1c25b283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:13.452629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2356190-2019-4fc0-be78-fdbc1c25b283 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:13.454849 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 29/56] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:13.460401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4742ff-1d84-45c6-94fe-37e4a18127a1 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:13.560740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4742ff-1d84-45c6-94fe-37e4a18127a1 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:13.594747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f167e-1fa4-4c4b-82ca-891ee35aae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:13.595409 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f167e-1fa4-4c4b-82ca-891ee35aae80 None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:13.595700 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f167e-1fa4-4c4b-82ca-891ee35aae80 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:13.595984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f167e-1fa4-4c4b-82ca-891ee35aae80 None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:13.596708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f167e-1fa4-4c4b-82ca-891ee35aae80 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:13.598167 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f167e-1fa4-4c4b-82ca-891ee35aae80 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:13.691208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 28/57] 10.222.0.15 () {60 vars in 1140 bytes} [Fri May 27 19:39:13 2022] POST /identity/v3/projects => generated 298 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:39:15.891809 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05467e24-7512-4b5b-9d23-b436dea412cd None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:15.892346 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05467e24-7512-4b5b-9d23-b436dea412cd None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:15.892450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05467e24-7512-4b5b-9d23-b436dea412cd None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:15.893753 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 30/58] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:15.899180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc15d6-8d7e-45a8-b052-6fc4eb2ef4e6 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:15.899607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc15d6-8d7e-45a8-b052-6fc4eb2ef4e6 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:15.899749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc15d6-8d7e-45a8-b052-6fc4eb2ef4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:15.916820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-e7fc15d6-8d7e-45a8-b052-6fc4eb2ef4e6 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:15.918084 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e7fc15d6-8d7e-45a8-b052-6fc4eb2ef4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:15.965313 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:15.986289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 29/59] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:16.010315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05467e24-7512-4b5b-9d23-b436dea412cd None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:16.085168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:16.110548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05467e24-7512-4b5b-9d23-b436dea412cd None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:16.142646 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05dbf5-8eb3-4fc7-b89d-12b061851389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:16.143370 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05dbf5-8eb3-4fc7-b89d-12b061851389 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:16.143657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05dbf5-8eb3-4fc7-b89d-12b061851389 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:16.143933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05dbf5-8eb3-4fc7-b89d-12b061851389 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:16.145097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05dbf5-8eb3-4fc7-b89d-12b061851389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:16.146724 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05dbf5-8eb3-4fc7-b89d-12b061851389 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:16.148316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 31/60] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:16.154000 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc15d6-8d7e-45a8-b052-6fc4eb2ef4e6 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:16.251348 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc15d6-8d7e-45a8-b052-6fc4eb2ef4e6 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:16.284791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65a6d3-cabd-49af-9c1e-ec7b8dad1967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:16.285455 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a6d3-cabd-49af-9c1e-ec7b8dad1967 None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:16.285744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a6d3-cabd-49af-9c1e-ec7b8dad1967 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:16.286026 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a6d3-cabd-49af-9c1e-ec7b8dad1967 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:16.286762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65a6d3-cabd-49af-9c1e-ec7b8dad1967 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:16.288233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65a6d3-cabd-49af-9c1e-ec7b8dad1967 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:16.386551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 30/61] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:39:16 2022] POST /identity/v3/users => generated 275 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:39:19.679141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099b299-a727-4a92-a2eb-2302773d54fb None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:19.679638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099b299-a727-4a92-a2eb-2302773d54fb None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:19.679709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099b299-a727-4a92-a2eb-2302773d54fb None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:19.681095 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 32/62] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:19.688767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a87e2-c4e8-413e-bac9-0c3ed3d2e55f None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:19.689731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a87e2-c4e8-413e-bac9-0c3ed3d2e55f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:19.690155 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a87e2-c4e8-413e-bac9-0c3ed3d2e55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:19.711398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-294a87e2-c4e8-413e-bac9-0c3ed3d2e55f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:19.712806 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-294a87e2-c4e8-413e-bac9-0c3ed3d2e55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:19.728149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4319e-ef54-428a-ae64-927a3986344c None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:19.728745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4319e-ef54-428a-ae64-927a3986344c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:19.729217 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4319e-ef54-428a-ae64-927a3986344c None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:19.730819 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 33/63] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:39:19.736011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174c59a-f591-4a5c-baa5-099a82b8711a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:19.736527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174c59a-f591-4a5c-baa5-099a82b8711a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:19.737023 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174c59a-f591-4a5c-baa5-099a82b8711a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:19.762706 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:19.768556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-8174c59a-f591-4a5c-baa5-099a82b8711a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:19.769736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8174c59a-f591-4a5c-baa5-099a82b8711a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:19.841302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 31/64] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:19.865542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a87e2-c4e8-413e-bac9-0c3ed3d2e55f None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:19.884761 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 34/65] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:19.907855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174c59a-f591-4a5c-baa5-099a82b8711a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:20.034420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174c59a-f591-4a5c-baa5-099a82b8711a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:20.042559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:20.079038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af948-a7f9-4ff4-ac65-70456f4817fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:20.080391 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af948-a7f9-4ff4-ac65-70456f4817fb None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:20.080972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af948-a7f9-4ff4-ac65-70456f4817fb None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:20.081420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700af948-a7f9-4ff4-ac65-70456f4817fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:20.095865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700af948-a7f9-4ff4-ac65-70456f4817fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-700af948-a7f9-4ff4-ac65-70456f4817fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:20.104501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:20.105361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:20.106109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:20.106109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:20.106109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:20.106109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:20.106109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:20.106109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:20.106109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:20.106109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:20.106109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:20.106109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:20.106109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:20.106109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:20.113954 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 35/66] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:39:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:39:20.115384 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af948-a7f9-4ff4-ac65-70456f4817fb None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:20.150055 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a87e2-c4e8-413e-bac9-0c3ed3d2e55f None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:20.205957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fefe02-1b62-4dd9-b929-81b548072a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:20.206801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fefe02-1b62-4dd9-b929-81b548072a61 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:20.207096 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fefe02-1b62-4dd9-b929-81b548072a61 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:20.207385 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fefe02-1b62-4dd9-b929-81b548072a61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:20.218983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fefe02-1b62-4dd9-b929-81b548072a61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-f0fefe02-1b62-4dd9-b929-81b548072a61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:20.226886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:20.227759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:20.228505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:20.228505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:20.228505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:20.228505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:20.228505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:20.228505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:20.228505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:20.228505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:20.228505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:20.228505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:20.228505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:20.228505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:20.228505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 32/67] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:39:20.229600 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67c1b9-02a4-46dd-9d47-7114d15da915 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:20.229760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67c1b9-02a4-46dd-9d47-7114d15da915 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:20.230029 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67c1b9-02a4-46dd-9d47-7114d15da915 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:20.231334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 33/68] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:20.237240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e4638-ad55-48da-a629-5f5bf9f6c945 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:20.237543 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e4638-ad55-48da-a629-5f5bf9f6c945 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:20.237828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e4638-ad55-48da-a629-5f5bf9f6c945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:20.255639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-e40e4638-ad55-48da-a629-5f5bf9f6c945 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:20.256854 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e40e4638-ad55-48da-a629-5f5bf9f6c945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:20.263714 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700af948-a7f9-4ff4-ac65-70456f4817fb None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:20.279196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:20.295477 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:20.301144 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ca49f-fcd2-426d-8b7e-2d0d0542c40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:20.301998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ca49f-fcd2-426d-8b7e-2d0d0542c40a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:20.302284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ca49f-fcd2-426d-8b7e-2d0d0542c40a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:20.302599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ca49f-fcd2-426d-8b7e-2d0d0542c40a None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:20.303367 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ca49f-fcd2-426d-8b7e-2d0d0542c40a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:20.303930 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ca49f-fcd2-426d-8b7e-2d0d0542c40a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:20.305408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ca49f-fcd2-426d-8b7e-2d0d0542c40a None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:20.315180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 36/69] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:20.316259 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ca49f-fcd2-426d-8b7e-2d0d0542c40a None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:20.333013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 34/70] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:20.334464 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7db93e-abf9-468c-852f-0495e89a6b8f None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:20.334763 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7db93e-abf9-468c-852f-0495e89a6b8f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:20.335052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7db93e-abf9-468c-852f-0495e89a6b8f None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:20.336463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 35/71] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:20.339127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7db93e-abf9-468c-852f-0495e89a6b8f None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:20.433823 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ca49f-fcd2-426d-8b7e-2d0d0542c40a None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:20.451612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7db93e-abf9-468c-852f-0495e89a6b8f None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:20.466639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43a545-2cf0-446d-b7ac-3250f72aa408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:20.467317 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43a545-2cf0-446d-b7ac-3250f72aa408 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:20.467610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43a545-2cf0-446d-b7ac-3250f72aa408 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:20.467900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43a545-2cf0-446d-b7ac-3250f72aa408 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:20.469196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43a545-2cf0-446d-b7ac-3250f72aa408 None admin] RBAC: Adding query filter params (name=member) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:20.469512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43a545-2cf0-446d-b7ac-3250f72aa408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:20.472747 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43a545-2cf0-446d-b7ac-3250f72aa408 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:20.480074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 37/72] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:20.481313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b388c9-f927-4bf1-91e8-8d039c563dc7 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:20.481617 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b388c9-f927-4bf1-91e8-8d039c563dc7 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:20.481907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b388c9-f927-4bf1-91e8-8d039c563dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:20.491337 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36210c1b-6567-4301-9daf-86f241442988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:20.492214 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36210c1b-6567-4301-9daf-86f241442988 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:20.492496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36210c1b-6567-4301-9daf-86f241442988 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:20.492772 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36210c1b-6567-4301-9daf-86f241442988 None admin] PATH_INFO: `/v3/users/446effb9e1f24b71a4cffe88e4bce86a` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:20.493968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36210c1b-6567-4301-9daf-86f241442988 None admin] RBAC: Authorizing `identity:get_user(user_id=446effb9e1f24b71a4cffe88e4bce86a)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:20.495452 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36210c1b-6567-4301-9daf-86f241442988 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:20.497068 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:20 2022] GET /identity/v3/users/446effb9e1f24b71a4cffe88e4bce86a => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:20.497818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36210c1b-6567-4301-9daf-86f241442988 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:20.498727 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-f3b388c9-f927-4bf1-91e8-8d039c563dc7 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:20.500511 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f3b388c9-f927-4bf1-91e8-8d039c563dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:20.526584 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:20.552773 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:20.569816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 38/74] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:20.571147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8997b-1eb5-4662-8221-25be876c90c3 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:20.571437 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8997b-1eb5-4662-8221-25be876c90c3 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:20.571717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8997b-1eb5-4662-8221-25be876c90c3 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:20.572968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 39/75] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:20.575100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8997b-1eb5-4662-8221-25be876c90c3 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:20.610718 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36210c1b-6567-4301-9daf-86f241442988 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:20.645548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204598f-3421-439f-b2d1-d832331ef151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:20.646380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204598f-3421-439f-b2d1-d832331ef151 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:20.646681 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204598f-3421-439f-b2d1-d832331ef151 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:20.646966 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204598f-3421-439f-b2d1-d832331ef151 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:20.657063 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204598f-3421-439f-b2d1-d832331ef151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-2204598f-3421-439f-b2d1-d832331ef151 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:20.665139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:20.666102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:20.666912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:20.666912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:20.666912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:20.666912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:20.666912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:20.666912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:20.666912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:20.666912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:20.666912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:20.666912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:20.666912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:20.666912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:20.666912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 37/76] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:39:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:20.667547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204598f-3421-439f-b2d1-d832331ef151 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:20.681457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8997b-1eb5-4662-8221-25be876c90c3 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:20.715688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930771ab-32fd-4615-a8f6-4eec0cf9f024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:20.716569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930771ab-32fd-4615-a8f6-4eec0cf9f024 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:20.717140 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930771ab-32fd-4615-a8f6-4eec0cf9f024 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:20.717140 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930771ab-32fd-4615-a8f6-4eec0cf9f024 None admin] PATH_INFO: `/v3/users/068f43858bd84ea9a8a4bd23968f5df6` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:20.730720 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930771ab-32fd-4615-a8f6-4eec0cf9f024 None admin] RBAC: Authorizing `identity:get_user(user_id=068f43858bd84ea9a8a4bd23968f5df6)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:20.732206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930771ab-32fd-4615-a8f6-4eec0cf9f024 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:20.733934 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 40/77] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:20 2022] GET /identity/v3/users/068f43858bd84ea9a8a4bd23968f5df6 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:20.735718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea9b83-be9f-465d-9509-b656c344c3bb None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:20.736023 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea9b83-be9f-465d-9509-b656c344c3bb None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:20.736312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea9b83-be9f-465d-9509-b656c344c3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:20.752432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-41ea9b83-be9f-465d-9509-b656c344c3bb None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:20.753636 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-41ea9b83-be9f-465d-9509-b656c344c3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:20.763616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:20.780271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204598f-3421-439f-b2d1-d832331ef151 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:20.793865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:20.818528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75d05b-2aee-4d33-a4a2-fcddd8ef4dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:20.819129 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75d05b-2aee-4d33-a4a2-fcddd8ef4dd0 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:20.819404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 41/78] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:20.830464 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75d05b-2aee-4d33-a4a2-fcddd8ef4dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:20.830464 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75d05b-2aee-4d33-a4a2-fcddd8ef4dd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:20.830600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea9b83-be9f-465d-9509-b656c344c3bb None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:20.901063 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75d05b-2aee-4d33-a4a2-fcddd8ef4dd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:20.902593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75d05b-2aee-4d33-a4a2-fcddd8ef4dd0 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:20.918189 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea9b83-be9f-465d-9509-b656c344c3bb None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:20.952598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7e2cd-b360-497a-9d35-54609f7acf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:20.953931 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7e2cd-b360-497a-9d35-54609f7acf5f None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:20.954221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7e2cd-b360-497a-9d35-54609f7acf5f None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:20.954535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7e2cd-b360-497a-9d35-54609f7acf5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:20.955747 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7e2cd-b360-497a-9d35-54609f7acf5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:20.957200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7e2cd-b360-497a-9d35-54609f7acf5f None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:20.958874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 42/79] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:20.959634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7e2cd-b360-497a-9d35-54609f7acf5f None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:20.989856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:21.003176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:21.005650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 38/80] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:21.006610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75d05b-2aee-4d33-a4a2-fcddd8ef4dd0 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:21.060669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7e2cd-b360-497a-9d35-54609f7acf5f None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:21.094455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0369905-0e08-4cfb-b16a-3041d900995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:21.095062 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0369905-0e08-4cfb-b16a-3041d900995a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:21.096418 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0369905-0e08-4cfb-b16a-3041d900995a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:21.096418 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0369905-0e08-4cfb-b16a-3041d900995a None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:21.096418 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0369905-0e08-4cfb-b16a-3041d900995a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:21.096699 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0369905-0e08-4cfb-b16a-3041d900995a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:21.098044 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0369905-0e08-4cfb-b16a-3041d900995a None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:21.105866 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 43/81] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:39:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:21.106784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0369905-0e08-4cfb-b16a-3041d900995a None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:21.112530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75d05b-2aee-4d33-a4a2-fcddd8ef4dd0 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:21.147106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda92bb-4e84-4376-be3f-43536ce4623c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:21.147766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda92bb-4e84-4376-be3f-43536ce4623c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:21.148055 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda92bb-4e84-4376-be3f-43536ce4623c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:21.148338 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda92bb-4e84-4376-be3f-43536ce4623c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:21.201068 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:21.205664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0369905-0e08-4cfb-b16a-3041d900995a None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:21.208490 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:21.217453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda92bb-4e84-4376-be3f-43536ce4623c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:21.219016 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda92bb-4e84-4376-be3f-43536ce4623c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:21.238368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bb915-7b0c-4b42-8d3c-bbe9b981bde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:21.239174 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bb915-7b0c-4b42-8d3c-bbe9b981bde9 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:21.239470 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bb915-7b0c-4b42-8d3c-bbe9b981bde9 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:21.239759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bb915-7b0c-4b42-8d3c-bbe9b981bde9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:21.250218 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bb915-7b0c-4b42-8d3c-bbe9b981bde9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-8e6bb915-7b0c-4b42-8d3c-bbe9b981bde9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:21.257736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:21.258639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:21.259487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:21.259487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:21.259487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:21.259487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:21.259487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:21.259487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:21.259487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:21.259487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:21.259487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:21.259487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:21.259487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:21.259487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:21.259487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 44/82] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:21.260280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bb915-7b0c-4b42-8d3c-bbe9b981bde9 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:21.323497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 39/83] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:21.327661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda92bb-4e84-4376-be3f-43536ce4623c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:21.359718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bb915-7b0c-4b42-8d3c-bbe9b981bde9 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:21.395053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f6088-70f5-4858-afed-be6ae83feebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:21.395875 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f6088-70f5-4858-afed-be6ae83feebb None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:21.396289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f6088-70f5-4858-afed-be6ae83feebb None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:21.396767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f6088-70f5-4858-afed-be6ae83feebb None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:21.397698 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f6088-70f5-4858-afed-be6ae83feebb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:21.399262 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f6088-70f5-4858-afed-be6ae83feebb None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:21.410162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:21.425431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda92bb-4e84-4376-be3f-43536ce4623c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:21.459155 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae4bb8-9316-48d8-a3f9-491e18edddb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:21.460009 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae4bb8-9316-48d8-a3f9-491e18edddb6 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:21.460297 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae4bb8-9316-48d8-a3f9-491e18edddb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:21.460576 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae4bb8-9316-48d8-a3f9-491e18edddb6 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:21.461756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae4bb8-9316-48d8-a3f9-491e18edddb6 None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:21.463225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae4bb8-9316-48d8-a3f9-491e18edddb6 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:21.464916 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 40/84] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:21 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:21.465770 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae4bb8-9316-48d8-a3f9-491e18edddb6 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:21.511858 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 45/85] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:39:21 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:39:21.512709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f6088-70f5-4858-afed-be6ae83feebb None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:21.537810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:21.576558 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae4bb8-9316-48d8-a3f9-491e18edddb6 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:21.615566 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf9dd7-5228-4345-bf0c-441efce7cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:21.616525 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf9dd7-5228-4345-bf0c-441efce7cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:21.616820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf9dd7-5228-4345-bf0c-441efce7cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:21.617109 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf9dd7-5228-4345-bf0c-441efce7cbf1 None admin] PATH_INFO: `/v3/users/068f43858bd84ea9a8a4bd23968f5df6` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:21.618477 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf9dd7-5228-4345-bf0c-441efce7cbf1 None admin] RBAC: Authorizing `identity:get_user(user_id=068f43858bd84ea9a8a4bd23968f5df6)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:21.619962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf9dd7-5228-4345-bf0c-441efce7cbf1 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:21.621661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 41/86] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:21 2022] GET /identity/v3/users/068f43858bd84ea9a8a4bd23968f5df6 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:21.622480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf9dd7-5228-4345-bf0c-441efce7cbf1 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:21.635604 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f6088-70f5-4858-afed-be6ae83feebb None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:21.648032 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:21.675522 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45c416-0b72-40ac-ae74-a4384084b047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:21.676225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45c416-0b72-40ac-ae74-a4384084b047 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:21.676522 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45c416-0b72-40ac-ae74-a4384084b047 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:21.676804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45c416-0b72-40ac-ae74-a4384084b047 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:21.677595 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45c416-0b72-40ac-ae74-a4384084b047 None admin] RBAC: Adding query filter params (name=member) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:21.677910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45c416-0b72-40ac-ae74-a4384084b047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:21.681470 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45c416-0b72-40ac-ae74-a4384084b047 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:21.691557 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 46/87] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:21.694469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45c416-0b72-40ac-ae74-a4384084b047 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:21.745247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf9dd7-5228-4345-bf0c-441efce7cbf1 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:21.791988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44134ac6-9312-4eba-a16a-4220b167e706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:21.793365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44134ac6-9312-4eba-a16a-4220b167e706 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:21.793927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44134ac6-9312-4eba-a16a-4220b167e706 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:21.794213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44134ac6-9312-4eba-a16a-4220b167e706 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:21.795786 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44134ac6-9312-4eba-a16a-4220b167e706 None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:21.798806 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44134ac6-9312-4eba-a16a-4220b167e706 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:21.800773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 42/88] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:21 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:21.801365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44134ac6-9312-4eba-a16a-4220b167e706 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:21.811626 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:21.840057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45c416-0b72-40ac-ae74-a4384084b047 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:21.880681 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebdcdb-e275-41a3-9e53-a96dc0c6af8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:21.881356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebdcdb-e275-41a3-9e53-a96dc0c6af8e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:21.881714 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebdcdb-e275-41a3-9e53-a96dc0c6af8e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:21.882065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebdcdb-e275-41a3-9e53-a96dc0c6af8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:21.883257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebdcdb-e275-41a3-9e53-a96dc0c6af8e None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=bae51daa53924a5a9246a49472acf706, user.id=446effb9e1f24b71a4cffe88e4bce86a) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:21.883257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebdcdb-e275-41a3-9e53-a96dc0c6af8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:21.888662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebdcdb-e275-41a3-9e53-a96dc0c6af8e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:21.897492 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 47/89] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:21 2022] GET /identity/v3/role_assignments?user.id=446effb9e1f24b71a4cffe88e4bce86a&scope.project.id=bae51daa53924a5a9246a49472acf706&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:21.898731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebdcdb-e275-41a3-9e53-a96dc0c6af8e None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:21.939514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:21.980592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44134ac6-9312-4eba-a16a-4220b167e706 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:22.026515 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebdcdb-e275-41a3-9e53-a96dc0c6af8e None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:22.070321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80683f3e-9cb8-426a-8378-8f85c1d97d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:22.071835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80683f3e-9cb8-426a-8378-8f85c1d97d0d None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:22.072388 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80683f3e-9cb8-426a-8378-8f85c1d97d0d None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:22.072916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80683f3e-9cb8-426a-8378-8f85c1d97d0d None admin] PATH_INFO: `/v3/users/068f43858bd84ea9a8a4bd23968f5df6` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:22.074560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80683f3e-9cb8-426a-8378-8f85c1d97d0d None admin] RBAC: Authorizing `identity:get_user(user_id=068f43858bd84ea9a8a4bd23968f5df6)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:22.076432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80683f3e-9cb8-426a-8378-8f85c1d97d0d None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:22.079048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 48/90] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:21 2022] GET /identity/v3/users/068f43858bd84ea9a8a4bd23968f5df6 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:22.080440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80683f3e-9cb8-426a-8378-8f85c1d97d0d None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:22.081378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238a31-bddd-459f-a6b3-c5bcfdb2de8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:22.082096 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238a31-bddd-459f-a6b3-c5bcfdb2de8a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:22.082483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238a31-bddd-459f-a6b3-c5bcfdb2de8a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:22.082841 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4238a31-bddd-459f-a6b3-c5bcfdb2de8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:22.100414 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:22.170941 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4238a31-bddd-459f-a6b3-c5bcfdb2de8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:22.172447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4238a31-bddd-459f-a6b3-c5bcfdb2de8a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:22.213934 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80683f3e-9cb8-426a-8378-8f85c1d97d0d None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:22.262400 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccb9d2-8ec0-432c-ba5a-0d4a81f15746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:22.263397 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccb9d2-8ec0-432c-ba5a-0d4a81f15746 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:22.263863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccb9d2-8ec0-432c-ba5a-0d4a81f15746 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:22.264320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccb9d2-8ec0-432c-ba5a-0d4a81f15746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:22.265365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccb9d2-8ec0-432c-ba5a-0d4a81f15746 None admin] RBAC: Adding query filter params (role.id=c638961e289c4d108d8c584cb350a509, scope.project.id=bae51daa53924a5a9246a49472acf706, user.id=068f43858bd84ea9a8a4bd23968f5df6) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:22.265864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccb9d2-8ec0-432c-ba5a-0d4a81f15746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:22.267565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccb9d2-8ec0-432c-ba5a-0d4a81f15746 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:22.274028 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 49/91] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:22 2022] GET /identity/v3/role_assignments?user.id=068f43858bd84ea9a8a4bd23968f5df6&scope.project.id=bae51daa53924a5a9246a49472acf706&role.id=c638961e289c4d108d8c584cb350a509 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:22.275262 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccb9d2-8ec0-432c-ba5a-0d4a81f15746 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:22.315917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:22.316237 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 43/92] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:22.323925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238a31-bddd-459f-a6b3-c5bcfdb2de8a None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:22.444774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4238a31-bddd-459f-a6b3-c5bcfdb2de8a None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:22.469361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:22.543846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22b612-85ff-4a12-bb15-9c0dd909b078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:22.544735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22b612-85ff-4a12-bb15-9c0dd909b078 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:22.545027 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22b612-85ff-4a12-bb15-9c0dd909b078 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:22.545303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22b612-85ff-4a12-bb15-9c0dd909b078 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:22.551253 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22b612-85ff-4a12-bb15-9c0dd909b078 None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:22.552739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22b612-85ff-4a12-bb15-9c0dd909b078 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:22.555148 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 44/93] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:22 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:22.560689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22b612-85ff-4a12-bb15-9c0dd909b078 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:22.561566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccb9d2-8ec0-432c-ba5a-0d4a81f15746 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:22.622892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c181ea-4268-44ab-a665-419d2ee960cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:22.623556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c181ea-4268-44ab-a665-419d2ee960cf None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:22.623846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c181ea-4268-44ab-a665-419d2ee960cf None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:22.624127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c181ea-4268-44ab-a665-419d2ee960cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:22.673259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:22.739432 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22b612-85ff-4a12-bb15-9c0dd909b078 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:22.753436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c181ea-4268-44ab-a665-419d2ee960cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:22.754997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c181ea-4268-44ab-a665-419d2ee960cf None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:22.807091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf0080-da53-4302-a38f-3436100357c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:22.807769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf0080-da53-4302-a38f-3436100357c5 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:22.808046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf0080-da53-4302-a38f-3436100357c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:22.808334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf0080-da53-4302-a38f-3436100357c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:22.809178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf0080-da53-4302-a38f-3436100357c5 None admin] RBAC: Adding query filter params (role.id=cba310daca814298b574fb2259749836, scope.project.id=bae51daa53924a5a9246a49472acf706, user.id=068f43858bd84ea9a8a4bd23968f5df6) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:22.809498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf0080-da53-4302-a38f-3436100357c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:22.810987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf0080-da53-4302-a38f-3436100357c5 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:22.822054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 45/94] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:22 2022] GET /identity/v3/role_assignments?user.id=068f43858bd84ea9a8a4bd23968f5df6&scope.project.id=bae51daa53924a5a9246a49472acf706&role.id=cba310daca814298b574fb2259749836 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:22.900125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:22.929662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 50/95] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:22.935620 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf0080-da53-4302-a38f-3436100357c5 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:23.081117 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf0080-da53-4302-a38f-3436100357c5 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:23.105715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:23.127747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f9d6a-0fa3-4b45-80ff-98186802715c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:23.128632 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f9d6a-0fa3-4b45-80ff-98186802715c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:23.128920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f9d6a-0fa3-4b45-80ff-98186802715c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:23.129200 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f9d6a-0fa3-4b45-80ff-98186802715c None admin] PATH_INFO: `/v3/projects/af706032c52b42e4a105b9f072c18911` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:23.132601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f9d6a-0fa3-4b45-80ff-98186802715c None admin] RBAC: Authorizing `identity:get_project(project_id=af706032c52b42e4a105b9f072c18911)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:23.134072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f9d6a-0fa3-4b45-80ff-98186802715c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:23.136078 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 46/96] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:22 2022] GET /identity/v3/projects/af706032c52b42e4a105b9f072c18911 => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:23.143088 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c181ea-4268-44ab-a665-419d2ee960cf None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:23.273514 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c181ea-4268-44ab-a665-419d2ee960cf None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:23.314456 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532b4c3-6c08-4ed3-9b28-bc17f6d61fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:23.315134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532b4c3-6c08-4ed3-9b28-bc17f6d61fdf None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:23.315422 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532b4c3-6c08-4ed3-9b28-bc17f6d61fdf None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:23.315702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532b4c3-6c08-4ed3-9b28-bc17f6d61fdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:23.316548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532b4c3-6c08-4ed3-9b28-bc17f6d61fdf None admin] RBAC: Adding query filter params (role.id=c638961e289c4d108d8c584cb350a509, scope.project.id=af706032c52b42e4a105b9f072c18911, user.id=068f43858bd84ea9a8a4bd23968f5df6) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:23.316863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532b4c3-6c08-4ed3-9b28-bc17f6d61fdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:23.318387 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532b4c3-6c08-4ed3-9b28-bc17f6d61fdf None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:23.324656 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 51/97] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:23 2022] GET /identity/v3/role_assignments?user.id=068f43858bd84ea9a8a4bd23968f5df6&scope.project.id=af706032c52b42e4a105b9f072c18911&role.id=c638961e289c4d108d8c584cb350a509 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:24.828239 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80050ed8-d599-4201-9d4a-4a8d0795e8ef None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:24.828775 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80050ed8-d599-4201-9d4a-4a8d0795e8ef None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:24.828775 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80050ed8-d599-4201-9d4a-4a8d0795e8ef None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:24.830171 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 47/98] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:24.835858 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7987b4-d9b8-45f6-8bab-10a233b5c3a0 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:24.836258 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7987b4-d9b8-45f6-8bab-10a233b5c3a0 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:24.836440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7987b4-d9b8-45f6-8bab-10a233b5c3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:24.859395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-ff7987b4-d9b8-45f6-8bab-10a233b5c3a0 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:24.860604 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ff7987b4-d9b8-45f6-8bab-10a233b5c3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:24.902090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:24.936737 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 52/99] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:24.968445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80050ed8-d599-4201-9d4a-4a8d0795e8ef None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:24.976531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf76c8c-ba75-4d53-8c8c-8c6b73fa6c56 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:24.976531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf76c8c-ba75-4d53-8c8c-8c6b73fa6c56 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:24.976531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf76c8c-ba75-4d53-8c8c-8c6b73fa6c56 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:24.976531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 53/100] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:39:24.982653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad04039-d341-4ff0-90dc-466f0d97fd1c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:24.983171 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad04039-d341-4ff0-90dc-466f0d97fd1c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:24.983660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad04039-d341-4ff0-90dc-466f0d97fd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:25.019739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-1ad04039-d341-4ff0-90dc-466f0d97fd1c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:25.021409 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-1ad04039-d341-4ff0-90dc-466f0d97fd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:25.182373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 54/101] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:25.185529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80050ed8-d599-4201-9d4a-4a8d0795e8ef None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:25.231963 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fa4c5-a9a7-47fc-a90e-48b8679090e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:25.233192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fa4c5-a9a7-47fc-a90e-48b8679090e2 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:25.233713 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fa4c5-a9a7-47fc-a90e-48b8679090e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:25.234739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fa4c5-a9a7-47fc-a90e-48b8679090e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:25.253129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad04039-d341-4ff0-90dc-466f0d97fd1c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:25.263099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fa4c5-a9a7-47fc-a90e-48b8679090e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-ff3fa4c5-a9a7-47fc-a90e-48b8679090e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:25.271303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:25.272177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:25.273381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:25.273381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:25.273381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:25.273381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:25.273381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:25.273381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:25.273381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:25.273381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:25.273381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:25.273381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:25.273381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:25.273381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:25.273381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 48/102] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:25.283298 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fa4c5-a9a7-47fc-a90e-48b8679090e2 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:25.338237 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:25.397704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fa4c5-a9a7-47fc-a90e-48b8679090e2 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:25.436696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad04039-d341-4ff0-90dc-466f0d97fd1c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:25.439446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:25.477498 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dd124-25ff-4499-9674-19577af60349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:25.478584 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dd124-25ff-4499-9674-19577af60349 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:25.479140 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dd124-25ff-4499-9674-19577af60349 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:25.479647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dd124-25ff-4499-9674-19577af60349 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:25.480970 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dd124-25ff-4499-9674-19577af60349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:25.482615 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dd124-25ff-4499-9674-19577af60349 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:25.485108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 55/103] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:25.486601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ac66b-c56d-4e71-899a-5aa27162c9cf None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:25.487234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ac66b-c56d-4e71-899a-5aa27162c9cf None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:25.487718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ac66b-c56d-4e71-899a-5aa27162c9cf None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:25.489160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 56/104] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:25.494151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5050f-f2e8-425f-acf4-d050ed1d0470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:25.494151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5050f-f2e8-425f-acf4-d050ed1d0470 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:25.494151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5050f-f2e8-425f-acf4-d050ed1d0470 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:25.494151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5050f-f2e8-425f-acf4-d050ed1d0470 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:25.494532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5050f-f2e8-425f-acf4-d050ed1d0470 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:25.494532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5050f-f2e8-425f-acf4-d050ed1d0470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:25.494814 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5050f-f2e8-425f-acf4-d050ed1d0470 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:25.496063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a60b4b-cc4c-49f6-a750-8394f6c7189c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:25.496489 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a60b4b-cc4c-49f6-a750-8394f6c7189c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:25.496914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a60b4b-cc4c-49f6-a750-8394f6c7189c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:25.509401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 49/105] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:25.514741 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5050f-f2e8-425f-acf4-d050ed1d0470 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:25.530275 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-36a60b4b-cc4c-49f6-a750-8394f6c7189c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:25.532271 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-36a60b4b-cc4c-49f6-a750-8394f6c7189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:25.663357 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 57/106] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:25.664538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a60b4b-cc4c-49f6-a750-8394f6c7189c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:25.730372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5050f-f2e8-425f-acf4-d050ed1d0470 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:25.789913 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:25.837839 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd394b-fc43-473d-882b-73a82ef2c770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:25.839320 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd394b-fc43-473d-882b-73a82ef2c770 None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:25.839762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd394b-fc43-473d-882b-73a82ef2c770 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:25.840216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd394b-fc43-473d-882b-73a82ef2c770 None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:25.841088 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd394b-fc43-473d-882b-73a82ef2c770 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:25.842960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd394b-fc43-473d-882b-73a82ef2c770 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:25.870741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:25.874148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a60b4b-cc4c-49f6-a750-8394f6c7189c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:25.914054 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910c5bd-2f67-4a55-adeb-60c6506d22f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:25.914965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910c5bd-2f67-4a55-adeb-60c6506d22f2 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:25.915256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910c5bd-2f67-4a55-adeb-60c6506d22f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:25.915608 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910c5bd-2f67-4a55-adeb-60c6506d22f2 None admin] PATH_INFO: `/v3/users/0f0778686ca741cba3a8f5155f302ab2` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:25.929810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910c5bd-2f67-4a55-adeb-60c6506d22f2 None admin] RBAC: Authorizing `identity:get_user(user_id=0f0778686ca741cba3a8f5155f302ab2)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:25.931334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910c5bd-2f67-4a55-adeb-60c6506d22f2 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:25.933356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 58/107] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:25 2022] GET /identity/v3/users/0f0778686ca741cba3a8f5155f302ab2 => generated 289 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:25.934180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910c5bd-2f67-4a55-adeb-60c6506d22f2 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:25.976373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 50/108] 10.222.0.15 () {60 vars in 1141 bytes} [Fri May 27 19:39:25 2022] POST /identity/v3/projects => generated 302 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:39:25.977490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad145d-a4e0-4885-9a45-ff293b0ea2d1 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:25.977790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad145d-a4e0-4885-9a45-ff293b0ea2d1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:25.978071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad145d-a4e0-4885-9a45-ff293b0ea2d1 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:26.013088 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 51/109] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:26.013088 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad145d-a4e0-4885-9a45-ff293b0ea2d1 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:26.100316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910c5bd-2f67-4a55-adeb-60c6506d22f2 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:26.142256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad145d-a4e0-4885-9a45-ff293b0ea2d1 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:26.145690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88455eb5-6977-4654-9053-41e2d23d3dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:26.146790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88455eb5-6977-4654-9053-41e2d23d3dd0 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:26.147153 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88455eb5-6977-4654-9053-41e2d23d3dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:26.147502 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88455eb5-6977-4654-9053-41e2d23d3dd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:26.162038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88455eb5-6977-4654-9053-41e2d23d3dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-88455eb5-6977-4654-9053-41e2d23d3dd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:26.173164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:26.174309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:26.175339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:26.175339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:26.175339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:26.175339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:26.175339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:26.175339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:26.175339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:26.175339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:26.175339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:26.175339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:26.175339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:26.175339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:26.175339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 59/110] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:39:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:26.179161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0140f-4b5d-444e-b0ee-78b2b209123f None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:26.179573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0140f-4b5d-444e-b0ee-78b2b209123f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:26.179953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0140f-4b5d-444e-b0ee-78b2b209123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:26.190489 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39610126-26e7-4e1b-b1a9-2e8932c9e35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:26.191308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39610126-26e7-4e1b-b1a9-2e8932c9e35c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:26.191667 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39610126-26e7-4e1b-b1a9-2e8932c9e35c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:26.192021 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39610126-26e7-4e1b-b1a9-2e8932c9e35c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:26.200801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-cfd0140f-4b5d-444e-b0ee-78b2b209123f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:26.203338 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-cfd0140f-4b5d-444e-b0ee-78b2b209123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:26.223577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:26.236799 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:26.287028 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39610126-26e7-4e1b-b1a9-2e8932c9e35c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:26.288522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39610126-26e7-4e1b-b1a9-2e8932c9e35c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:26.296247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 60/111] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:26.297658 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ee5a-4248-4f4d-9764-9b2bce127f40 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:26.302774 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ee5a-4248-4f4d-9764-9b2bce127f40 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:26.303075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ee5a-4248-4f4d-9764-9b2bce127f40 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:26.308765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 61/112] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:26.308765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026ee5a-4248-4f4d-9764-9b2bce127f40 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:26.408633 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 52/113] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:26.409999 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f105a8-4c11-4952-8728-637d0bd37dda None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:26.410387 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f105a8-4c11-4952-8728-637d0bd37dda None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:26.410605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f105a8-4c11-4952-8728-637d0bd37dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:26.427263 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-58f105a8-4c11-4952-8728-637d0bd37dda None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:26.428725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-58f105a8-4c11-4952-8728-637d0bd37dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:26.429624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026ee5a-4248-4f4d-9764-9b2bce127f40 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:26.469640 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338db82-4c9a-4067-a8fc-89c6d6f686df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:26.470330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338db82-4c9a-4067-a8fc-89c6d6f686df None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:26.470653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338db82-4c9a-4067-a8fc-89c6d6f686df None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:26.470964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338db82-4c9a-4067-a8fc-89c6d6f686df None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:26.471729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338db82-4c9a-4067-a8fc-89c6d6f686df None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:26.472055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338db82-4c9a-4067-a8fc-89c6d6f686df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:26.473473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338db82-4c9a-4067-a8fc-89c6d6f686df None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:26.484493 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 62/114] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:26.485164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338db82-4c9a-4067-a8fc-89c6d6f686df None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:26.499989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:26.501111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:26.512513 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 53/115] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:26.518493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a41d45-f2f3-4036-bfda-886a7d14a777 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:26.518493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a41d45-f2f3-4036-bfda-886a7d14a777 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:26.518493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a41d45-f2f3-4036-bfda-886a7d14a777 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:26.518493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 54/116] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:26.518493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a41d45-f2f3-4036-bfda-886a7d14a777 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:26.596875 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338db82-4c9a-4067-a8fc-89c6d6f686df None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:26.633035 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400c173-4a35-468f-b5d1-96af04105872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:26.633393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a41d45-f2f3-4036-bfda-886a7d14a777 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:26.633847 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400c173-4a35-468f-b5d1-96af04105872 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:26.634137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400c173-4a35-468f-b5d1-96af04105872 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:26.634448 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400c173-4a35-468f-b5d1-96af04105872 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:26.649841 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400c173-4a35-468f-b5d1-96af04105872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-5400c173-4a35-468f-b5d1-96af04105872 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:26.657683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:26.658873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:26.659629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:26.659629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:26.659629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:26.659629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:26.659629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:26.659629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:26.659629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:26.659629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:26.659629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:26.659629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:26.659629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:26.659629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:26.659629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 63/117] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:26.660340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400c173-4a35-468f-b5d1-96af04105872 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:26.675734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c187b-52a9-4a7c-8d98-1c713efae48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:26.676827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c187b-52a9-4a7c-8d98-1c713efae48e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:26.677257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c187b-52a9-4a7c-8d98-1c713efae48e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:26.677688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c187b-52a9-4a7c-8d98-1c713efae48e None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:26.679319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c187b-52a9-4a7c-8d98-1c713efae48e None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:26.680920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c187b-52a9-4a7c-8d98-1c713efae48e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:26.682813 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 55/118] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:26 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:26.684176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253a035-e710-46d4-8450-68829de255dc None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:26.684471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253a035-e710-46d4-8450-68829de255dc None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:26.684754 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253a035-e710-46d4-8450-68829de255dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:26.705276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-4253a035-e710-46d4-8450-68829de255dc None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:26.706510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4253a035-e710-46d4-8450-68829de255dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:26.745579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:26.768568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:26.778077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400c173-4a35-468f-b5d1-96af04105872 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:26.779185 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 56/119] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:26.780013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253a035-e710-46d4-8450-68829de255dc None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:26.832618 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de78931-ba05-40c5-8630-dd9f0e6e611b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:26.833500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de78931-ba05-40c5-8630-dd9f0e6e611b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:26.833794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de78931-ba05-40c5-8630-dd9f0e6e611b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:26.834079 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de78931-ba05-40c5-8630-dd9f0e6e611b None admin] PATH_INFO: `/v3/users/446effb9e1f24b71a4cffe88e4bce86a` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:26.835463 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de78931-ba05-40c5-8630-dd9f0e6e611b None admin] RBAC: Authorizing `identity:get_user(user_id=446effb9e1f24b71a4cffe88e4bce86a)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:26.837044 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de78931-ba05-40c5-8630-dd9f0e6e611b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:26.838784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 64/120] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:26 2022] GET /identity/v3/users/446effb9e1f24b71a4cffe88e4bce86a => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:26.839387 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de78931-ba05-40c5-8630-dd9f0e6e611b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:26.882886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253a035-e710-46d4-8450-68829de255dc None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:26.920826 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd0f60-cc4c-4eca-9d09-7a5494bd5999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:26.921678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd0f60-cc4c-4eca-9d09-7a5494bd5999 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:26.921970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd0f60-cc4c-4eca-9d09-7a5494bd5999 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:26.922255 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd0f60-cc4c-4eca-9d09-7a5494bd5999 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:26.933061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd0f60-cc4c-4eca-9d09-7a5494bd5999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-32fd0f60-cc4c-4eca-9d09-7a5494bd5999 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:26.941362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:26.942444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:26.943401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:26.943401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:26.943401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:26.943401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:26.943401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:26.943401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:26.943401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:26.943401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:26.943401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:26.943401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:26.943401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:26.943401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:26.943401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 57/121] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:39:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:26.943401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd0f60-cc4c-4eca-9d09-7a5494bd5999 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:26.958157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de78931-ba05-40c5-8630-dd9f0e6e611b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:26.993172 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed36635-b5f2-4cdb-8c45-1598b1c13b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:26.993848 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed36635-b5f2-4cdb-8c45-1598b1c13b71 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:26.994141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed36635-b5f2-4cdb-8c45-1598b1c13b71 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:26.994457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed36635-b5f2-4cdb-8c45-1598b1c13b71 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:26.995218 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed36635-b5f2-4cdb-8c45-1598b1c13b71 None admin] RBAC: Adding query filter params (name=member) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:26.995534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed36635-b5f2-4cdb-8c45-1598b1c13b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:26.996927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed36635-b5f2-4cdb-8c45-1598b1c13b71 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:26.999666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:27.001972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:27.010539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 65/122] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:27.010539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed36635-b5f2-4cdb-8c45-1598b1c13b71 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:27.059476 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd0f60-cc4c-4eca-9d09-7a5494bd5999 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:27.095720 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b65a8-3382-47f2-8758-9cc7474b91cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:27.096709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b65a8-3382-47f2-8758-9cc7474b91cc None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:27.097199 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b65a8-3382-47f2-8758-9cc7474b91cc None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:27.097878 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b65a8-3382-47f2-8758-9cc7474b91cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:27.098730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b65a8-3382-47f2-8758-9cc7474b91cc None admin] RBAC: Adding query filter params (role.id=c611325a95844e85b977b39f6a7decd1, scope.project.id=bae51daa53924a5a9246a49472acf706, user.id=0f0778686ca741cba3a8f5155f302ab2) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:27.099048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b65a8-3382-47f2-8758-9cc7474b91cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:27.100591 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b65a8-3382-47f2-8758-9cc7474b91cc None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:27.106631 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 58/123] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:26 2022] GET /identity/v3/role_assignments?user.id=0f0778686ca741cba3a8f5155f302ab2&scope.project.id=bae51daa53924a5a9246a49472acf706&role.id=c611325a95844e85b977b39f6a7decd1 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:27.107424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b65a8-3382-47f2-8758-9cc7474b91cc None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:27.120120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed36635-b5f2-4cdb-8c45-1598b1c13b71 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:27.170736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec38585-f7c4-4064-b55b-6ec3135383a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:27.173210 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec38585-f7c4-4064-b55b-6ec3135383a1 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:27.173882 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec38585-f7c4-4064-b55b-6ec3135383a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:27.174490 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec38585-f7c4-4064-b55b-6ec3135383a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:27.191449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec38585-f7c4-4064-b55b-6ec3135383a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-9ec38585-f7c4-4064-b55b-6ec3135383a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:27.201735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:27.202763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:27.203539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:27.203539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:27.203539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:27.203539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:27.203539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:27.203539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:27.203539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:27.203539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:27.203539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:27.203539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:27.203539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:27.203539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:27.206745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 66/124] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:27.207869 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec38585-f7c4-4064-b55b-6ec3135383a1 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:27.234884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b65a8-3382-47f2-8758-9cc7474b91cc None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:27.254156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:27.278323 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca4109-c3cb-43de-9b76-4482e9f76d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:27.279402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca4109-c3cb-43de-9b76-4482e9f76d20 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:27.279798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca4109-c3cb-43de-9b76-4482e9f76d20 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:27.280208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca4109-c3cb-43de-9b76-4482e9f76d20 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:27.282281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca4109-c3cb-43de-9b76-4482e9f76d20 None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:27.284493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca4109-c3cb-43de-9b76-4482e9f76d20 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:27.290707 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 59/125] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:27 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:27.291814 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca4109-c3cb-43de-9b76-4482e9f76d20 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:27.299428 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:27.353457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec38585-f7c4-4064-b55b-6ec3135383a1 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:27.399608 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e4a85-7588-4677-a9ff-8b4038850caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:27.400849 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e4a85-7588-4677-a9ff-8b4038850caf None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:27.401145 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e4a85-7588-4677-a9ff-8b4038850caf None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:27.401435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e4a85-7588-4677-a9ff-8b4038850caf None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:27.402528 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e4a85-7588-4677-a9ff-8b4038850caf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:27.402855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e4a85-7588-4677-a9ff-8b4038850caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:27.404993 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e4a85-7588-4677-a9ff-8b4038850caf None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:27.414116 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca4109-c3cb-43de-9b76-4482e9f76d20 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:27.416534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 67/126] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:39:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:27.418086 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e4a85-7588-4677-a9ff-8b4038850caf None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:27.457704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67a035-a0af-418c-8079-00d430366b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:27.458651 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67a035-a0af-418c-8079-00d430366b53 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:27.459058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67a035-a0af-418c-8079-00d430366b53 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:27.459510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67a035-a0af-418c-8079-00d430366b53 None admin] PATH_INFO: `/v3/users/068f43858bd84ea9a8a4bd23968f5df6` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:27.461069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67a035-a0af-418c-8079-00d430366b53 None admin] RBAC: Authorizing `identity:get_user(user_id=068f43858bd84ea9a8a4bd23968f5df6)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:27.462632 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67a035-a0af-418c-8079-00d430366b53 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:27.464835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 60/127] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:27 2022] GET /identity/v3/users/068f43858bd84ea9a8a4bd23968f5df6 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:27.465539 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67a035-a0af-418c-8079-00d430366b53 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:27.529562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:27.551098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e4a85-7588-4677-a9ff-8b4038850caf None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:27.581253 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:27.587098 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67a035-a0af-418c-8079-00d430366b53 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:27.599290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78203467-548b-481c-ae56-4e97097c47d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:27.600012 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78203467-548b-481c-ae56-4e97097c47d0 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:27.600565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78203467-548b-481c-ae56-4e97097c47d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:27.600961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78203467-548b-481c-ae56-4e97097c47d0 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:27.601730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78203467-548b-481c-ae56-4e97097c47d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:27.602048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78203467-548b-481c-ae56-4e97097c47d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:27.604217 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78203467-548b-481c-ae56-4e97097c47d0 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:27.617356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 68/128] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:27.618371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78203467-548b-481c-ae56-4e97097c47d0 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:27.631063 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021ac60-a43e-4b96-97fa-3b4a2736e1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:27.632231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021ac60-a43e-4b96-97fa-3b4a2736e1dc None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:27.632772 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021ac60-a43e-4b96-97fa-3b4a2736e1dc None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:27.633279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021ac60-a43e-4b96-97fa-3b4a2736e1dc None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706/users/446effb9e1f24b71a4cffe88e4bce86a/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:27.635699 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021ac60-a43e-4b96-97fa-3b4a2736e1dc None admin] RBAC: Authorizing `identity:create_grant(project_id=bae51daa53924a5a9246a49472acf706, user_id=446effb9e1f24b71a4cffe88e4bce86a, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:27.637508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021ac60-a43e-4b96-97fa-3b4a2736e1dc None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:27.723662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 61/129] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:39:27 2022] PUT /identity/v3/projects/bae51daa53924a5a9246a49472acf706/users/446effb9e1f24b71a4cffe88e4bce86a/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:39:27.725789 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021ac60-a43e-4b96-97fa-3b4a2736e1dc None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:27.744899 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78203467-548b-481c-ae56-4e97097c47d0 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:27.817515 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59bb71-d735-434a-8982-4c44841ebc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:27.818971 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59bb71-d735-434a-8982-4c44841ebc0e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:27.820780 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59bb71-d735-434a-8982-4c44841ebc0e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:27.821495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59bb71-d735-434a-8982-4c44841ebc0e None admin] PATH_INFO: `/v3/users/068f43858bd84ea9a8a4bd23968f5df6` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:27.824624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59bb71-d735-434a-8982-4c44841ebc0e None admin] RBAC: Authorizing `identity:get_user(user_id=068f43858bd84ea9a8a4bd23968f5df6)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:27.827389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59bb71-d735-434a-8982-4c44841ebc0e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:27.830112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 69/130] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:27 2022] GET /identity/v3/users/068f43858bd84ea9a8a4bd23968f5df6 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:27.833320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59bb71-d735-434a-8982-4c44841ebc0e None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:27.932976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021ac60-a43e-4b96-97fa-3b4a2736e1dc None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:27.950704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:27.953493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:27.995706 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d08fe-9668-407c-8d01-651d97a7fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:27.997717 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d08fe-9668-407c-8d01-651d97a7fdc1 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:27.998207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d08fe-9668-407c-8d01-651d97a7fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:28.004426 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d08fe-9668-407c-8d01-651d97a7fdc1 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:28.004426 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d08fe-9668-407c-8d01-651d97a7fdc1 None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:28.004426 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d08fe-9668-407c-8d01-651d97a7fdc1 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:28.005755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 62/131] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:27 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:28.007047 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d08fe-9668-407c-8d01-651d97a7fdc1 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:28.020354 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59bb71-d735-434a-8982-4c44841ebc0e None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:28.057968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a033ea-f9e4-4b64-ae54-2d1ae4c7134b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:28.059080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a033ea-f9e4-4b64-ae54-2d1ae4c7134b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:28.059187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a033ea-f9e4-4b64-ae54-2d1ae4c7134b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:28.059440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a033ea-f9e4-4b64-ae54-2d1ae4c7134b None admin] PATH_INFO: `/v3/users/068f43858bd84ea9a8a4bd23968f5df6` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:28.060648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a033ea-f9e4-4b64-ae54-2d1ae4c7134b None admin] RBAC: Authorizing `identity:get_user(user_id=068f43858bd84ea9a8a4bd23968f5df6)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:28.062205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a033ea-f9e4-4b64-ae54-2d1ae4c7134b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:28.063796 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 70/132] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:27 2022] GET /identity/v3/users/068f43858bd84ea9a8a4bd23968f5df6 => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:28.064559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a033ea-f9e4-4b64-ae54-2d1ae4c7134b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:28.157685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d08fe-9668-407c-8d01-651d97a7fdc1 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:28.186592 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a033ea-f9e4-4b64-ae54-2d1ae4c7134b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:28.210526 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:28.230437 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb3870-deba-49ea-9a5b-34c2d7dde55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:28.231807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb3870-deba-49ea-9a5b-34c2d7dde55e None admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:28.232299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb3870-deba-49ea-9a5b-34c2d7dde55e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:28.232808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb3870-deba-49ea-9a5b-34c2d7dde55e None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706/users/068f43858bd84ea9a8a4bd23968f5df6/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:28.236398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb3870-deba-49ea-9a5b-34c2d7dde55e None admin] RBAC: Authorizing `identity:create_grant(project_id=bae51daa53924a5a9246a49472acf706, user_id=068f43858bd84ea9a8a4bd23968f5df6, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:28.238206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb3870-deba-49ea-9a5b-34c2d7dde55e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:28.239865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d28f50-7a33-4a36-b014-85cd28b3a577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:28.240762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d28f50-7a33-4a36-b014-85cd28b3a577 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:28.241056 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d28f50-7a33-4a36-b014-85cd28b3a577 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:28.241696 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d28f50-7a33-4a36-b014-85cd28b3a577 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:28.242967 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d28f50-7a33-4a36-b014-85cd28b3a577 None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:28.244619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d28f50-7a33-4a36-b014-85cd28b3a577 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:28.257176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 63/133] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:28 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:28.257176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d28f50-7a33-4a36-b014-85cd28b3a577 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:28.311695 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:28.348536 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 71/134] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:39:28 2022] PUT /identity/v3/projects/bae51daa53924a5a9246a49472acf706/users/068f43858bd84ea9a8a4bd23968f5df6/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:39:28.349609 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb3870-deba-49ea-9a5b-34c2d7dde55e None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:28.399991 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d28f50-7a33-4a36-b014-85cd28b3a577 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:28.471570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21e99f-29d8-40e3-b894-2335cd8db939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:28.474295 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21e99f-29d8-40e3-b894-2335cd8db939 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:28.476664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21e99f-29d8-40e3-b894-2335cd8db939 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:28.476970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21e99f-29d8-40e3-b894-2335cd8db939 None admin] PATH_INFO: `/v3/projects/af706032c52b42e4a105b9f072c18911` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:28.478258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21e99f-29d8-40e3-b894-2335cd8db939 None admin] RBAC: Authorizing `identity:get_project(project_id=af706032c52b42e4a105b9f072c18911)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:28.479899 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a21e99f-29d8-40e3-b894-2335cd8db939 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:28.481677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 64/135] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:28 2022] GET /identity/v3/projects/af706032c52b42e4a105b9f072c18911 => generated 312 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:28.487647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21e99f-29d8-40e3-b894-2335cd8db939 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:28.565752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb3870-deba-49ea-9a5b-34c2d7dde55e None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:28.602714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21e99f-29d8-40e3-b894-2335cd8db939 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:28.626751 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:28.642045 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42add7c-b3b6-4663-80bd-395a79306d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:28.642982 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42add7c-b3b6-4663-80bd-395a79306d4a None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:28.643092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c38d08-c71e-462f-a908-8f1a2d2dbe20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:28.650930 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42add7c-b3b6-4663-80bd-395a79306d4a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:28.650930 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42add7c-b3b6-4663-80bd-395a79306d4a None admin] PATH_INFO: `/v3/projects/af706032c52b42e4a105b9f072c18911/users/068f43858bd84ea9a8a4bd23968f5df6/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:28.651096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c38d08-c71e-462f-a908-8f1a2d2dbe20 None admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:28.651096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c38d08-c71e-462f-a908-8f1a2d2dbe20 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:28.651096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c38d08-c71e-462f-a908-8f1a2d2dbe20 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706/users/068f43858bd84ea9a8a4bd23968f5df6/roles/cba310daca814298b574fb2259749836` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:28.651283 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42add7c-b3b6-4663-80bd-395a79306d4a None admin] RBAC: Authorizing `identity:create_grant(project_id=af706032c52b42e4a105b9f072c18911, user_id=068f43858bd84ea9a8a4bd23968f5df6, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:28.651356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c38d08-c71e-462f-a908-8f1a2d2dbe20 None admin] RBAC: Authorizing `identity:create_grant(project_id=bae51daa53924a5a9246a49472acf706, user_id=068f43858bd84ea9a8a4bd23968f5df6, role_id=cba310daca814298b574fb2259749836)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:28.651422 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42add7c-b3b6-4663-80bd-395a79306d4a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:28.651508 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c38d08-c71e-462f-a908-8f1a2d2dbe20 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:28.701469 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 65/136] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:39:28 2022] PUT /identity/v3/projects/af706032c52b42e4a105b9f072c18911/users/068f43858bd84ea9a8a4bd23968f5df6/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 19:39:28.706893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875412d3-5047-4a13-873e-7a0d06bfd57e None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:28.707197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875412d3-5047-4a13-873e-7a0d06bfd57e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:28.707648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875412d3-5047-4a13-873e-7a0d06bfd57e None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:28.709064 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 66/137] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:28.715095 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77bdc1-3221-417c-8f88-93546143402f None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:28.715398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77bdc1-3221-417c-8f88-93546143402f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:28.715684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77bdc1-3221-417c-8f88-93546143402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:28.728964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 72/138] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:39:28 2022] PUT /identity/v3/projects/bae51daa53924a5a9246a49472acf706/users/068f43858bd84ea9a8a4bd23968f5df6/roles/cba310daca814298b574fb2259749836 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:39:28.743730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-ca77bdc1-3221-417c-8f88-93546143402f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:28.745143 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-ca77bdc1-3221-417c-8f88-93546143402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:28.848957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 67/139] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:28.896566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c38d08-c71e-462f-a908-8f1a2d2dbe20 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:28.967496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:29.055802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c38d08-c71e-462f-a908-8f1a2d2dbe20 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:29.097221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9fd5a-9056-4271-8712-3500519945b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:29.098047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9fd5a-9056-4271-8712-3500519945b8 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:29.098356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9fd5a-9056-4271-8712-3500519945b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:29.098646 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9fd5a-9056-4271-8712-3500519945b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:29.103348 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9fd5a-9056-4271-8712-3500519945b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:29.104804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9fd5a-9056-4271-8712-3500519945b8 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:29.106562 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 73/140] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:29.112266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77bdc1-3221-417c-8f88-93546143402f None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:29.224728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77bdc1-3221-417c-8f88-93546143402f None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:29.227167 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:29.264393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92632f-6c95-4287-a06b-8c41a55d99a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:29.265635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92632f-6c95-4287-a06b-8c41a55d99a1 None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:29.265926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92632f-6c95-4287-a06b-8c41a55d99a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:29.266212 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92632f-6c95-4287-a06b-8c41a55d99a1 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:29.266980 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92632f-6c95-4287-a06b-8c41a55d99a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:29.268453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92632f-6c95-4287-a06b-8c41a55d99a1 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:29.367399 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 68/141] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:39:29 2022] POST /identity/v3/users => generated 283 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:39:29.716433 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0ec54-bf3c-408a-b6d2-55b5cb7f4b6c None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:29.716792 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0ec54-bf3c-408a-b6d2-55b5cb7f4b6c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:29.716958 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0ec54-bf3c-408a-b6d2-55b5cb7f4b6c None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:29.718983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 74/142] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:29.724955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc1948-e45f-4d14-ab45-0d71be48fbb0 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:29.725464 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc1948-e45f-4d14-ab45-0d71be48fbb0 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:29.725915 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc1948-e45f-4d14-ab45-0d71be48fbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:29.744921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-37cc1948-e45f-4d14-ab45-0d71be48fbb0 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:29.746584 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-37cc1948-e45f-4d14-ab45-0d71be48fbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:29.826439 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 69/143] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:29.844529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0ec54-bf3c-408a-b6d2-55b5cb7f4b6c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:29.956240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0ec54-bf3c-408a-b6d2-55b5cb7f4b6c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:29.971032 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:30.003371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5f4a6-b218-4b88-94fc-bd86947aad55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:30.004216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5f4a6-b218-4b88-94fc-bd86947aad55 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:30.004518 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5f4a6-b218-4b88-94fc-bd86947aad55 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:30.004798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5f4a6-b218-4b88-94fc-bd86947aad55 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:30.021048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5f4a6-b218-4b88-94fc-bd86947aad55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-8ca5f4a6-b218-4b88-94fc-bd86947aad55 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:30.028674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:30.029516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:30.030266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:30.030266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:30.030266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:30.030266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:30.030266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:30.030266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:30.030266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:30.030266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:30.030266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:30.030266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:30.030266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:30.030266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:30.030266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 75/144] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:30.036321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc1948-e45f-4d14-ab45-0d71be48fbb0 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:30.139310 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:30.150328 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc1948-e45f-4d14-ab45-0d71be48fbb0 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:30.185988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbe854-31ed-4f3e-856c-d22580a8cb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:30.186728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbe854-31ed-4f3e-856c-d22580a8cb01 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:30.187189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbe854-31ed-4f3e-856c-d22580a8cb01 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:30.187851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbe854-31ed-4f3e-856c-d22580a8cb01 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:30.188617 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbe854-31ed-4f3e-856c-d22580a8cb01 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:30.189125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbe854-31ed-4f3e-856c-d22580a8cb01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:30.190537 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbe854-31ed-4f3e-856c-d22580a8cb01 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:30.199683 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 70/145] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:30.205483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5f4a6-b218-4b88-94fc-bd86947aad55 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:30.340425 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5f4a6-b218-4b88-94fc-bd86947aad55 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:30.378616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa3cf9-8700-4f25-9a33-33d521c3bd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:30.379501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa3cf9-8700-4f25-9a33-33d521c3bd29 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:30.379784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa3cf9-8700-4f25-9a33-33d521c3bd29 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:30.380061 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa3cf9-8700-4f25-9a33-33d521c3bd29 None admin] PATH_INFO: `/v3/users/0f0778686ca741cba3a8f5155f302ab2` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:30.381435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa3cf9-8700-4f25-9a33-33d521c3bd29 None admin] RBAC: Authorizing `identity:get_user(user_id=0f0778686ca741cba3a8f5155f302ab2)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:30.382915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa3cf9-8700-4f25-9a33-33d521c3bd29 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:30.384548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 76/146] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:30 2022] GET /identity/v3/users/0f0778686ca741cba3a8f5155f302ab2 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:30.390170 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbe854-31ed-4f3e-856c-d22580a8cb01 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:30.518917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbe854-31ed-4f3e-856c-d22580a8cb01 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:30.555930 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715abec-c446-496a-8a41-fbf32ef1ce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:30.556795 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715abec-c446-496a-8a41-fbf32ef1ce06 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:30.557086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715abec-c446-496a-8a41-fbf32ef1ce06 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:30.557367 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715abec-c446-496a-8a41-fbf32ef1ce06 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:30.558593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715abec-c446-496a-8a41-fbf32ef1ce06 None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:30.560034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715abec-c446-496a-8a41-fbf32ef1ce06 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:30.566470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 71/147] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:30 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:30.567852 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa3cf9-8700-4f25-9a33-33d521c3bd29 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:30.607004 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:30.681768 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa3cf9-8700-4f25-9a33-33d521c3bd29 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:30.741121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b76a54-4202-4e30-9260-982da2df036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:30.742021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b76a54-4202-4e30-9260-982da2df036c None admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:30.742308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b76a54-4202-4e30-9260-982da2df036c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:30.742611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b76a54-4202-4e30-9260-982da2df036c None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706/users/0f0778686ca741cba3a8f5155f302ab2/roles/c611325a95844e85b977b39f6a7decd1` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:30.747686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b76a54-4202-4e30-9260-982da2df036c None admin] RBAC: Authorizing `identity:create_grant(project_id=bae51daa53924a5a9246a49472acf706, user_id=0f0778686ca741cba3a8f5155f302ab2, role_id=c611325a95844e85b977b39f6a7decd1)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:30.749961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b76a54-4202-4e30-9260-982da2df036c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:30.824322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72bafd-f08f-49e2-a825-7a7364223033 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:30.824671 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72bafd-f08f-49e2-a825-7a7364223033 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:30.824968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c72bafd-f08f-49e2-a825-7a7364223033 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:30.826299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 72/148] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:39:30.836053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee188e-6e35-446f-ad5c-dcc260e28f4d None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:30.836634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee188e-6e35-446f-ad5c-dcc260e28f4d None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:30.840734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee188e-6e35-446f-ad5c-dcc260e28f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:30.846142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 77/149] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:39:30 2022] PUT /identity/v3/projects/bae51daa53924a5a9246a49472acf706/users/0f0778686ca741cba3a8f5155f302ab2/roles/c611325a95844e85b977b39f6a7decd1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:39:30.870972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-d8ee188e-6e35-446f-ad5c-dcc260e28f4d None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:30.870972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d8ee188e-6e35-446f-ad5c-dcc260e28f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:30.894798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:30.958235 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 73/150] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 27 19:39:31.003402 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b76a54-4202-4e30-9260-982da2df036c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:31.119825 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:31.126749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b76a54-4202-4e30-9260-982da2df036c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:31.169188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02050de5-386c-47c7-be51-406bc5f4f24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:31.170008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02050de5-386c-47c7-be51-406bc5f4f24d None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:31.170304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02050de5-386c-47c7-be51-406bc5f4f24d None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:31.170616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02050de5-386c-47c7-be51-406bc5f4f24d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:31.183723 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02050de5-386c-47c7-be51-406bc5f4f24d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-02050de5-386c-47c7-be51-406bc5f4f24d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:31.193219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:31.194111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:31.194994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:31.194994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:31.194994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:31.194994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:31.194994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:31.194994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:31.194994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:31.194994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:31.194994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:31.194994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:31.194994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:31.194994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:31.194994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 78/151] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:39:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:31.200596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee188e-6e35-446f-ad5c-dcc260e28f4d None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:31.353369 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee188e-6e35-446f-ad5c-dcc260e28f4d None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:31.399534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ab79-2185-4680-a4a0-5e52a5422727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:31.400534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ab79-2185-4680-a4a0-5e52a5422727 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:31.401034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ab79-2185-4680-a4a0-5e52a5422727 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:31.401505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ab79-2185-4680-a4a0-5e52a5422727 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:31.402488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522ab79-2185-4680-a4a0-5e52a5422727 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:31.403010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522ab79-2185-4680-a4a0-5e52a5422727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:31.404593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522ab79-2185-4680-a4a0-5e52a5422727 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:31.417943 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 74/152] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:31.424170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02050de5-386c-47c7-be51-406bc5f4f24d None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:31.582649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02050de5-386c-47c7-be51-406bc5f4f24d None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:31.630879 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40249866-74da-4860-8179-2836521778e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:31.631768 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40249866-74da-4860-8179-2836521778e5 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:31.632062 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40249866-74da-4860-8179-2836521778e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:31.632348 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40249866-74da-4860-8179-2836521778e5 None admin] PATH_INFO: `/v3/users/446effb9e1f24b71a4cffe88e4bce86a` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:31.633573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40249866-74da-4860-8179-2836521778e5 None admin] RBAC: Authorizing `identity:get_user(user_id=446effb9e1f24b71a4cffe88e4bce86a)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:31.635075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40249866-74da-4860-8179-2836521778e5 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:31.636734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 79/153] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:31 2022] GET /identity/v3/users/446effb9e1f24b71a4cffe88e4bce86a => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:31.643387 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ab79-2185-4680-a4a0-5e52a5422727 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:31.674797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:31.813983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ab79-2185-4680-a4a0-5e52a5422727 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:31.854603 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97654ab-2215-457e-875c-e184f40854d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:31.855263 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97654ab-2215-457e-875c-e184f40854d3 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:31.855546 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97654ab-2215-457e-875c-e184f40854d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:31.855822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97654ab-2215-457e-875c-e184f40854d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:31.944671 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97654ab-2215-457e-875c-e184f40854d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:31.946138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97654ab-2215-457e-875c-e184f40854d3 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:31.960916 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:32.057966 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 75/154] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:32.063481 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40249866-74da-4860-8179-2836521778e5 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:32.114055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:32.206945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40249866-74da-4860-8179-2836521778e5 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:32.239207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f14e5-06e3-4c13-a885-b847eaaca566 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:32.240259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f14e5-06e3-4c13-a885-b847eaaca566 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:32.240759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f14e5-06e3-4c13-a885-b847eaaca566 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:32.246437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 76/155] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:32.251458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3759f86-426e-4759-8676-4ad1912b8fb7 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:32.252008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3759f86-426e-4759-8676-4ad1912b8fb7 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:32.252480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3759f86-426e-4759-8676-4ad1912b8fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:32.260779 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb46c1-6b41-466f-b11d-a14f245cbc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:32.261663 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb46c1-6b41-466f-b11d-a14f245cbc31 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:32.261953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb46c1-6b41-466f-b11d-a14f245cbc31 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:32.262243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb46c1-6b41-466f-b11d-a14f245cbc31 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:32.263619 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb46c1-6b41-466f-b11d-a14f245cbc31 None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:32.265996 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb46c1-6b41-466f-b11d-a14f245cbc31 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:32.272665 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 80/156] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:32 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:32.273587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb46c1-6b41-466f-b11d-a14f245cbc31 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:32.291371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-f3759f86-426e-4759-8676-4ad1912b8fb7 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:32.292914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f3759f86-426e-4759-8676-4ad1912b8fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:32.452067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 77/157] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:32.467423 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:32.482398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb46c1-6b41-466f-b11d-a14f245cbc31 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:32.502315 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3759f86-426e-4759-8676-4ad1912b8fb7 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:32.543086 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c64bb0-948d-4421-b7d3-a54ba22c01ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:32.543764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c64bb0-948d-4421-b7d3-a54ba22c01ac None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:32.544054 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c64bb0-948d-4421-b7d3-a54ba22c01ac None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:32.544337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c64bb0-948d-4421-b7d3-a54ba22c01ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:32.545478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c64bb0-948d-4421-b7d3-a54ba22c01ac None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=bae51daa53924a5a9246a49472acf706, user.id=446effb9e1f24b71a4cffe88e4bce86a) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:32.545797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c64bb0-948d-4421-b7d3-a54ba22c01ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:32.547761 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c64bb0-948d-4421-b7d3-a54ba22c01ac None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:32.555515 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 81/158] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:32 2022] GET /identity/v3/role_assignments?user.id=446effb9e1f24b71a4cffe88e4bce86a&scope.project.id=bae51daa53924a5a9246a49472acf706&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:32.588049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:32.665778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3759f86-426e-4759-8676-4ad1912b8fb7 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:32.711590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e411c66-ade8-4430-a91b-06615c0cf833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:32.712419 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e411c66-ade8-4430-a91b-06615c0cf833 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:32.712703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e411c66-ade8-4430-a91b-06615c0cf833 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:32.712982 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e411c66-ade8-4430-a91b-06615c0cf833 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:32.729356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e411c66-ade8-4430-a91b-06615c0cf833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-6e411c66-ade8-4430-a91b-06615c0cf833 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:32.737657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:32.738589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:32.740053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:32.740053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:32.740053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:32.740053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:32.740053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:32.740053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:32.740053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:32.740053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:32.740053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:32.740053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:32.740053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:32.740053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:32.740053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 78/159] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:39:32.745110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c64bb0-948d-4421-b7d3-a54ba22c01ac None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:32.933122 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c64bb0-948d-4421-b7d3-a54ba22c01ac None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:32.976624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cdb97-97fb-4b85-a507-e3e7c2d2debf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:32.977321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cdb97-97fb-4b85-a507-e3e7c2d2debf None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:32.977614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cdb97-97fb-4b85-a507-e3e7c2d2debf None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:32.977902 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cdb97-97fb-4b85-a507-e3e7c2d2debf None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:32.978700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cdb97-97fb-4b85-a507-e3e7c2d2debf None admin] RBAC: Adding query filter params (name=member) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:32.979021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cdb97-97fb-4b85-a507-e3e7c2d2debf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:32.980494 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cdb97-97fb-4b85-a507-e3e7c2d2debf None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:32.995169 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 82/160] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:33.002116 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e411c66-ade8-4430-a91b-06615c0cf833 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:33.134598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150498de-fc94-424d-ad1c-e49d1b4e3236 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:33.135294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150498de-fc94-424d-ad1c-e49d1b4e3236 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:33.135798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150498de-fc94-424d-ad1c-e49d1b4e3236 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:33.137393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 83/161] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:33.153509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0a7ae-0168-400c-95e7-4a3c3c7ca930 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:33.154110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0a7ae-0168-400c-95e7-4a3c3c7ca930 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:33.154618 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0a7ae-0168-400c-95e7-4a3c3c7ca930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:33.170420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e411c66-ade8-4430-a91b-06615c0cf833 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:33.172644 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:33.188199 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e9d0a7ae-0168-400c-95e7-4a3c3c7ca930 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:33.189687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e9d0a7ae-0168-400c-95e7-4a3c3c7ca930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:33.219175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:33.231677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6270b92-db20-48f5-a6e8-5b0ee62f3287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:33.232500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6270b92-db20-48f5-a6e8-5b0ee62f3287 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:33.232789 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6270b92-db20-48f5-a6e8-5b0ee62f3287 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:33.234061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6270b92-db20-48f5-a6e8-5b0ee62f3287 None admin] PATH_INFO: `/v3/users/068f43858bd84ea9a8a4bd23968f5df6` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:33.235358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6270b92-db20-48f5-a6e8-5b0ee62f3287 None admin] RBAC: Authorizing `identity:get_user(user_id=068f43858bd84ea9a8a4bd23968f5df6)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:33.237232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6270b92-db20-48f5-a6e8-5b0ee62f3287 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:33.239091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 79/162] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:33 2022] GET /identity/v3/users/068f43858bd84ea9a8a4bd23968f5df6 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:33.245043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6270b92-db20-48f5-a6e8-5b0ee62f3287 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:33.340726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 84/163] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:33.342079 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c41ed-fe86-474e-9a52-d062ee5a193a None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:33.342392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c41ed-fe86-474e-9a52-d062ee5a193a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:33.342685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c41ed-fe86-474e-9a52-d062ee5a193a None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:33.344549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 85/164] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:33.350249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68a7ac-1436-424b-9e07-32523f5887be None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:33.350632 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68a7ac-1436-424b-9e07-32523f5887be None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:33.350871 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68a7ac-1436-424b-9e07-32523f5887be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:33.380703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-0a68a7ac-1436-424b-9e07-32523f5887be None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:33.381910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-0a68a7ac-1436-424b-9e07-32523f5887be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:33.431673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6270b92-db20-48f5-a6e8-5b0ee62f3287 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:33.486453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccec39d-9817-4a9d-a30c-0fc34434d66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:33.486453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccec39d-9817-4a9d-a30c-0fc34434d66b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:33.486453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccec39d-9817-4a9d-a30c-0fc34434d66b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:33.486453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccec39d-9817-4a9d-a30c-0fc34434d66b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:33.545288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:33.555898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 86/165] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:33.557878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68a7ac-1436-424b-9e07-32523f5887be None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:33.603391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccec39d-9817-4a9d-a30c-0fc34434d66b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:33.604895 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccec39d-9817-4a9d-a30c-0fc34434d66b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:33.664418 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:33.684701 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68a7ac-1436-424b-9e07-32523f5887be None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:33.721215 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bc274-9e51-4366-b536-a2d17c19e95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:33.722082 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bc274-9e51-4366-b536-a2d17c19e95c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:33.722694 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bc274-9e51-4366-b536-a2d17c19e95c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:33.722917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bc274-9e51-4366-b536-a2d17c19e95c None admin] PATH_INFO: `/v3/roles/member` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:33.734298 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bc274-9e51-4366-b536-a2d17c19e95c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-ac6bc274-9e51-4366-b536-a2d17c19e95c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:33.743116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:33.743963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:33.745411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:33.745411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:33.745411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:33.745411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:33.745411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:33.745411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:33.745411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:33.745411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:33.745411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:33.745411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:33.745411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:33.745411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:33.745411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 87/166] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:33.745411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bc274-9e51-4366-b536-a2d17c19e95c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:33.793661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 80/167] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:33.794866 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccec39d-9817-4a9d-a30c-0fc34434d66b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:33.887933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:33.923124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccec39d-9817-4a9d-a30c-0fc34434d66b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:33.952643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bc274-9e51-4366-b536-a2d17c19e95c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:33.963609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13278be-b6e1-44e3-8d40-a59ebfd8c9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:33.964787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13278be-b6e1-44e3-8d40-a59ebfd8c9f2 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:33.965077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13278be-b6e1-44e3-8d40-a59ebfd8c9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:33.965361 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13278be-b6e1-44e3-8d40-a59ebfd8c9f2 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:33.966117 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13278be-b6e1-44e3-8d40-a59ebfd8c9f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:33.966454 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13278be-b6e1-44e3-8d40-a59ebfd8c9f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:33.968372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13278be-b6e1-44e3-8d40-a59ebfd8c9f2 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:33.986107 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 81/168] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:33.987059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13278be-b6e1-44e3-8d40-a59ebfd8c9f2 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:34.028821 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacd7db-4a66-45b2-93f6-360678834296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:34.029556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacd7db-4a66-45b2-93f6-360678834296 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:34.029838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacd7db-4a66-45b2-93f6-360678834296 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:34.030113 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacd7db-4a66-45b2-93f6-360678834296 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:34.038505 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:34.042731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacd7db-4a66-45b2-93f6-360678834296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-9bacd7db-4a66-45b2-93f6-360678834296 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:34.052278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:34.053457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:34.054334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:34.054334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:34.054334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:34.054334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:34.054334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:34.054334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:34.054334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:34.054334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:34.054334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:34.054334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:34.054334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:34.054334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:34.060485 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 88/169] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:39:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:34.060485 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacd7db-4a66-45b2-93f6-360678834296 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:34.160115 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13278be-b6e1-44e3-8d40-a59ebfd8c9f2 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:34.170926 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacd7db-4a66-45b2-93f6-360678834296 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:34.207760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40732d-1e5e-4ce7-821c-7063576ad69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:34.209135 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40732d-1e5e-4ce7-821c-7063576ad69e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:34.209720 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40732d-1e5e-4ce7-821c-7063576ad69e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:34.210460 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:34.210759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40732d-1e5e-4ce7-821c-7063576ad69e None admin] PATH_INFO: `/v3/users/068f43858bd84ea9a8a4bd23968f5df6` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:34.213006 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40732d-1e5e-4ce7-821c-7063576ad69e None admin] RBAC: Authorizing `identity:get_user(user_id=068f43858bd84ea9a8a4bd23968f5df6)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:34.214707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be40732d-1e5e-4ce7-821c-7063576ad69e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:34.216561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 89/170] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:34 2022] GET /identity/v3/users/068f43858bd84ea9a8a4bd23968f5df6 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:34.221487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a177ae7-2bbb-4412-bdd5-8d8ddeb236f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:34.221487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a177ae7-2bbb-4412-bdd5-8d8ddeb236f5 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:34.221487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a177ae7-2bbb-4412-bdd5-8d8ddeb236f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:34.221487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a177ae7-2bbb-4412-bdd5-8d8ddeb236f5 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:34.222977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40732d-1e5e-4ce7-821c-7063576ad69e None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:34.227771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a177ae7-2bbb-4412-bdd5-8d8ddeb236f5 None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:34.228700 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a177ae7-2bbb-4412-bdd5-8d8ddeb236f5 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:34.230702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 82/171] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:33 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:34.231473 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a177ae7-2bbb-4412-bdd5-8d8ddeb236f5 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:34.300310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:34.333351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40732d-1e5e-4ce7-821c-7063576ad69e None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:34.371204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826385-c8f7-4bc5-8ef8-92beebf6425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:34.372099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826385-c8f7-4bc5-8ef8-92beebf6425c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:34.372457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826385-c8f7-4bc5-8ef8-92beebf6425c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:34.372811 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826385-c8f7-4bc5-8ef8-92beebf6425c None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:34.373645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b826385-c8f7-4bc5-8ef8-92beebf6425c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:34.374741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b826385-c8f7-4bc5-8ef8-92beebf6425c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:34.376220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b826385-c8f7-4bc5-8ef8-92beebf6425c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:34.385206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 90/172] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:39:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:34.391146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826385-c8f7-4bc5-8ef8-92beebf6425c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:34.400366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a177ae7-2bbb-4412-bdd5-8d8ddeb236f5 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:34.459071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42a83c-e9ae-4131-aca1-774009e970c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:34.459742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42a83c-e9ae-4131-aca1-774009e970c9 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:34.460031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42a83c-e9ae-4131-aca1-774009e970c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:34.460319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42a83c-e9ae-4131-aca1-774009e970c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:34.513112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826385-c8f7-4bc5-8ef8-92beebf6425c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:34.542870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:34.552005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7e566-47d8-4157-ae65-69365cdd5127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:34.552689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7e566-47d8-4157-ae65-69365cdd5127 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:34.553527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7e566-47d8-4157-ae65-69365cdd5127 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:34.553880 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7e566-47d8-4157-ae65-69365cdd5127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:34.555008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7e566-47d8-4157-ae65-69365cdd5127 None admin] RBAC: Adding query filter params (role.id=c638961e289c4d108d8c584cb350a509, scope.project.id=bae51daa53924a5a9246a49472acf706, user.id=068f43858bd84ea9a8a4bd23968f5df6) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:34.555444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7e566-47d8-4157-ae65-69365cdd5127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:34.557030 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7e566-47d8-4157-ae65-69365cdd5127 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:34.564794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 91/173] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:34 2022] GET /identity/v3/role_assignments?user.id=068f43858bd84ea9a8a4bd23968f5df6&scope.project.id=bae51daa53924a5a9246a49472acf706&role.id=c638961e289c4d108d8c584cb350a509 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:34.565792 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7e566-47d8-4157-ae65-69365cdd5127 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:34.586494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:34.593625 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42a83c-e9ae-4131-aca1-774009e970c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:34.595193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42a83c-e9ae-4131-aca1-774009e970c9 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:34.691866 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7e566-47d8-4157-ae65-69365cdd5127 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:34.739533 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace0f59-f897-47ef-b348-86ec01cc78d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:34.740906 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace0f59-f897-47ef-b348-86ec01cc78d9 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:34.741433 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace0f59-f897-47ef-b348-86ec01cc78d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:34.741888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace0f59-f897-47ef-b348-86ec01cc78d9 None admin] PATH_INFO: `/v3/users/068f43858bd84ea9a8a4bd23968f5df6` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:34.743510 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace0f59-f897-47ef-b348-86ec01cc78d9 None admin] RBAC: Authorizing `identity:get_user(user_id=068f43858bd84ea9a8a4bd23968f5df6)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:34.745354 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace0f59-f897-47ef-b348-86ec01cc78d9 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:34.747521 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 92/174] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:34 2022] GET /identity/v3/users/068f43858bd84ea9a8a4bd23968f5df6 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:34.756437 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace0f59-f897-47ef-b348-86ec01cc78d9 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:34.797698 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 83/175] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:34.814302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42a83c-e9ae-4131-aca1-774009e970c9 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:34.862731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:34.932626 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace0f59-f897-47ef-b348-86ec01cc78d9 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:34.982805 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc9e30-1e72-42e3-a10d-2c9ab3fe8bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:34.984494 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc9e30-1e72-42e3-a10d-2c9ab3fe8bf3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:34.984959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc9e30-1e72-42e3-a10d-2c9ab3fe8bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:34.987525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc9e30-1e72-42e3-a10d-2c9ab3fe8bf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:34.989805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:34.992699 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42a83c-e9ae-4131-aca1-774009e970c9 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:35.035216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd5a68-130c-4cce-b3c1-65adeb109fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:35.036512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd5a68-130c-4cce-b3c1-65adeb109fde None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.037287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd5a68-130c-4cce-b3c1-65adeb109fde None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.037804 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd5a68-130c-4cce-b3c1-65adeb109fde None admin] PATH_INFO: `/v3/projects/af706032c52b42e4a105b9f072c18911` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.039480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd5a68-130c-4cce-b3c1-65adeb109fde None admin] RBAC: Authorizing `identity:get_project(project_id=af706032c52b42e4a105b9f072c18911)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:35.041150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd5a68-130c-4cce-b3c1-65adeb109fde None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:35.043264 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 84/176] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:34 2022] GET /identity/v3/projects/af706032c52b42e4a105b9f072c18911 => generated 312 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:35.044833 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b6dbf-3037-463a-84d5-e23d51ad6ab2 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.045317 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b6dbf-3037-463a-84d5-e23d51ad6ab2 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.045834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b6dbf-3037-463a-84d5-e23d51ad6ab2 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.047300 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 85/177] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:35.048788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9c78e-a896-4c8e-b214-3646ea6dbc19 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.049274 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9c78e-a896-4c8e-b214-3646ea6dbc19 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.049762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9c78e-a896-4c8e-b214-3646ea6dbc19 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.051268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 86/178] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:35.052223 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9c78e-a896-4c8e-b214-3646ea6dbc19 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:35.086796 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc9e30-1e72-42e3-a10d-2c9ab3fe8bf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:35.089108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc9e30-1e72-42e3-a10d-2c9ab3fe8bf3 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:35.177317 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:35.198508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9c78e-a896-4c8e-b214-3646ea6dbc19 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:35.232007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 93/179] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:35.232709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c6d4c-1c7b-4b81-96ff-e56a66867cac None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.233001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c6d4c-1c7b-4b81-96ff-e56a66867cac None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.233461 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c6d4c-1c7b-4b81-96ff-e56a66867cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.242030 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8a635-3b4f-4fcc-accd-b2c905f8bdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:35.242726 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8a635-3b4f-4fcc-accd-b2c905f8bdfa None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.243017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8a635-3b4f-4fcc-accd-b2c905f8bdfa None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.243302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8a635-3b4f-4fcc-accd-b2c905f8bdfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.244142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8a635-3b4f-4fcc-accd-b2c905f8bdfa None admin] RBAC: Adding query filter params (role.id=c638961e289c4d108d8c584cb350a509, scope.project.id=af706032c52b42e4a105b9f072c18911, user.id=068f43858bd84ea9a8a4bd23968f5df6) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:35.244461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8a635-3b4f-4fcc-accd-b2c905f8bdfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:35.246117 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8a635-3b4f-4fcc-accd-b2c905f8bdfa None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:35.252213 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-d05c6d4c-1c7b-4b81-96ff-e56a66867cac None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:35.252340 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 87/180] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:35 2022] GET /identity/v3/role_assignments?user.id=068f43858bd84ea9a8a4bd23968f5df6&scope.project.id=af706032c52b42e4a105b9f072c18911&role.id=c638961e289c4d108d8c584cb350a509 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:35.253516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d26e1-8f16-4fbf-bf53-c6e2192b12fa None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.253811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d26e1-8f16-4fbf-bf53-c6e2192b12fa None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.254092 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d26e1-8f16-4fbf-bf53-c6e2192b12fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.255875 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d05c6d4c-1c7b-4b81-96ff-e56a66867cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:35.278320 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-080d26e1-8f16-4fbf-bf53-c6e2192b12fa None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:35.279679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-080d26e1-8f16-4fbf-bf53-c6e2192b12fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:35.317788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:35.338401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 94/181] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:35.344064 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc98a1-3efa-4e0e-bab8-cb917ffda357 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.344384 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc98a1-3efa-4e0e-bab8-cb917ffda357 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.344981 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc98a1-3efa-4e0e-bab8-cb917ffda357 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.346789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 95/182] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:35.347363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc98a1-3efa-4e0e-bab8-cb917ffda357 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:35.372474 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 88/183] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:35.374666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511e17-5141-4d44-a087-ba3635c650ae None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.375003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511e17-5141-4d44-a087-ba3635c650ae None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.375291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6511e17-5141-4d44-a087-ba3635c650ae None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.380835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 89/184] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:35.380835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185763f-3b6a-4e66-b889-7f6e173edb95 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.380835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185763f-3b6a-4e66-b889-7f6e173edb95 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.380835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185763f-3b6a-4e66-b889-7f6e173edb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.404521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-0185763f-3b6a-4e66-b889-7f6e173edb95 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:35.406284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-0185763f-3b6a-4e66-b889-7f6e173edb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:35.464742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:35.478296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc98a1-3efa-4e0e-bab8-cb917ffda357 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:35.493757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 90/185] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:35.498551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185763f-3b6a-4e66-b889-7f6e173edb95 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:35.520041 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6888f9-66ac-4304-a882-c9ba4ff6aad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:35.521439 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6888f9-66ac-4304-a882-c9ba4ff6aad7 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.521740 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6888f9-66ac-4304-a882-c9ba4ff6aad7 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.522085 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6888f9-66ac-4304-a882-c9ba4ff6aad7 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.523351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6888f9-66ac-4304-a882-c9ba4ff6aad7 None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:35.524812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6888f9-66ac-4304-a882-c9ba4ff6aad7 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:35.531898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 96/186] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:35 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:35.533072 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1f8ef-2655-42e9-846a-60a8f37f19aa None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.533364 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1f8ef-2655-42e9-846a-60a8f37f19aa None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.533644 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1f8ef-2655-42e9-846a-60a8f37f19aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.550673 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-54c1f8ef-2655-42e9-846a-60a8f37f19aa None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:35.551851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-54c1f8ef-2655-42e9-846a-60a8f37f19aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:35.601437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:35.610118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185763f-3b6a-4e66-b889-7f6e173edb95 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:35.618951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 97/187] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:35.630981 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1f8ef-2655-42e9-846a-60a8f37f19aa None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:35.647331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd864f-8208-412c-867c-b259d8ba83bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:35.648238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd864f-8208-412c-867c-b259d8ba83bb None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.648595 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd864f-8208-412c-867c-b259d8ba83bb None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.648965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd864f-8208-412c-867c-b259d8ba83bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.659366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd864f-8208-412c-867c-b259d8ba83bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-cecd864f-8208-412c-867c-b259d8ba83bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:35.667319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:35.668179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:35.669308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:35.669308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:35.669308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:35.669308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:35.669308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:35.669308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:35.669308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:35.669308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:35.669308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:35.669308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:35.669308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:35.669308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:35.669308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 91/188] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:35.669308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd864f-8208-412c-867c-b259d8ba83bb None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:35.722910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:35.735584 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1f8ef-2655-42e9-846a-60a8f37f19aa None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:35.769693 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd864f-8208-412c-867c-b259d8ba83bb None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:35.772274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00485a9-54bc-4bd4-960d-596ea85c95b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:35.773169 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00485a9-54bc-4bd4-960d-596ea85c95b4 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.773461 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00485a9-54bc-4bd4-960d-596ea85c95b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.773741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00485a9-54bc-4bd4-960d-596ea85c95b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.784788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00485a9-54bc-4bd4-960d-596ea85c95b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-d00485a9-54bc-4bd4-960d-596ea85c95b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:35.794119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:35.795090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:35.795904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:35.795904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:35.795904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:35.795904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:35.795904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:35.795904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:35.795904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:35.795904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:35.795904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:35.795904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:35.795904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:35.795904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:35.795904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 98/189] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:39:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:35.796554 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00485a9-54bc-4bd4-960d-596ea85c95b4 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:35.808859 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef907c-544b-49d3-9f42-42ed32ba40a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:35.809671 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef907c-544b-49d3-9f42-42ed32ba40a3 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.809955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef907c-544b-49d3-9f42-42ed32ba40a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.810230 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef907c-544b-49d3-9f42-42ed32ba40a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.820844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef907c-544b-49d3-9f42-42ed32ba40a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-15ef907c-544b-49d3-9f42-42ed32ba40a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:35.829609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:35.830573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:35.831692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:35.831692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:35.831692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:35.831692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:35.831692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:35.831692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:35.831692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:35.831692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:35.831692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:35.831692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:35.831692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:35.831692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:35.831692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 92/190] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:39:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:35.831692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef907c-544b-49d3-9f42-42ed32ba40a3 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:35.847099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:35.906111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00485a9-54bc-4bd4-960d-596ea85c95b4 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:35.929637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef907c-544b-49d3-9f42-42ed32ba40a3 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:35.938451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b88ff-e0f0-470a-bae9-f7c1c72c129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:35.939110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b88ff-e0f0-470a-bae9-f7c1c72c129b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.939402 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b88ff-e0f0-470a-bae9-f7c1c72c129b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.939688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b88ff-e0f0-470a-bae9-f7c1c72c129b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.940523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b88ff-e0f0-470a-bae9-f7c1c72c129b None admin] RBAC: Adding query filter params (role.id=cba310daca814298b574fb2259749836, scope.project.id=bae51daa53924a5a9246a49472acf706, user.id=068f43858bd84ea9a8a4bd23968f5df6) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:35.940936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b88ff-e0f0-470a-bae9-f7c1c72c129b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:35.942423 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b88ff-e0f0-470a-bae9-f7c1c72c129b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:35.948295 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 99/191] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:35 2022] GET /identity/v3/role_assignments?user.id=068f43858bd84ea9a8a4bd23968f5df6&scope.project.id=bae51daa53924a5a9246a49472acf706&role.id=cba310daca814298b574fb2259749836 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:35.949078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b88ff-e0f0-470a-bae9-f7c1c72c129b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:35.965999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:35.976684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558083b7-9719-46d9-ab25-fe7822d37418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:35.977577 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558083b7-9719-46d9-ab25-fe7822d37418 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:35.979882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558083b7-9719-46d9-ab25-fe7822d37418 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:35.979882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558083b7-9719-46d9-ab25-fe7822d37418 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:35.979882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558083b7-9719-46d9-ab25-fe7822d37418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:35.981194 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558083b7-9719-46d9-ab25-fe7822d37418 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:35.987771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 93/192] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:35.987771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558083b7-9719-46d9-ab25-fe7822d37418 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:36.071893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b88ff-e0f0-470a-bae9-f7c1c72c129b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:36.078308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:36.098788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558083b7-9719-46d9-ab25-fe7822d37418 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:36.109503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ec568-6693-4800-b3e1-1d69795e4734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:36.110209 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ec568-6693-4800-b3e1-1d69795e4734 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:36.110532 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ec568-6693-4800-b3e1-1d69795e4734 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:36.110820 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ec568-6693-4800-b3e1-1d69795e4734 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:36.111592 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ec568-6693-4800-b3e1-1d69795e4734 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:36.111903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ec568-6693-4800-b3e1-1d69795e4734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:36.113319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ec568-6693-4800-b3e1-1d69795e4734 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:36.125647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 100/193] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:36.126967 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ec568-6693-4800-b3e1-1d69795e4734 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:36.144999 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a1b11-be28-4bb9-bb19-96e0d0851bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:36.145672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a1b11-be28-4bb9-bb19-96e0d0851bd8 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:36.145957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a1b11-be28-4bb9-bb19-96e0d0851bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:36.146241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a1b11-be28-4bb9-bb19-96e0d0851bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:36.147059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a1b11-be28-4bb9-bb19-96e0d0851bd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:36.147375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a1b11-be28-4bb9-bb19-96e0d0851bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:36.148750 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a1b11-be28-4bb9-bb19-96e0d0851bd8 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:36.159378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 94/194] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:36.160121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a1b11-be28-4bb9-bb19-96e0d0851bd8 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:36.212227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:36.237876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ec568-6693-4800-b3e1-1d69795e4734 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:36.263347 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a1b11-be28-4bb9-bb19-96e0d0851bd8 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:36.272038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c7bec-8dd9-4bf8-b5af-8f982a44e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:36.272715 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c7bec-8dd9-4bf8-b5af-8f982a44e525 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:36.273002 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c7bec-8dd9-4bf8-b5af-8f982a44e525 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:36.273281 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c7bec-8dd9-4bf8-b5af-8f982a44e525 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:36.274027 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c7bec-8dd9-4bf8-b5af-8f982a44e525 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:36.274365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c7bec-8dd9-4bf8-b5af-8f982a44e525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:36.275813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c7bec-8dd9-4bf8-b5af-8f982a44e525 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:36.283575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 101/195] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:39:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:36.284348 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c7bec-8dd9-4bf8-b5af-8f982a44e525 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:36.301143 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a490c1-d1c4-4da0-b488-1073a7fb6b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:36.301830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a490c1-d1c4-4da0-b488-1073a7fb6b3e None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:36.302118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a490c1-d1c4-4da0-b488-1073a7fb6b3e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:36.302429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a490c1-d1c4-4da0-b488-1073a7fb6b3e None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:36.303413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a490c1-d1c4-4da0-b488-1073a7fb6b3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:36.304849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a490c1-d1c4-4da0-b488-1073a7fb6b3e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:36.380778 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c7bec-8dd9-4bf8-b5af-8f982a44e525 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:36.403202 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:36.411772 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 95/196] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:39:36 2022] POST /identity/v3/users => generated 297 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:39:36.411772 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a490c1-d1c4-4da0-b488-1073a7fb6b3e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:36.416751 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146037d5-361a-4538-9d0b-904e8b4444f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:36.417672 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146037d5-361a-4538-9d0b-904e8b4444f3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:36.417963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146037d5-361a-4538-9d0b-904e8b4444f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:36.418248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146037d5-361a-4538-9d0b-904e8b4444f3 None admin] PATH_INFO: `/v3/users/0f0778686ca741cba3a8f5155f302ab2` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:36.419708 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146037d5-361a-4538-9d0b-904e8b4444f3 None admin] RBAC: Authorizing `identity:get_user(user_id=0f0778686ca741cba3a8f5155f302ab2)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:36.421292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146037d5-361a-4538-9d0b-904e8b4444f3 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:36.423268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 102/197] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:36 2022] GET /identity/v3/users/0f0778686ca741cba3a8f5155f302ab2 => generated 289 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:36.423268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146037d5-361a-4538-9d0b-904e8b4444f3 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:36.429322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:36.535415 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a490c1-d1c4-4da0-b488-1073a7fb6b3e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:36.538580 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146037d5-361a-4538-9d0b-904e8b4444f3 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:36.573754 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7e09b-3af6-4cf8-a5d3-3a7aea3147c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:36.574704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7e09b-3af6-4cf8-a5d3-3a7aea3147c6 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:36.574996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7e09b-3af6-4cf8-a5d3-3a7aea3147c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:36.575281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7e09b-3af6-4cf8-a5d3-3a7aea3147c6 None admin] PATH_INFO: `/v3/users/ac5958eebbcb4dbab7b23d01605e7c20` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:36.578137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d58d3-2d97-4456-8cf0-d670191ab107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:36.579610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d58d3-2d97-4456-8cf0-d670191ab107 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:36.579610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d58d3-2d97-4456-8cf0-d670191ab107 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:36.579610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d58d3-2d97-4456-8cf0-d670191ab107 None admin] PATH_INFO: `/v3/users/ac5958eebbcb4dbab7b23d01605e7c20` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:36.593878 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7e09b-3af6-4cf8-a5d3-3a7aea3147c6 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5958eebbcb4dbab7b23d01605e7c20)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:36.595370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7e09b-3af6-4cf8-a5d3-3a7aea3147c6 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:36.595594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d58d3-2d97-4456-8cf0-d670191ab107 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5958eebbcb4dbab7b23d01605e7c20)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:36.598043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 96/198] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:36 2022] GET /identity/v3/users/ac5958eebbcb4dbab7b23d01605e7c20 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:36.598157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d58d3-2d97-4456-8cf0-d670191ab107 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:36.598228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7e09b-3af6-4cf8-a5d3-3a7aea3147c6 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:36.603800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 103/199] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:36 2022] GET /identity/v3/users/ac5958eebbcb4dbab7b23d01605e7c20 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:36.603800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d58d3-2d97-4456-8cf0-d670191ab107 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:36.675642 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:36.678616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:36.735329 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d58d3-2d97-4456-8cf0-d670191ab107 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:36.737423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7e09b-3af6-4cf8-a5d3-3a7aea3147c6 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:36.779132 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226fa2c-c7cc-4707-a1c8-7a2d8afaf904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:36.780111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226fa2c-c7cc-4707-a1c8-7a2d8afaf904 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:36.780402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226fa2c-c7cc-4707-a1c8-7a2d8afaf904 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:36.780714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226fa2c-c7cc-4707-a1c8-7a2d8afaf904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:36.784213 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5add304-1465-4ba5-9eea-b4383938c0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:36.784766 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add304-1465-4ba5-9eea-b4383938c0e6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:36.785054 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add304-1465-4ba5-9eea-b4383938c0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:36.785329 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add304-1465-4ba5-9eea-b4383938c0e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:36.856611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5add304-1465-4ba5-9eea-b4383938c0e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:36.858112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5add304-1465-4ba5-9eea-b4383938c0e6 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:36.860823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226fa2c-c7cc-4707-a1c8-7a2d8afaf904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:36.862458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226fa2c-c7cc-4707-a1c8-7a2d8afaf904 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:36.921403 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:36.937693 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:36.962797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 104/200] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 19:39:36.963856 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5add304-1465-4ba5-9eea-b4383938c0e6 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:36.980739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 97/201] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:36.981917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226fa2c-c7cc-4707-a1c8-7a2d8afaf904 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:37.066776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5add304-1465-4ba5-9eea-b4383938c0e6 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:37.088810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226fa2c-c7cc-4707-a1c8-7a2d8afaf904 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:37.110484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bcfa4-1f40-42e2-95bb-d579e571d239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:37.111298 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bcfa4-1f40-42e2-95bb-d579e571d239 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:37.111688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bcfa4-1f40-42e2-95bb-d579e571d239 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:37.112069 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bcfa4-1f40-42e2-95bb-d579e571d239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:37.127808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc010f4-9ddd-4f79-aa3c-2a8be6c586f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:37.128892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc010f4-9ddd-4f79-aa3c-2a8be6c586f1 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:37.129344 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc010f4-9ddd-4f79-aa3c-2a8be6c586f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:37.129629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc010f4-9ddd-4f79-aa3c-2a8be6c586f1 None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:37.130900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc010f4-9ddd-4f79-aa3c-2a8be6c586f1 None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:37.132355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc010f4-9ddd-4f79-aa3c-2a8be6c586f1 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:37.134075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 98/202] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:36 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:37.134898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc010f4-9ddd-4f79-aa3c-2a8be6c586f1 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:37.153319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:37.162496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:37.208884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bcfa4-1f40-42e2-95bb-d579e571d239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:37.210240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bcfa4-1f40-42e2-95bb-d579e571d239 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:37.263988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc010f4-9ddd-4f79-aa3c-2a8be6c586f1 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:37.300333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885866f-47cf-48cb-9ae8-67cb8fd65311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:37.301581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885866f-47cf-48cb-9ae8-67cb8fd65311 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:37.302088 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885866f-47cf-48cb-9ae8-67cb8fd65311 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:37.302622 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885866f-47cf-48cb-9ae8-67cb8fd65311 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:37.304244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885866f-47cf-48cb-9ae8-67cb8fd65311 None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:37.305908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885866f-47cf-48cb-9ae8-67cb8fd65311 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:37.307855 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 99/203] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:37 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:37.308803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885866f-47cf-48cb-9ae8-67cb8fd65311 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:37.320717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 105/204] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:37.321637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bcfa4-1f40-42e2-95bb-d579e571d239 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:37.388348 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:37.406870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:37.416095 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885866f-47cf-48cb-9ae8-67cb8fd65311 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:37.430124 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bcfa4-1f40-42e2-95bb-d579e571d239 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:37.454786 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad372f1-2948-47de-9aa4-1217b77c6685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:37.455908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad372f1-2948-47de-9aa4-1217b77c6685 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:37.456413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad372f1-2948-47de-9aa4-1217b77c6685 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:37.456888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad372f1-2948-47de-9aa4-1217b77c6685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:37.457912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad372f1-2948-47de-9aa4-1217b77c6685 None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=e7932e13323241e28bd6b9427eb8ea11, user.id=ac5958eebbcb4dbab7b23d01605e7c20) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:37.458508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad372f1-2948-47de-9aa4-1217b77c6685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:37.460284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad372f1-2948-47de-9aa4-1217b77c6685 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:37.466504 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 100/205] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:37 2022] GET /identity/v3/role_assignments?user.id=ac5958eebbcb4dbab7b23d01605e7c20&scope.project.id=e7932e13323241e28bd6b9427eb8ea11&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:37.467415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cc9c1-20f3-49ce-8575-bae63df2cd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:37.467783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad372f1-2948-47de-9aa4-1217b77c6685 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:37.468223 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc9c1-20f3-49ce-8575-bae63df2cd15 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:37.468617 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc9c1-20f3-49ce-8575-bae63df2cd15 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:37.468906 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431cc9c1-20f3-49ce-8575-bae63df2cd15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:37.469786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cc9c1-20f3-49ce-8575-bae63df2cd15 None admin] RBAC: Adding query filter params (role.id=c611325a95844e85b977b39f6a7decd1, scope.project.id=bae51daa53924a5a9246a49472acf706, user.id=0f0778686ca741cba3a8f5155f302ab2) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:37.478482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cc9c1-20f3-49ce-8575-bae63df2cd15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:37.480740 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431cc9c1-20f3-49ce-8575-bae63df2cd15 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:37.488320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 106/206] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:37 2022] GET /identity/v3/role_assignments?user.id=0f0778686ca741cba3a8f5155f302ab2&scope.project.id=bae51daa53924a5a9246a49472acf706&role.id=c611325a95844e85b977b39f6a7decd1 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:37.599262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad372f1-2948-47de-9aa4-1217b77c6685 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:37.643142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0bf89-da6e-42d9-a7fd-b578f65c7087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:37.644663 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0bf89-da6e-42d9-a7fd-b578f65c7087 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:37.645117 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0bf89-da6e-42d9-a7fd-b578f65c7087 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:37.645557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0bf89-da6e-42d9-a7fd-b578f65c7087 None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:37.647098 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0bf89-da6e-42d9-a7fd-b578f65c7087 None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:37.648734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0bf89-da6e-42d9-a7fd-b578f65c7087 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:37.650854 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 101/207] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:37 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:37.659523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cc9c1-20f3-49ce-8575-bae63df2cd15 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:37.860405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431cc9c1-20f3-49ce-8575-bae63df2cd15 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:37.890718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:37.901594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3f085-e2bf-4112-b9c5-6b8da9a5f999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:37.902787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3f085-e2bf-4112-b9c5-6b8da9a5f999 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:37.903080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3f085-e2bf-4112-b9c5-6b8da9a5f999 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:37.904336 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3f085-e2bf-4112-b9c5-6b8da9a5f999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:37.904336 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3f085-e2bf-4112-b9c5-6b8da9a5f999 None admin] RBAC: Adding query filter params (role.id=cba310daca814298b574fb2259749836, scope.project.id=e7932e13323241e28bd6b9427eb8ea11, user.id=ac5958eebbcb4dbab7b23d01605e7c20) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:37.904717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3f085-e2bf-4112-b9c5-6b8da9a5f999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:37.908050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3f085-e2bf-4112-b9c5-6b8da9a5f999 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:37.914060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 107/208] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:37 2022] GET /identity/v3/role_assignments?user.id=ac5958eebbcb4dbab7b23d01605e7c20&scope.project.id=e7932e13323241e28bd6b9427eb8ea11&role.id=cba310daca814298b574fb2259749836 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:38.895890 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066e691-2313-4015-b79a-1430c39fc693 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:38.896403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066e691-2313-4015-b79a-1430c39fc693 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:38.896477 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066e691-2313-4015-b79a-1430c39fc693 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:38.897827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 102/209] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:38.903188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f834c-5e56-4c37-b8c4-bfdf89692abc None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:38.903596 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f834c-5e56-4c37-b8c4-bfdf89692abc None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:38.903760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f834c-5e56-4c37-b8c4-bfdf89692abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:38.921414 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-194f834c-5e56-4c37-b8c4-bfdf89692abc None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:38.922908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-194f834c-5e56-4c37-b8c4-bfdf89692abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:38.975810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f3016-e7be-46e8-910c-1acbfc9f638e None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:38.976137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f3016-e7be-46e8-910c-1acbfc9f638e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:38.976374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f3016-e7be-46e8-910c-1acbfc9f638e None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:38.977878 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 103/210] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:39:38.983015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39324c-5023-4e05-a8a6-066c5341f020 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:38.983524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39324c-5023-4e05-a8a6-066c5341f020 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:38.984036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39324c-5023-4e05-a8a6-066c5341f020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:38.997193 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 108/211] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:39.001313 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-ce39324c-5023-4e05-a8a6-066c5341f020 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:39.002648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-ce39324c-5023-4e05-a8a6-066c5341f020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:39.020663 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f834c-5e56-4c37-b8c4-bfdf89692abc None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:39.021460 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:39.081834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 104/212] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:39.109238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39324c-5023-4e05-a8a6-066c5341f020 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:39.144908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f834c-5e56-4c37-b8c4-bfdf89692abc None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:39.170183 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:39.186658 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1ede1-d294-4edd-ba80-b9a5a38345b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:39.187497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1ede1-d294-4edd-ba80-b9a5a38345b3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:39.187785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1ede1-d294-4edd-ba80-b9a5a38345b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:39.188060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1ede1-d294-4edd-ba80-b9a5a38345b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:39.202624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1ede1-d294-4edd-ba80-b9a5a38345b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-2ad1ede1-d294-4edd-ba80-b9a5a38345b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:39.211141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:39.212047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:39.213269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:39.213269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:39.213269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:39.213269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:39.213269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:39.213269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:39.213269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:39.213269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:39.213269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:39.213269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:39.213269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:39.213269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:39.213269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 109/213] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:39:39.218107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1ede1-d294-4edd-ba80-b9a5a38345b3 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:39.231927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39324c-5023-4e05-a8a6-066c5341f020 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:39.268821 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c61bba-772e-4d1a-82f0-c706d07e82a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:39.269625 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c61bba-772e-4d1a-82f0-c706d07e82a7 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:39.269908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c61bba-772e-4d1a-82f0-c706d07e82a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:39.270184 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c61bba-772e-4d1a-82f0-c706d07e82a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:39.271626 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c61bba-772e-4d1a-82f0-c706d07e82a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:39.273074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c61bba-772e-4d1a-82f0-c706d07e82a7 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:39.275033 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 105/214] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:39.280360 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c61bba-772e-4d1a-82f0-c706d07e82a7 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:39.306584 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:39.339246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1ede1-d294-4edd-ba80-b9a5a38345b3 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:39.376465 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be0279-a088-40bf-8135-14176a4cdfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:39.377610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be0279-a088-40bf-8135-14176a4cdfef None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:39.378143 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be0279-a088-40bf-8135-14176a4cdfef None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:39.378652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be0279-a088-40bf-8135-14176a4cdfef None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:39.379611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be0279-a088-40bf-8135-14176a4cdfef None admin] RBAC: Adding query filter params (name=member) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:39.380215 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be0279-a088-40bf-8135-14176a4cdfef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:39.382067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be0279-a088-40bf-8135-14176a4cdfef None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:39.386784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c61bba-772e-4d1a-82f0-c706d07e82a7 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:39.392319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 110/215] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:39.406454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be0279-a088-40bf-8135-14176a4cdfef None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:39.427460 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53ce3d-33be-4318-9d77-e7c2267b9db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:39.428378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53ce3d-33be-4318-9d77-e7c2267b9db1 None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:39.428664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53ce3d-33be-4318-9d77-e7c2267b9db1 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:39.428941 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53ce3d-33be-4318-9d77-e7c2267b9db1 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:39.429742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53ce3d-33be-4318-9d77-e7c2267b9db1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:39.431243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53ce3d-33be-4318-9d77-e7c2267b9db1 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:39.453085 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:39.512906 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be0279-a088-40bf-8135-14176a4cdfef None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:39.528204 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 106/216] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:39:39 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 19:39:39.560716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a2899-144c-4469-a168-bd956dde50f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:39.562751 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a2899-144c-4469-a168-bd956dde50f2 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:39.563360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a2899-144c-4469-a168-bd956dde50f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:39.563871 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a2899-144c-4469-a168-bd956dde50f2 None admin] PATH_INFO: `/v3/users/bcaf81c1c21143aead86107fcb8ea7b8` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:39.582058 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a2899-144c-4469-a168-bd956dde50f2 None admin] RBAC: Authorizing `identity:get_user(user_id=bcaf81c1c21143aead86107fcb8ea7b8)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:39.583915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a2899-144c-4469-a168-bd956dde50f2 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:39.586045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 111/217] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:39 2022] GET /identity/v3/users/bcaf81c1c21143aead86107fcb8ea7b8 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:39.592086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53ce3d-33be-4318-9d77-e7c2267b9db1 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:39.693333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:39.713226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53ce3d-33be-4318-9d77-e7c2267b9db1 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:39.749285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d6162-fd65-495a-95aa-8bf1f1dc5b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:39.749957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d6162-fd65-495a-95aa-8bf1f1dc5b95 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:39.750247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d6162-fd65-495a-95aa-8bf1f1dc5b95 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:39.750570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d6162-fd65-495a-95aa-8bf1f1dc5b95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:39.823315 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d6162-fd65-495a-95aa-8bf1f1dc5b95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:39.824598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d6162-fd65-495a-95aa-8bf1f1dc5b95 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:39.846914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac58fc-6186-467c-81be-249ef80eaa88 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:39.847564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac58fc-6186-467c-81be-249ef80eaa88 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:39.847862 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac58fc-6186-467c-81be-249ef80eaa88 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:39.849311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 112/218] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:39.856057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae030dd4-c90b-4be2-a5bb-349583d38b49 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:39.856354 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae030dd4-c90b-4be2-a5bb-349583d38b49 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:39.856637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae030dd4-c90b-4be2-a5bb-349583d38b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:39.877610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-ae030dd4-c90b-4be2-a5bb-349583d38b49 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:39.879191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ae030dd4-c90b-4be2-a5bb-349583d38b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:39.924385 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:39.954011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 107/219] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:39.959709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d6162-fd65-495a-95aa-8bf1f1dc5b95 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:39.966868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 113/220] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:39.989841 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae030dd4-c90b-4be2-a5bb-349583d38b49 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:40.026279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:40.090258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d6162-fd65-495a-95aa-8bf1f1dc5b95 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:40.119241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae030dd4-c90b-4be2-a5bb-349583d38b49 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:40.132880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141edaf-d379-427b-ab73-783c40c208e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:40.134889 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141edaf-d379-427b-ab73-783c40c208e1 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:40.135561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141edaf-d379-427b-ab73-783c40c208e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:40.136153 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141edaf-d379-427b-ab73-783c40c208e1 None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:40.137950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141edaf-d379-427b-ab73-783c40c208e1 None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:40.140113 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141edaf-d379-427b-ab73-783c40c208e1 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:40.143291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 108/221] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:39 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:40.149382 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141edaf-d379-427b-ab73-783c40c208e1 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:40.159553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fadb17-06ed-4abe-ad66-bbf81b79f5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:40.160405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fadb17-06ed-4abe-ad66-bbf81b79f5d6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:40.161139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fadb17-06ed-4abe-ad66-bbf81b79f5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:40.161139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fadb17-06ed-4abe-ad66-bbf81b79f5d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:40.174193 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fadb17-06ed-4abe-ad66-bbf81b79f5d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-20fadb17-06ed-4abe-ad66-bbf81b79f5d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:40.182420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:40.183473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:40.184255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:40.184255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:40.184255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:40.184255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:40.184255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:40.184255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:40.184255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:40.184255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:40.184255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:40.184255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:40.184255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:40.184255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:40.184864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 114/222] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:39:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:39:40.190747 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fadb17-06ed-4abe-ad66-bbf81b79f5d6 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:40.208134 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:40.263333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141edaf-d379-427b-ab73-783c40c208e1 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:40.299546 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06009f-d03c-4ac8-9e4b-d5ee3f64d19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:40.300372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06009f-d03c-4ac8-9e4b-d5ee3f64d19a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:40.300758 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06009f-d03c-4ac8-9e4b-d5ee3f64d19a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:40.301143 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06009f-d03c-4ac8-9e4b-d5ee3f64d19a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:40.302089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06009f-d03c-4ac8-9e4b-d5ee3f64d19a None admin] RBAC: Adding query filter params (role.id=c638961e289c4d108d8c584cb350a509, scope.project.id=e7932e13323241e28bd6b9427eb8ea11, user.id=bcaf81c1c21143aead86107fcb8ea7b8) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:40.302805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06009f-d03c-4ac8-9e4b-d5ee3f64d19a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:40.304355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06009f-d03c-4ac8-9e4b-d5ee3f64d19a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:40.310685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:40.315001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 109/223] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:40 2022] GET /identity/v3/role_assignments?user.id=bcaf81c1c21143aead86107fcb8ea7b8&scope.project.id=e7932e13323241e28bd6b9427eb8ea11&role.id=c638961e289c4d108d8c584cb350a509 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:40.324193 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fadb17-06ed-4abe-ad66-bbf81b79f5d6 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:40.380468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be54a48-2eb5-4666-b7a8-5b7ee6cf5429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:40.381178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be54a48-2eb5-4666-b7a8-5b7ee6cf5429 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:40.381475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be54a48-2eb5-4666-b7a8-5b7ee6cf5429 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:40.381765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be54a48-2eb5-4666-b7a8-5b7ee6cf5429 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:40.382579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be54a48-2eb5-4666-b7a8-5b7ee6cf5429 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:40.382903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be54a48-2eb5-4666-b7a8-5b7ee6cf5429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:40.384413 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be54a48-2eb5-4666-b7a8-5b7ee6cf5429 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:40.395098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 115/224] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:40.398276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cb739-f2fe-4df9-b7ea-b19fb013291a None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:40.398606 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cb739-f2fe-4df9-b7ea-b19fb013291a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:40.398893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857cb739-f2fe-4df9-b7ea-b19fb013291a None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:40.400788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be54a48-2eb5-4666-b7a8-5b7ee6cf5429 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:40.401043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 110/225] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:40.406806 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275b660-2dad-43ea-903f-0e09550573e5 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:40.407116 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275b660-2dad-43ea-903f-0e09550573e5 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:40.407368 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275b660-2dad-43ea-903f-0e09550573e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:40.463632 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-c275b660-2dad-43ea-903f-0e09550573e5 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:40.464771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c275b660-2dad-43ea-903f-0e09550573e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:40.514573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be54a48-2eb5-4666-b7a8-5b7ee6cf5429 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:40.553170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf30d44-c3d6-414a-b8d8-c841c2946ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:40.554074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf30d44-c3d6-414a-b8d8-c841c2946ee2 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:40.554388 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf30d44-c3d6-414a-b8d8-c841c2946ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:40.554681 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf30d44-c3d6-414a-b8d8-c841c2946ee2 None admin] PATH_INFO: `/v3/users/ac5958eebbcb4dbab7b23d01605e7c20` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:40.555964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf30d44-c3d6-414a-b8d8-c841c2946ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5958eebbcb4dbab7b23d01605e7c20)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:40.557600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf30d44-c3d6-414a-b8d8-c841c2946ee2 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:40.559638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 116/226] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:40 2022] GET /identity/v3/users/ac5958eebbcb4dbab7b23d01605e7c20 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:40.565658 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf30d44-c3d6-414a-b8d8-c841c2946ee2 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:40.590934 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:40.620330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 111/227] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:40.644830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275b660-2dad-43ea-903f-0e09550573e5 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:40.680088 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf30d44-c3d6-414a-b8d8-c841c2946ee2 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:40.716616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7f02c-7f19-417e-83fa-d5ac6c995595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:40.718071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f02c-7f19-417e-83fa-d5ac6c995595 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:40.718380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f02c-7f19-417e-83fa-d5ac6c995595 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:40.718669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f02c-7f19-417e-83fa-d5ac6c995595 None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:40.719908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7f02c-7f19-417e-83fa-d5ac6c995595 None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:40.721581 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7f02c-7f19-417e-83fa-d5ac6c995595 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:40.723725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 117/228] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:40 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:40.729441 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7f02c-7f19-417e-83fa-d5ac6c995595 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:40.740539 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:40.826875 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:40.839522 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7f02c-7f19-417e-83fa-d5ac6c995595 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:40.870044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275b660-2dad-43ea-903f-0e09550573e5 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:40.878316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367543ab-418d-47ab-8682-ba563c776891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:40.879423 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367543ab-418d-47ab-8682-ba563c776891 None admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:40.879714 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367543ab-418d-47ab-8682-ba563c776891 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:40.880000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367543ab-418d-47ab-8682-ba563c776891 None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11/users/ac5958eebbcb4dbab7b23d01605e7c20/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:40.882226 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367543ab-418d-47ab-8682-ba563c776891 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7932e13323241e28bd6b9427eb8ea11, user_id=ac5958eebbcb4dbab7b23d01605e7c20, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:40.883815 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367543ab-418d-47ab-8682-ba563c776891 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:40.916231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01369a90-9aa1-4bb4-87ed-e7fcd0fbe69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:40.917069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01369a90-9aa1-4bb4-87ed-e7fcd0fbe69c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:40.917420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01369a90-9aa1-4bb4-87ed-e7fcd0fbe69c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:40.917702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01369a90-9aa1-4bb4-87ed-e7fcd0fbe69c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:40.931306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01369a90-9aa1-4bb4-87ed-e7fcd0fbe69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-01369a90-9aa1-4bb4-87ed-e7fcd0fbe69c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:40.940987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:40.942011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:40.943743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:40.943743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:40.943743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:40.943743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:40.943743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:40.943743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:40.943743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:40.943743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:40.943743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:40.943743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:40.943743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:40.943743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:40.943743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 112/229] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:39:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:39:40.959647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 118/230] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:39:40 2022] PUT /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11/users/ac5958eebbcb4dbab7b23d01605e7c20/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 19:39:40.962333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01369a90-9aa1-4bb4-87ed-e7fcd0fbe69c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:41.096555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:41.100745 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01369a90-9aa1-4bb4-87ed-e7fcd0fbe69c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:41.149850 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b947923-6968-4772-97cf-03ffa287dcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:41.150574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b947923-6968-4772-97cf-03ffa287dcf6 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:41.150868 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b947923-6968-4772-97cf-03ffa287dcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:41.151153 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b947923-6968-4772-97cf-03ffa287dcf6 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:41.151922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b947923-6968-4772-97cf-03ffa287dcf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:41.152240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b947923-6968-4772-97cf-03ffa287dcf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:41.153650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b947923-6968-4772-97cf-03ffa287dcf6 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:41.166710 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 113/231] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:39:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:41.172788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367543ab-418d-47ab-8682-ba563c776891 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:41.289011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367543ab-418d-47ab-8682-ba563c776891 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:41.330589 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b2e48-891e-4c45-bdb2-9ade0249b435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:41.331473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b2e48-891e-4c45-bdb2-9ade0249b435 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:41.331757 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b2e48-891e-4c45-bdb2-9ade0249b435 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:41.332031 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b2e48-891e-4c45-bdb2-9ade0249b435 None admin] PATH_INFO: `/v3/users/ac5958eebbcb4dbab7b23d01605e7c20` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:41.333347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b2e48-891e-4c45-bdb2-9ade0249b435 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5958eebbcb4dbab7b23d01605e7c20)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:41.334927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b2e48-891e-4c45-bdb2-9ade0249b435 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:41.336893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 119/232] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:41 2022] GET /identity/v3/users/ac5958eebbcb4dbab7b23d01605e7c20 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:41.342586 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b947923-6968-4772-97cf-03ffa287dcf6 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:41.485179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b947923-6968-4772-97cf-03ffa287dcf6 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:41.547062 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c3e27-d69c-43bf-a480-ab71d98e932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:41.547947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c3e27-d69c-43bf-a480-ab71d98e932e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:41.548236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c3e27-d69c-43bf-a480-ab71d98e932e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:41.548519 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c3e27-d69c-43bf-a480-ab71d98e932e None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:41.549774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c3e27-d69c-43bf-a480-ab71d98e932e None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:41.551254 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c3e27-d69c-43bf-a480-ab71d98e932e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:41.553672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 114/233] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:41 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:41.559280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b2e48-891e-4c45-bdb2-9ade0249b435 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:41.594576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:41.707028 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b2e48-891e-4c45-bdb2-9ade0249b435 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:41.766008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc31d8d-9373-4044-b856-7a80e8c6e96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:41.767288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc31d8d-9373-4044-b856-7a80e8c6e96c None admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:41.767775 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc31d8d-9373-4044-b856-7a80e8c6e96c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:41.768265 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc31d8d-9373-4044-b856-7a80e8c6e96c None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11/users/ac5958eebbcb4dbab7b23d01605e7c20/roles/cba310daca814298b574fb2259749836` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:41.776192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc31d8d-9373-4044-b856-7a80e8c6e96c None admin] RBAC: Authorizing `identity:create_grant(project_id=e7932e13323241e28bd6b9427eb8ea11, user_id=ac5958eebbcb4dbab7b23d01605e7c20, role_id=cba310daca814298b574fb2259749836)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:41.777903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc31d8d-9373-4044-b856-7a80e8c6e96c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:41.895192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 120/234] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:39:41 2022] PUT /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11/users/ac5958eebbcb4dbab7b23d01605e7c20/roles/cba310daca814298b574fb2259749836 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:39:42.290884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deff96d-9bf0-4cb9-ba7c-857e0ec14eaf None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:42.291405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deff96d-9bf0-4cb9-ba7c-857e0ec14eaf None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:42.291479 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deff96d-9bf0-4cb9-ba7c-857e0ec14eaf None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:42.293168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 115/235] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:42.299773 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3333c9-ea29-4b1d-8f04-e18214a1ddcd None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:42.300282 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3333c9-ea29-4b1d-8f04-e18214a1ddcd None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:42.300359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3333c9-ea29-4b1d-8f04-e18214a1ddcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:42.317915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-5b3333c9-ea29-4b1d-8f04-e18214a1ddcd None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:42.319399 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5b3333c9-ea29-4b1d-8f04-e18214a1ddcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:42.393118 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 121/236] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:42.417390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deff96d-9bf0-4cb9-ba7c-857e0ec14eaf None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:42.458663 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:42.489579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a4d9f-d599-4204-b134-2c7eda542a0e None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:42.489860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a4d9f-d599-4204-b134-2c7eda542a0e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:42.490148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a4d9f-d599-4204-b134-2c7eda542a0e None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:42.491834 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 122/237] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:42.496801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb399-9fc8-42b0-8e8c-536554b416a7 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:42.497090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb399-9fc8-42b0-8e8c-536554b416a7 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:42.497368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb399-9fc8-42b0-8e8c-536554b416a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:42.521602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:42.534622 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-17bdb399-9fc8-42b0-8e8c-536554b416a7 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:42.535807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-17bdb399-9fc8-42b0-8e8c-536554b416a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:42.549914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deff96d-9bf0-4cb9-ba7c-857e0ec14eaf None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:42.613782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3233-b025-43af-905f-44e9926137e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:42.615217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3233-b025-43af-905f-44e9926137e6 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:42.615575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3233-b025-43af-905f-44e9926137e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:42.615863 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3233-b025-43af-905f-44e9926137e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:42.636104 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c3233-b025-43af-905f-44e9926137e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-fe0c3233-b025-43af-905f-44e9926137e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:42.651007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:42.651921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:42.652689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:42.652689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:42.652689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:42.652689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:42.652689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:42.652689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:42.652689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:42.652689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:42.652689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:42.652689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:42.652689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:42.652689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:42.654071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 116/238] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:42.655891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 123/239] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:42.658870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3233-b025-43af-905f-44e9926137e6 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:42.685693 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdb399-9fc8-42b0-8e8c-536554b416a7 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:42.818820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:42.824984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3233-b025-43af-905f-44e9926137e6 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:42.863276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521b202-a8d6-439d-953d-a2235aee2b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:42.864293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521b202-a8d6-439d-953d-a2235aee2b3f None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:42.865095 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521b202-a8d6-439d-953d-a2235aee2b3f None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:42.866037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521b202-a8d6-439d-953d-a2235aee2b3f None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:42.867136 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521b202-a8d6-439d-953d-a2235aee2b3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:42.867725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521b202-a8d6-439d-953d-a2235aee2b3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:42.869418 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521b202-a8d6-439d-953d-a2235aee2b3f None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:42.879728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 117/240] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:42.887709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521b202-a8d6-439d-953d-a2235aee2b3f None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:42.894378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdb399-9fc8-42b0-8e8c-536554b416a7 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:42.932709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da94a63-d0d4-417c-a83d-7e28f384e420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:42.933955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da94a63-d0d4-417c-a83d-7e28f384e420 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:42.934429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da94a63-d0d4-417c-a83d-7e28f384e420 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:42.934857 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da94a63-d0d4-417c-a83d-7e28f384e420 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:42.936283 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da94a63-d0d4-417c-a83d-7e28f384e420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:42.937894 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da94a63-d0d4-417c-a83d-7e28f384e420 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:42.939717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 124/241] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:42.945092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da94a63-d0d4-417c-a83d-7e28f384e420 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:42.978739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:43.069369 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da94a63-d0d4-417c-a83d-7e28f384e420 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:43.112786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecc565-f6bb-4d31-9549-ad260f288613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:43.113837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecc565-f6bb-4d31-9549-ad260f288613 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:43.114331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecc565-f6bb-4d31-9549-ad260f288613 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:43.114895 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecc565-f6bb-4d31-9549-ad260f288613 None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:43.116754 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecc565-f6bb-4d31-9549-ad260f288613 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:43.118466 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecc565-f6bb-4d31-9549-ad260f288613 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:43.162401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521b202-a8d6-439d-953d-a2235aee2b3f None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:43.203449 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afe869-74da-4c6c-9b3e-ac97485eef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:43.204724 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afe869-74da-4c6c-9b3e-ac97485eef51 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:43.205241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afe869-74da-4c6c-9b3e-ac97485eef51 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:43.205723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afe869-74da-4c6c-9b3e-ac97485eef51 None admin] PATH_INFO: `/v3/users/750e1d69b2e748ef9216f382e1165479` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:43.227003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 125/242] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:39:42 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:39:43.231653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afe869-74da-4c6c-9b3e-ac97485eef51 None admin] RBAC: Authorizing `identity:get_user(user_id=750e1d69b2e748ef9216f382e1165479)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:43.234371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afe869-74da-4c6c-9b3e-ac97485eef51 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:43.236824 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 118/243] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:42 2022] GET /identity/v3/users/750e1d69b2e748ef9216f382e1165479 => generated 297 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:43.243199 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecc565-f6bb-4d31-9549-ad260f288613 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:43.288846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d923-8aed-48ca-8f59-f6bb3d66dc69 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:43.289189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d923-8aed-48ca-8f59-f6bb3d66dc69 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:43.289417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d923-8aed-48ca-8f59-f6bb3d66dc69 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:43.290871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 119/244] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:39:43.296839 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9420b-1f38-49f1-b029-04a34a5d78e7 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:43.297452 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9420b-1f38-49f1-b029-04a34a5d78e7 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:43.297452 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9420b-1f38-49f1-b029-04a34a5d78e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:43.320260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:43.335549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-a5c9420b-1f38-49f1-b029-04a34a5d78e7 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:43.339987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-a5c9420b-1f38-49f1-b029-04a34a5d78e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:43.349648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:43.412660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecc565-f6bb-4d31-9549-ad260f288613 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:43.434119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 120/245] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:43.470083 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9420b-1f38-49f1-b029-04a34a5d78e7 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:43.485604 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e90b0-4062-476f-8ad2-e8b66b2d3812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:43.486551 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e90b0-4062-476f-8ad2-e8b66b2d3812 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:43.487032 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e90b0-4062-476f-8ad2-e8b66b2d3812 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:43.487627 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e90b0-4062-476f-8ad2-e8b66b2d3812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:43.605379 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e90b0-4062-476f-8ad2-e8b66b2d3812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:43.607116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e90b0-4062-476f-8ad2-e8b66b2d3812 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:43.630545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9420b-1f38-49f1-b029-04a34a5d78e7 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:43.671612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433658d-098d-45ef-87a6-ac2137d93bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:43.672420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433658d-098d-45ef-87a6-ac2137d93bb6 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:43.672711 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433658d-098d-45ef-87a6-ac2137d93bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:43.672996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433658d-098d-45ef-87a6-ac2137d93bb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:43.680439 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:43.681452 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:43.687321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433658d-098d-45ef-87a6-ac2137d93bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-6433658d-098d-45ef-87a6-ac2137d93bb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:43.695238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:43.696120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:43.696898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:43.696898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:43.696898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:43.696898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:43.696898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:43.696898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:43.696898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:43.696898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:43.696898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:43.696898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:43.696898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:43.696898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:43.696898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 121/246] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:39:43.706182 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433658d-098d-45ef-87a6-ac2137d93bb6 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:43.730196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 126/247] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:43.736295 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e90b0-4062-476f-8ad2-e8b66b2d3812 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:43.855904 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433658d-098d-45ef-87a6-ac2137d93bb6 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:43.874114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e90b0-4062-476f-8ad2-e8b66b2d3812 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:43.908888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f0f49-87f5-48a5-8fd5-4a1a5060c4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:43.909575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0f49-87f5-48a5-8fd5-4a1a5060c4de None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:43.909864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0f49-87f5-48a5-8fd5-4a1a5060c4de None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:43.910147 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f0f49-87f5-48a5-8fd5-4a1a5060c4de None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:43.910949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f0f49-87f5-48a5-8fd5-4a1a5060c4de None admin] RBAC: Adding query filter params (name=member) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:43.911264 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f0f49-87f5-48a5-8fd5-4a1a5060c4de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:43.913038 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f0f49-87f5-48a5-8fd5-4a1a5060c4de None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:43.921990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc19dc-cc82-4f30-9c63-e20d208720d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:43.923202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc19dc-cc82-4f30-9c63-e20d208720d7 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:43.923735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc19dc-cc82-4f30-9c63-e20d208720d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:43.924217 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc19dc-cc82-4f30-9c63-e20d208720d7 None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:43.925291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 122/248] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:43.925876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc19dc-cc82-4f30-9c63-e20d208720d7 None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:43.927872 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc19dc-cc82-4f30-9c63-e20d208720d7 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:43.930790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 127/249] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:43 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:43.934457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f0f49-87f5-48a5-8fd5-4a1a5060c4de None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:43.937749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc19dc-cc82-4f30-9c63-e20d208720d7 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:43.970267 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:44.015061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:44.062158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f0f49-87f5-48a5-8fd5-4a1a5060c4de None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:44.064698 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc19dc-cc82-4f30-9c63-e20d208720d7 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:44.098832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd43f02-16d4-4b79-a484-7209373bc7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:44.099716 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd43f02-16d4-4b79-a484-7209373bc7a7 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:44.100012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd43f02-16d4-4b79-a484-7209373bc7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:44.100290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd43f02-16d4-4b79-a484-7209373bc7a7 None admin] PATH_INFO: `/v3/users/bcaf81c1c21143aead86107fcb8ea7b8` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:44.101510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd43f02-16d4-4b79-a484-7209373bc7a7 None admin] RBAC: Authorizing `identity:get_user(user_id=bcaf81c1c21143aead86107fcb8ea7b8)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:44.101647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f341e7-3326-41d0-86ba-021971ece316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:44.102481 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f341e7-3326-41d0-86ba-021971ece316 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:44.102909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f341e7-3326-41d0-86ba-021971ece316 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:44.103036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd43f02-16d4-4b79-a484-7209373bc7a7 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:44.103439 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f341e7-3326-41d0-86ba-021971ece316 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:44.104423 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f341e7-3326-41d0-86ba-021971ece316 None admin] RBAC: Adding query filter params (role.id=c611325a95844e85b977b39f6a7decd1, scope.project.id=e7932e13323241e28bd6b9427eb8ea11, user.id=750e1d69b2e748ef9216f382e1165479) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:44.104893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f341e7-3326-41d0-86ba-021971ece316 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:44.106565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f341e7-3326-41d0-86ba-021971ece316 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:44.109228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 123/250] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:43 2022] GET /identity/v3/users/bcaf81c1c21143aead86107fcb8ea7b8 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:44.110839 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e911b-9da4-4d52-addc-ea772056add7 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:44.110963 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e911b-9da4-4d52-addc-ea772056add7 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:44.111199 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e911b-9da4-4d52-addc-ea772056add7 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:44.112638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 124/251] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:44.114281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e911b-9da4-4d52-addc-ea772056add7 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:44.114729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 128/252] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:43 2022] GET /identity/v3/role_assignments?user.id=750e1d69b2e748ef9216f382e1165479&scope.project.id=e7932e13323241e28bd6b9427eb8ea11&role.id=c611325a95844e85b977b39f6a7decd1 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:44.120517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad04f69-badc-4632-a820-41c19886174e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:44.121129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad04f69-badc-4632-a820-41c19886174e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:44.121612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad04f69-badc-4632-a820-41c19886174e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:44.140823 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-bad04f69-badc-4632-a820-41c19886174e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:44.142457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-bad04f69-badc-4632-a820-41c19886174e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:44.230520 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e911b-9da4-4d52-addc-ea772056add7 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:44.266922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:44.270532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51730e-72a2-402f-8220-b84e62c28386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:44.271415 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51730e-72a2-402f-8220-b84e62c28386 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:44.271705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51730e-72a2-402f-8220-b84e62c28386 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:44.272031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51730e-72a2-402f-8220-b84e62c28386 None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:44.273355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51730e-72a2-402f-8220-b84e62c28386 None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:44.274870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 129/253] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:44.274978 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51730e-72a2-402f-8220-b84e62c28386 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:44.277010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 125/254] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:44 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:44.282786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad04f69-badc-4632-a820-41c19886174e None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:44.317741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:44.348886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51730e-72a2-402f-8220-b84e62c28386 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:44.418487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad04f69-badc-4632-a820-41c19886174e None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:44.453828 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f5166-e4f5-4904-9b93-2a0ddd795106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:44.454766 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f5166-e4f5-4904-9b93-2a0ddd795106 None admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:44.455056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f5166-e4f5-4904-9b93-2a0ddd795106 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:44.455340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f5166-e4f5-4904-9b93-2a0ddd795106 None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11/users/bcaf81c1c21143aead86107fcb8ea7b8/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:44.457440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f5166-e4f5-4904-9b93-2a0ddd795106 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7932e13323241e28bd6b9427eb8ea11, user_id=bcaf81c1c21143aead86107fcb8ea7b8, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:44.458952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f5166-e4f5-4904-9b93-2a0ddd795106 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:44.537068 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51730e-72a2-402f-8220-b84e62c28386 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:44.560625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 130/255] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:39:44 2022] PUT /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11/users/bcaf81c1c21143aead86107fcb8ea7b8/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:39:44.588285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650569bd-523a-4f18-a005-fadc0cfe8d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:44.589198 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650569bd-523a-4f18-a005-fadc0cfe8d18 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:44.589496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650569bd-523a-4f18-a005-fadc0cfe8d18 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:44.589784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650569bd-523a-4f18-a005-fadc0cfe8d18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:44.594623 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb100c-f93d-4b1f-be27-c0b94f2e3676 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:44.594924 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb100c-f93d-4b1f-be27-c0b94f2e3676 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:44.595210 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb100c-f93d-4b1f-be27-c0b94f2e3676 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:44.596969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 131/256] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:44.608698 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650569bd-523a-4f18-a005-fadc0cfe8d18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:44.615946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1aaef-2ff1-495e-901f-498ad69da203 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:44.616256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1aaef-2ff1-495e-901f-498ad69da203 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:44.616526 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1aaef-2ff1-495e-901f-498ad69da203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-650569bd-523a-4f18-a005-fadc0cfe8d18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:44.617782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:44.618944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:44.619734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:44.619734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:44.619734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:44.619734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:44.619734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:44.619734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:44.619734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:44.619734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:44.619734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:44.619734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:44.619734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:39:44.619734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:44.622523 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 126/257] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:39:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:44.629196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650569bd-523a-4f18-a005-fadc0cfe8d18 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:44.671684 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-3dc1aaef-2ff1-495e-901f-498ad69da203 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:44.676009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-3dc1aaef-2ff1-495e-901f-498ad69da203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:44.750197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:44.816002 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 132/258] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:44.824872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650569bd-523a-4f18-a005-fadc0cfe8d18 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:44.847464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1aaef-2ff1-495e-901f-498ad69da203 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:44.866705 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:44.890472 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f846c-a30d-4140-9520-c62b26bfc896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:44.891202 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f846c-a30d-4140-9520-c62b26bfc896 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:44.891489 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f846c-a30d-4140-9520-c62b26bfc896 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:44.891816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f846c-a30d-4140-9520-c62b26bfc896 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:44.892575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f846c-a30d-4140-9520-c62b26bfc896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:44.892885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f846c-a30d-4140-9520-c62b26bfc896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:44.894296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f846c-a30d-4140-9520-c62b26bfc896 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:44.911871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 127/259] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:44.935554 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f846c-a30d-4140-9520-c62b26bfc896 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:45.028545 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1aaef-2ff1-495e-901f-498ad69da203 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:45.117492 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500e22-a299-4084-880b-e3b448f14a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:45.118792 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500e22-a299-4084-880b-e3b448f14a66 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:45.119250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500e22-a299-4084-880b-e3b448f14a66 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:45.119704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500e22-a299-4084-880b-e3b448f14a66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:45.136281 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38500e22-a299-4084-880b-e3b448f14a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-38500e22-a299-4084-880b-e3b448f14a66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:45.159081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:45.160015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:45.160797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:45.160797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:45.160797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:45.160797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:45.160797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:45.160797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:45.160797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:45.160797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:45.160797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:45.160797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:45.160797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:45.160797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:45.162393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 133/260] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:39:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:39:45.169309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500e22-a299-4084-880b-e3b448f14a66 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:45.181223 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f846c-a30d-4140-9520-c62b26bfc896 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:45.206930 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:45.217864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b852c-7b77-49f8-95c6-f110f9a6d92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:45.218869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b852c-7b77-49f8-95c6-f110f9a6d92f None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:45.219156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b852c-7b77-49f8-95c6-f110f9a6d92f None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:45.231522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b852c-7b77-49f8-95c6-f110f9a6d92f None admin] PATH_INFO: `/v3/users/ac5958eebbcb4dbab7b23d01605e7c20` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:45.231522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b852c-7b77-49f8-95c6-f110f9a6d92f None admin] RBAC: Authorizing `identity:get_user(user_id=ac5958eebbcb4dbab7b23d01605e7c20)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:45.231522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b852c-7b77-49f8-95c6-f110f9a6d92f None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:45.231522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 128/261] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:44 2022] GET /identity/v3/users/ac5958eebbcb4dbab7b23d01605e7c20 => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:45.231522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b852c-7b77-49f8-95c6-f110f9a6d92f None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:45.338886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b852c-7b77-49f8-95c6-f110f9a6d92f None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:45.339347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:45.377901 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68ceb5-523d-41b6-b4e7-91019cf0ada0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:45.378598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ceb5-523d-41b6-b4e7-91019cf0ada0 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:45.378892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ceb5-523d-41b6-b4e7-91019cf0ada0 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:45.379176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68ceb5-523d-41b6-b4e7-91019cf0ada0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:45.417214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500e22-a299-4084-880b-e3b448f14a66 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:45.443457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:45.454580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68ceb5-523d-41b6-b4e7-91019cf0ada0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:45.456151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68ceb5-523d-41b6-b4e7-91019cf0ada0 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:45.503071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81e0ff-f3f8-40e3-ae54-b267649a023a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:45.503768 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81e0ff-f3f8-40e3-ae54-b267649a023a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:45.504037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81e0ff-f3f8-40e3-ae54-b267649a023a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:45.504323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb81e0ff-f3f8-40e3-ae54-b267649a023a None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:45.505091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81e0ff-f3f8-40e3-ae54-b267649a023a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:45.505404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81e0ff-f3f8-40e3-ae54-b267649a023a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:45.506845 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb81e0ff-f3f8-40e3-ae54-b267649a023a None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:45.521885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 134/262] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:39:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:45.535126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81e0ff-f3f8-40e3-ae54-b267649a023a None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:45.569430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 129/263] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 19:39:45.574967 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68ceb5-523d-41b6-b4e7-91019cf0ada0 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:45.683345 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb81e0ff-f3f8-40e3-ae54-b267649a023a None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:45.719402 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4226bd-218e-4820-8b08-1fd29f8d5d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:45.720292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4226bd-218e-4820-8b08-1fd29f8d5d75 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:45.720582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4226bd-218e-4820-8b08-1fd29f8d5d75 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:45.720870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4226bd-218e-4820-8b08-1fd29f8d5d75 None admin] PATH_INFO: `/v3/users/ac5958eebbcb4dbab7b23d01605e7c20` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:45.722120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4226bd-218e-4820-8b08-1fd29f8d5d75 None admin] RBAC: Authorizing `identity:get_user(user_id=ac5958eebbcb4dbab7b23d01605e7c20)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:45.723732 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4226bd-218e-4820-8b08-1fd29f8d5d75 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:45.725383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:45.725746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 135/264] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:45 2022] GET /identity/v3/users/ac5958eebbcb4dbab7b23d01605e7c20 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:45.730688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4226bd-218e-4820-8b08-1fd29f8d5d75 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:45.734632 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:45.736659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68ceb5-523d-41b6-b4e7-91019cf0ada0 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:45.911392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a3065-6216-45cf-9077-1ab103b15899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:45.912410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a3065-6216-45cf-9077-1ab103b15899 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:45.912857 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a3065-6216-45cf-9077-1ab103b15899 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:45.913149 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a3065-6216-45cf-9077-1ab103b15899 None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:45.919139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a3065-6216-45cf-9077-1ab103b15899 None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:45.921090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a3065-6216-45cf-9077-1ab103b15899 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:45.923289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 130/265] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:45 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:45.929050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a3065-6216-45cf-9077-1ab103b15899 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:45.991616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4226bd-218e-4820-8b08-1fd29f8d5d75 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:46.119088 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46254548-1382-4167-b150-72a6b2d920d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:46.119770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46254548-1382-4167-b150-72a6b2d920d6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:46.120064 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46254548-1382-4167-b150-72a6b2d920d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:46.120353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46254548-1382-4167-b150-72a6b2d920d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:46.169037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a3065-6216-45cf-9077-1ab103b15899 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:46.255188 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3d2f7-b56e-4c38-a987-e5306e77260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:46.256225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3d2f7-b56e-4c38-a987-e5306e77260c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:46.256725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3d2f7-b56e-4c38-a987-e5306e77260c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:46.257189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3d2f7-b56e-4c38-a987-e5306e77260c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:46.258237 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3d2f7-b56e-4c38-a987-e5306e77260c None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=e7932e13323241e28bd6b9427eb8ea11, user.id=ac5958eebbcb4dbab7b23d01605e7c20) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:46.258768 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3d2f7-b56e-4c38-a987-e5306e77260c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:46.260422 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3d2f7-b56e-4c38-a987-e5306e77260c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:46.274026 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 131/266] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:45 2022] GET /identity/v3/role_assignments?user.id=ac5958eebbcb4dbab7b23d01605e7c20&scope.project.id=e7932e13323241e28bd6b9427eb8ea11&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 608 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:46.314643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46254548-1382-4167-b150-72a6b2d920d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:46.316168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46254548-1382-4167-b150-72a6b2d920d6 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:46.318300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:46.456536 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 136/267] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 726 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:46.462075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3d2f7-b56e-4c38-a987-e5306e77260c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:46.518933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:46.660902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3d2f7-b56e-4c38-a987-e5306e77260c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:46.711843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c8dba-5c04-4b63-82a7-39e208e177db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:46.713159 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c8dba-5c04-4b63-82a7-39e208e177db None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:46.713669 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c8dba-5c04-4b63-82a7-39e208e177db None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:46.714144 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c8dba-5c04-4b63-82a7-39e208e177db None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:46.719285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c8dba-5c04-4b63-82a7-39e208e177db None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:46.721164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8c8dba-5c04-4b63-82a7-39e208e177db None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:46.724170 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 132/268] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:46 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:46.731219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46254548-1382-4167-b150-72a6b2d920d6 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:46.873760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46254548-1382-4167-b150-72a6b2d920d6 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:46.875348 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:46.912533 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08306c56-fe63-41ac-a928-d644e14e2bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:46.913205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08306c56-fe63-41ac-a928-d644e14e2bf5 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:46.913496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08306c56-fe63-41ac-a928-d644e14e2bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:46.913778 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08306c56-fe63-41ac-a928-d644e14e2bf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:46.914655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08306c56-fe63-41ac-a928-d644e14e2bf5 None admin] RBAC: Adding query filter params (role.id=cba310daca814298b574fb2259749836, scope.project.id=e7932e13323241e28bd6b9427eb8ea11, user.id=ac5958eebbcb4dbab7b23d01605e7c20) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:46.914976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08306c56-fe63-41ac-a928-d644e14e2bf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:46.916427 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08306c56-fe63-41ac-a928-d644e14e2bf5 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:46.927517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 137/269] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:46 2022] GET /identity/v3/role_assignments?user.id=ac5958eebbcb4dbab7b23d01605e7c20&scope.project.id=e7932e13323241e28bd6b9427eb8ea11&role.id=cba310daca814298b574fb2259749836 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:47.012616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02795983-d76d-46e8-98a5-e767960f2ff1 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:47.013235 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02795983-d76d-46e8-98a5-e767960f2ff1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:47.014264 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02795983-d76d-46e8-98a5-e767960f2ff1 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:47.015978 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 133/270] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:47.021798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6f222-ba11-4dc8-87be-e7f02879b55b None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:47.022097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6f222-ba11-4dc8-87be-e7f02879b55b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:47.022412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6f222-ba11-4dc8-87be-e7f02879b55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:47.047622 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-83b6f222-ba11-4dc8-87be-e7f02879b55b None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:47.048901 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-83b6f222-ba11-4dc8-87be-e7f02879b55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:47.144542 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 138/271] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:47.188238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02795983-d76d-46e8-98a5-e767960f2ff1 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:47.242908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857aab2-bf41-4f0c-950f-8b373d4f2980 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:47.243208 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857aab2-bf41-4f0c-950f-8b373d4f2980 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:47.243479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857aab2-bf41-4f0c-950f-8b373d4f2980 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:47.245030 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 139/272] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:47.252512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826cd5f-c822-4e78-83c0-5adf691656fc None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:47.253133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826cd5f-c822-4e78-83c0-5adf691656fc None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:47.253614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826cd5f-c822-4e78-83c0-5adf691656fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:47.278382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-f826cd5f-c822-4e78-83c0-5adf691656fc None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:47.280486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f826cd5f-c822-4e78-83c0-5adf691656fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:47.330780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:47.347793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02795983-d76d-46e8-98a5-e767960f2ff1 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:47.363085 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 140/273] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:47.389987 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826cd5f-c822-4e78-83c0-5adf691656fc None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:47.402252 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbb28a-1c6f-4e78-a795-b0fa44b275c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:47.403440 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbb28a-1c6f-4e78-a795-b0fa44b275c2 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:47.403950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbb28a-1c6f-4e78-a795-b0fa44b275c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:47.404502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbb28a-1c6f-4e78-a795-b0fa44b275c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:47.406031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbb28a-1c6f-4e78-a795-b0fa44b275c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:47.408826 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbb28a-1c6f-4e78-a795-b0fa44b275c2 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:47.415261 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 134/274] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:47.417332 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbb28a-1c6f-4e78-a795-b0fa44b275c2 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:47.421050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:47.525261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826cd5f-c822-4e78-83c0-5adf691656fc None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:47.567463 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dad8a-577f-409f-9eb0-1a1ab6bf23e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:47.568586 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dad8a-577f-409f-9eb0-1a1ab6bf23e3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:47.569012 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dad8a-577f-409f-9eb0-1a1ab6bf23e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:47.569468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dad8a-577f-409f-9eb0-1a1ab6bf23e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:47.581424 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dad8a-577f-409f-9eb0-1a1ab6bf23e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:47.581551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbb28a-1c6f-4e78-a795-b0fa44b275c2 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-ab7dad8a-577f-409f-9eb0-1a1ab6bf23e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:47.591675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:47.592610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:47.593509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:47.593509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:47.593509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:47.593509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:47.593509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:47.593509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:47.593509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:47.593509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:47.593509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:47.593509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:47.593509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:47.593509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:47.596370 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 141/275] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:47.602017 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dad8a-577f-409f-9eb0-1a1ab6bf23e3 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:47.624329 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6b943-1b95-4b70-aad1-d96ee9d4b4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:47.625334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6b943-1b95-4b70-aad1-d96ee9d4b4eb None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:47.625628 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6b943-1b95-4b70-aad1-d96ee9d4b4eb None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:47.625915 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6b943-1b95-4b70-aad1-d96ee9d4b4eb None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:47.626730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6b943-1b95-4b70-aad1-d96ee9d4b4eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:47.629006 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6b943-1b95-4b70-aad1-d96ee9d4b4eb None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:47.706827 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:47.711297 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 135/276] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:39:47 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:39:47.720687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65555255-7fc8-4e33-bdaa-d7c4a697f45b None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:47.721366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65555255-7fc8-4e33-bdaa-d7c4a697f45b None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:47.721656 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dad8a-577f-409f-9eb0-1a1ab6bf23e3 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:47.722091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65555255-7fc8-4e33-bdaa-d7c4a697f45b None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:47.725497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 136/277] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:47.730055 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374883b-40df-46c2-9766-5a8124d2665b None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:47.730710 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374883b-40df-46c2-9766-5a8124d2665b None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:47.731152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374883b-40df-46c2-9766-5a8124d2665b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:47.756790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-4374883b-40df-46c2-9766-5a8124d2665b None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:47.758939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4374883b-40df-46c2-9766-5a8124d2665b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:47.764916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c8ffc-0614-45c5-b11e-8688571483b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:47.765608 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c8ffc-0614-45c5-b11e-8688571483b3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:47.765907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c8ffc-0614-45c5-b11e-8688571483b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:47.766190 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c8ffc-0614-45c5-b11e-8688571483b3 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:47.767121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c8ffc-0614-45c5-b11e-8688571483b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:47.767444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c8ffc-0614-45c5-b11e-8688571483b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:47.768925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c8ffc-0614-45c5-b11e-8688571483b3 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:47.772520 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:47.778829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 142/278] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:47.785215 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c8ffc-0614-45c5-b11e-8688571483b3 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:47.861282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 137/279] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:47.862953 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e085244-d3c3-49ba-9840-53159b6bdd96 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:47.863383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e085244-d3c3-49ba-9840-53159b6bdd96 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:47.863895 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e085244-d3c3-49ba-9840-53159b6bdd96 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:47.865729 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 138/280] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:47.870942 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02055d1e-2580-4f76-9f4b-4c05d387c102 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:47.871406 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02055d1e-2580-4f76-9f4b-4c05d387c102 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:47.871823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02055d1e-2580-4f76-9f4b-4c05d387c102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:47.892184 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-02055d1e-2580-4f76-9f4b-4c05d387c102 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:47.893391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-02055d1e-2580-4f76-9f4b-4c05d387c102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:47.913583 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c8ffc-0614-45c5-b11e-8688571483b3 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:47.957325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b258c-b8fb-4b0c-85d3-9fb650e582e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:47.958750 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b258c-b8fb-4b0c-85d3-9fb650e582e1 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:47.958750 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b258c-b8fb-4b0c-85d3-9fb650e582e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:47.958914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b258c-b8fb-4b0c-85d3-9fb650e582e1 None admin] PATH_INFO: `/v3/users/fb83fb289d42441d824eaf4052adb0eb` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:47.973965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 139/281] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:47.974734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02055d1e-2580-4f76-9f4b-4c05d387c102 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:47.992041 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b258c-b8fb-4b0c-85d3-9fb650e582e1 None admin] RBAC: Authorizing `identity:get_user(user_id=fb83fb289d42441d824eaf4052adb0eb)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:47.993553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b258c-b8fb-4b0c-85d3-9fb650e582e1 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:47.999739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 143/282] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:47 2022] GET /identity/v3/users/fb83fb289d42441d824eaf4052adb0eb => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:48.006475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b258c-b8fb-4b0c-85d3-9fb650e582e1 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:48.015185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:48.072365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:48.111640 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02055d1e-2580-4f76-9f4b-4c05d387c102 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:48.128869 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b258c-b8fb-4b0c-85d3-9fb650e582e1 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:48.150025 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff09d8-9c1c-4069-aa07-91203b68cf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:48.151135 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff09d8-9c1c-4069-aa07-91203b68cf1e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:48.151566 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff09d8-9c1c-4069-aa07-91203b68cf1e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:48.151988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff09d8-9c1c-4069-aa07-91203b68cf1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:48.164676 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd4f8e-8e50-46b1-a80e-e4249e2cd6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:48.164942 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff09d8-9c1c-4069-aa07-91203b68cf1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:48.165479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd4f8e-8e50-46b1-a80e-e4249e2cd6ac None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:48.165764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd4f8e-8e50-46b1-a80e-e4249e2cd6ac None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:48.166040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd4f8e-8e50-46b1-a80e-e4249e2cd6ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-73ff09d8-9c1c-4069-aa07-91203b68cf1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:48.173798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:48.174914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:48.175900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:48.175900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:48.175900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:48.175900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:48.175900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:48.175900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:48.175900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:48.175900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:48.175900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:48.175900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:48.175900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:48.175900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:48.176662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd4f8e-8e50-46b1-a80e-e4249e2cd6ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:48.178551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 140/283] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:48.179582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff09d8-9c1c-4069-aa07-91203b68cf1e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-37fd4f8e-8e50-46b1-a80e-e4249e2cd6ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:48.184830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:48.185765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:48.186593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:48.186593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:48.186593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:48.186593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:48.186593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:48.186593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:48.186593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:48.186593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:48.186593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:48.186593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:48.186593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:48.186593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:48.186593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 144/284] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:39:48.187273 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd4f8e-8e50-46b1-a80e-e4249e2cd6ac None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:48.255667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:48.290379 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd4f8e-8e50-46b1-a80e-e4249e2cd6ac None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:48.297735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff09d8-9c1c-4069-aa07-91203b68cf1e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:48.326198 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b059b9-0c4b-489a-928f-c26cfd7fa8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:48.326919 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b059b9-0c4b-489a-928f-c26cfd7fa8d7 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:48.327205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b059b9-0c4b-489a-928f-c26cfd7fa8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:48.327483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b059b9-0c4b-489a-928f-c26cfd7fa8d7 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:48.328303 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b059b9-0c4b-489a-928f-c26cfd7fa8d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:48.328535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b059b9-0c4b-489a-928f-c26cfd7fa8d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:48.329965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b059b9-0c4b-489a-928f-c26cfd7fa8d7 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:48.334212 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:48.338714 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 145/285] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:48.339362 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b059b9-0c4b-489a-928f-c26cfd7fa8d7 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:48.340949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd949e-f9fc-4efe-81f0-4157172530b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:48.342106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd949e-f9fc-4efe-81f0-4157172530b9 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:48.342601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd949e-f9fc-4efe-81f0-4157172530b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:48.343093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd949e-f9fc-4efe-81f0-4157172530b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:48.344110 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd949e-f9fc-4efe-81f0-4157172530b9 None admin] RBAC: Adding query filter params (role.id=c638961e289c4d108d8c584cb350a509, user.id=fb83fb289d42441d824eaf4052adb0eb, scope.system=all) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:48.352676 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd949e-f9fc-4efe-81f0-4157172530b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:48.352676 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd949e-f9fc-4efe-81f0-4157172530b9 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:48.352676 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 141/286] 10.222.0.15 () {56 vars in 1308 bytes} [Fri May 27 19:39:48 2022] GET /identity/v3/role_assignments?user.id=fb83fb289d42441d824eaf4052adb0eb&scope.system=all&role.id=c638961e289c4d108d8c584cb350a509 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:48.353471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd949e-f9fc-4efe-81f0-4157172530b9 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:48.503433 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd949e-f9fc-4efe-81f0-4157172530b9 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:48.514821 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b059b9-0c4b-489a-928f-c26cfd7fa8d7 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:48.550324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:48.559932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560686fc-7cf9-4590-9fba-cc3014575f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:48.564893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560686fc-7cf9-4590-9fba-cc3014575f60 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:48.564893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560686fc-7cf9-4590-9fba-cc3014575f60 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:48.564893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560686fc-7cf9-4590-9fba-cc3014575f60 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:48.564893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560686fc-7cf9-4590-9fba-cc3014575f60 None admin] RBAC: Adding query filter params (name=member) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:48.564893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560686fc-7cf9-4590-9fba-cc3014575f60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:48.564893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560686fc-7cf9-4590-9fba-cc3014575f60 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:48.574947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 146/287] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:48.585445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560686fc-7cf9-4590-9fba-cc3014575f60 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:48.590369 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774e32e-ab71-4c5e-8c95-752c61cd5c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:48.590369 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774e32e-ab71-4c5e-8c95-752c61cd5c7e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:48.590369 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774e32e-ab71-4c5e-8c95-752c61cd5c7e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:48.590369 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774e32e-ab71-4c5e-8c95-752c61cd5c7e None admin] PATH_INFO: `/v3/users/750e1d69b2e748ef9216f382e1165479` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:48.591066 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774e32e-ab71-4c5e-8c95-752c61cd5c7e None admin] RBAC: Authorizing `identity:get_user(user_id=750e1d69b2e748ef9216f382e1165479)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:48.591066 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774e32e-ab71-4c5e-8c95-752c61cd5c7e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:48.592986 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 142/288] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:48 2022] GET /identity/v3/users/750e1d69b2e748ef9216f382e1165479 => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:48.599519 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774e32e-ab71-4c5e-8c95-752c61cd5c7e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:48.676268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:48.716408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560686fc-7cf9-4590-9fba-cc3014575f60 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:48.722061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774e32e-ab71-4c5e-8c95-752c61cd5c7e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:48.761119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7afa2-8ff8-4c3d-b3b8-e7479b89928f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:48.761914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7afa2-8ff8-4c3d-b3b8-e7479b89928f None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:48.762203 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7afa2-8ff8-4c3d-b3b8-e7479b89928f None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:48.762449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f35f13-2ac0-405e-a99a-ba6e06aef0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:48.762563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7afa2-8ff8-4c3d-b3b8-e7479b89928f None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:48.763632 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f35f13-2ac0-405e-a99a-ba6e06aef0d6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:48.764329 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7afa2-8ff8-4c3d-b3b8-e7479b89928f None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:48.764740 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f35f13-2ac0-405e-a99a-ba6e06aef0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:48.765180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f35f13-2ac0-405e-a99a-ba6e06aef0d6 None admin] PATH_INFO: `/v3/users/bcaf81c1c21143aead86107fcb8ea7b8` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:48.765756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7afa2-8ff8-4c3d-b3b8-e7479b89928f None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:48.770366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 143/289] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:48 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:48.771127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f35f13-2ac0-405e-a99a-ba6e06aef0d6 None admin] RBAC: Authorizing `identity:get_user(user_id=bcaf81c1c21143aead86107fcb8ea7b8)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:48.772707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f35f13-2ac0-405e-a99a-ba6e06aef0d6 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:48.775303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7afa2-8ff8-4c3d-b3b8-e7479b89928f None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:48.776271 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 147/290] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:48 2022] GET /identity/v3/users/bcaf81c1c21143aead86107fcb8ea7b8 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:48.783902 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f35f13-2ac0-405e-a99a-ba6e06aef0d6 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:48.886178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:48.949925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f35f13-2ac0-405e-a99a-ba6e06aef0d6 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:48.993625 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7afa2-8ff8-4c3d-b3b8-e7479b89928f None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:49.015320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259420d6-634c-4726-a351-258ebb76ff79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:49.015882 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259420d6-634c-4726-a351-258ebb76ff79 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:49.016171 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259420d6-634c-4726-a351-258ebb76ff79 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:49.016443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259420d6-634c-4726-a351-258ebb76ff79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:49.051809 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:49.064104 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa0284-e7a7-4f65-b1b7-917a95ccc32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:49.065451 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0284-e7a7-4f65-b1b7-917a95ccc32a None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:49.065802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0284-e7a7-4f65-b1b7-917a95ccc32a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:49.066369 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa0284-e7a7-4f65-b1b7-917a95ccc32a None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11/users/750e1d69b2e748ef9216f382e1165479/roles/c611325a95844e85b977b39f6a7decd1` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:49.072237 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa0284-e7a7-4f65-b1b7-917a95ccc32a None admin] RBAC: Authorizing `identity:create_grant(project_id=e7932e13323241e28bd6b9427eb8ea11, user_id=750e1d69b2e748ef9216f382e1165479, role_id=c611325a95844e85b977b39f6a7decd1)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:49.074423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa0284-e7a7-4f65-b1b7-917a95ccc32a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:49.126138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259420d6-634c-4726-a351-258ebb76ff79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:49.127822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259420d6-634c-4726-a351-258ebb76ff79 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:49.155572 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 144/291] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:39:48 2022] PUT /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11/users/750e1d69b2e748ef9216f382e1165479/roles/c611325a95844e85b977b39f6a7decd1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:39:49.202883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:49.261420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 148/292] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:49.267114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa0284-e7a7-4f65-b1b7-917a95ccc32a None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:49.416439 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa0284-e7a7-4f65-b1b7-917a95ccc32a None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:49.474448 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e99b8-77c7-4c9d-8ccc-1945d5a4139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:49.474448 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e99b8-77c7-4c9d-8ccc-1945d5a4139d None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:49.474448 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e99b8-77c7-4c9d-8ccc-1945d5a4139d None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:49.474448 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e99b8-77c7-4c9d-8ccc-1945d5a4139d None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:49.474850 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e99b8-77c7-4c9d-8ccc-1945d5a4139d None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:49.477138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e99b8-77c7-4c9d-8ccc-1945d5a4139d None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:49.477594 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 145/293] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:49 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:49.486012 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259420d6-634c-4726-a351-258ebb76ff79 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:49.604631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259420d6-634c-4726-a351-258ebb76ff79 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:49.642155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518cc0b0-7114-4168-9e27-5e86baae88d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:49.642852 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cc0b0-7114-4168-9e27-5e86baae88d3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:49.643136 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cc0b0-7114-4168-9e27-5e86baae88d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:49.643754 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518cc0b0-7114-4168-9e27-5e86baae88d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:49.644594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cc0b0-7114-4168-9e27-5e86baae88d3 None admin] RBAC: Adding query filter params (role.id=c638961e289c4d108d8c584cb350a509, scope.project.id=e7932e13323241e28bd6b9427eb8ea11, user.id=bcaf81c1c21143aead86107fcb8ea7b8) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:49.644907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cc0b0-7114-4168-9e27-5e86baae88d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:49.646384 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518cc0b0-7114-4168-9e27-5e86baae88d3 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:49.652835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 149/294] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:49 2022] GET /identity/v3/role_assignments?user.id=bcaf81c1c21143aead86107fcb8ea7b8&scope.project.id=e7932e13323241e28bd6b9427eb8ea11&role.id=c638961e289c4d108d8c584cb350a509 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:50.348612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ed0fb-c15b-43d3-918e-134e3317c241 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:50.349466 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ed0fb-c15b-43d3-918e-134e3317c241 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:50.349892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ed0fb-c15b-43d3-918e-134e3317c241 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:50.351875 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 146/295] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:50.357072 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f1e36-ec22-4307-9a2f-811ca2cbad32 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:50.357547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f1e36-ec22-4307-9a2f-811ca2cbad32 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:50.357673 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f1e36-ec22-4307-9a2f-811ca2cbad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:50.362103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0c82b-a949-459a-959b-b148e8e3c5f5 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:50.362103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0c82b-a949-459a-959b-b148e8e3c5f5 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:50.362103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0c82b-a949-459a-959b-b148e8e3c5f5 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:50.362656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 147/296] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:39:50.369245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4db723-5680-4ea2-9ad3-e62eb8102f21 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:50.369732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4db723-5680-4ea2-9ad3-e62eb8102f21 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:50.370199 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4db723-5680-4ea2-9ad3-e62eb8102f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:50.386979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-fb4f1e36-ec22-4307-9a2f-811ca2cbad32 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:50.388534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-fb4f1e36-ec22-4307-9a2f-811ca2cbad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:50.398866 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-de4db723-5680-4ea2-9ad3-e62eb8102f21 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:50.399558 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-de4db723-5680-4ea2-9ad3-e62eb8102f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:50.414729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:50.464351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 150/297] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:50.466755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:50.484599 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 148/298] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:50.495433 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f1e36-ec22-4307-9a2f-811ca2cbad32 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:50.512335 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4db723-5680-4ea2-9ad3-e62eb8102f21 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:50.601857 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f1e36-ec22-4307-9a2f-811ca2cbad32 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:50.637610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4db723-5680-4ea2-9ad3-e62eb8102f21 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:50.637885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03d9cb-ee2e-4f24-b2c7-398151b237c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:50.638917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03d9cb-ee2e-4f24-b2c7-398151b237c2 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:50.639434 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03d9cb-ee2e-4f24-b2c7-398151b237c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:50.639920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03d9cb-ee2e-4f24-b2c7-398151b237c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:50.651069 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03d9cb-ee2e-4f24-b2c7-398151b237c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-4e03d9cb-ee2e-4f24-b2c7-398151b237c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:50.659793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:50.660670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:50.661455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:50.661455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:50.661455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:50.661455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:50.661455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:50.661455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:50.661455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:50.661455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:50.661455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:50.661455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:50.661455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:50.661455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:50.663954 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 151/299] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:39:50.669485 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03d9cb-ee2e-4f24-b2c7-398151b237c2 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:50.681823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e4d5f-4ab5-453b-a082-f71e69f1eaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:50.682941 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e4d5f-4ab5-453b-a082-f71e69f1eaf4 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:50.683373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e4d5f-4ab5-453b-a082-f71e69f1eaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:50.683794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e4d5f-4ab5-453b-a082-f71e69f1eaf4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:50.685140 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e4d5f-4ab5-453b-a082-f71e69f1eaf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:50.687517 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e4d5f-4ab5-453b-a082-f71e69f1eaf4 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:50.689509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 149/300] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:50.690805 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:50.695235 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e4d5f-4ab5-453b-a082-f71e69f1eaf4 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:50.781594 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:50.798203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03d9cb-ee2e-4f24-b2c7-398151b237c2 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:50.835811 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736392b-88a8-4160-8d63-8e2e07cf1fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:50.836698 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e4d5f-4ab5-453b-a082-f71e69f1eaf4 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:50.836883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736392b-88a8-4160-8d63-8e2e07cf1fae None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:50.837301 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736392b-88a8-4160-8d63-8e2e07cf1fae None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:50.837749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7736392b-88a8-4160-8d63-8e2e07cf1fae None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:50.838682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736392b-88a8-4160-8d63-8e2e07cf1fae None admin] RBAC: Adding query filter params (name=reader) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:50.839134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736392b-88a8-4160-8d63-8e2e07cf1fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:50.840661 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7736392b-88a8-4160-8d63-8e2e07cf1fae None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:50.850158 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 152/301] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:50.855635 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736392b-88a8-4160-8d63-8e2e07cf1fae None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:50.884141 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61cee8-0fab-4ffc-860f-561fbe7f34e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:50.885158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61cee8-0fab-4ffc-860f-561fbe7f34e9 None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:50.885588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61cee8-0fab-4ffc-860f-561fbe7f34e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:50.886057 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61cee8-0fab-4ffc-860f-561fbe7f34e9 None admin] PATH_INFO: `/v3/groups` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:50.886949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61cee8-0fab-4ffc-860f-561fbe7f34e9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:50.888690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61cee8-0fab-4ffc-860f-561fbe7f34e9 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:50.938205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:50.952388 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 150/302] 10.222.0.15 () {60 vars in 1134 bytes} [Fri May 27 19:39:50 2022] POST /identity/v3/groups => generated 229 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:39:50.954741 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcb5c8-ad7b-4c32-b7d4-aa87b287e120 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:50.955440 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcb5c8-ad7b-4c32-b7d4-aa87b287e120 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:50.956059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcb5c8-ad7b-4c32-b7d4-aa87b287e120 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:50.958253 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 151/303] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:50.966398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7736392b-88a8-4160-8d63-8e2e07cf1fae None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:50.970271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6253b94-6ff1-4156-89ee-256d18f508b6 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:50.970868 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6253b94-6ff1-4156-89ee-256d18f508b6 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:50.972292 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6253b94-6ff1-4156-89ee-256d18f508b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:50.995598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-e6253b94-6ff1-4156-89ee-256d18f508b6 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:50.997864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e6253b94-6ff1-4156-89ee-256d18f508b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:51.010618 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b4dcd-2c50-4739-b58f-e49a740eceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:51.011609 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4dcd-2c50-4739-b58f-e49a740eceb4 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:51.012612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4dcd-2c50-4739-b58f-e49a740eceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:51.012954 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4dcd-2c50-4739-b58f-e49a740eceb4 None admin] PATH_INFO: `/v3/users/ae79a8ad90424e07aab672f44f334a4e` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:51.033651 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b4dcd-2c50-4739-b58f-e49a740eceb4 None admin] RBAC: Authorizing `identity:get_user(user_id=ae79a8ad90424e07aab672f44f334a4e)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:51.036390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b4dcd-2c50-4739-b58f-e49a740eceb4 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:51.038541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 153/304] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:50 2022] GET /identity/v3/users/ae79a8ad90424e07aab672f44f334a4e => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:51.044491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b4dcd-2c50-4739-b58f-e49a740eceb4 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:51.105535 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 152/305] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:51.134750 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6253b94-6ff1-4156-89ee-256d18f508b6 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:51.163818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b4dcd-2c50-4739-b58f-e49a740eceb4 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:51.191404 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:51.205628 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:51.213970 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddac11-0abd-4603-810f-2d887c815a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:51.214891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddac11-0abd-4603-810f-2d887c815a0b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:51.215467 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddac11-0abd-4603-810f-2d887c815a0b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:51.215894 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddac11-0abd-4603-810f-2d887c815a0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:51.218464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddac11-0abd-4603-810f-2d887c815a0b None admin] RBAC: Adding query filter params (role.id=c611325a95844e85b977b39f6a7decd1, user.id=ae79a8ad90424e07aab672f44f334a4e, scope.system=all) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:51.218948 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddac11-0abd-4603-810f-2d887c815a0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:51.220588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddac11-0abd-4603-810f-2d887c815a0b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:51.227284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 154/306] 10.222.0.15 () {56 vars in 1308 bytes} [Fri May 27 19:39:51 2022] GET /identity/v3/role_assignments?user.id=ae79a8ad90424e07aab672f44f334a4e&scope.system=all&role.id=c611325a95844e85b977b39f6a7decd1 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:51.255496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6253b94-6ff1-4156-89ee-256d18f508b6 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:51.295735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019281e0-6ceb-45a2-82f1-69d910d1f92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:51.296577 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019281e0-6ceb-45a2-82f1-69d910d1f92b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:51.296867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019281e0-6ceb-45a2-82f1-69d910d1f92b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:51.297208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019281e0-6ceb-45a2-82f1-69d910d1f92b None admin] PATH_INFO: `/v3/roles/member` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:51.309717 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019281e0-6ceb-45a2-82f1-69d910d1f92b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-019281e0-6ceb-45a2-82f1-69d910d1f92b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:51.317871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:51.319035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:51.320127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:51.320127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:51.320127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:51.320127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:51.320127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:51.320127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:51.320127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:51.320127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:51.320127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:51.320127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:51.320127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:51.320127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:51.320127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 153/307] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:39:51.325503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddac11-0abd-4603-810f-2d887c815a0b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:51.437830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddac11-0abd-4603-810f-2d887c815a0b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:51.483849 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c2b26-5b8c-4a59-b0c1-368e224d3cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:51.484550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c2b26-5b8c-4a59-b0c1-368e224d3cf0 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:51.484838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c2b26-5b8c-4a59-b0c1-368e224d3cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:51.485121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c2b26-5b8c-4a59-b0c1-368e224d3cf0 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:51.485884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c2b26-5b8c-4a59-b0c1-368e224d3cf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:51.486196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c2b26-5b8c-4a59-b0c1-368e224d3cf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:51.487641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348c2b26-5b8c-4a59-b0c1-368e224d3cf0 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:51.497052 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 155/308] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:51.502707 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019281e0-6ceb-45a2-82f1-69d910d1f92b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:51.607884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019281e0-6ceb-45a2-82f1-69d910d1f92b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:51.617259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:51.643391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218d480-3413-40e1-8c06-48fe6672e2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:51.644276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218d480-3413-40e1-8c06-48fe6672e2d2 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:51.644567 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218d480-3413-40e1-8c06-48fe6672e2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:51.644847 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218d480-3413-40e1-8c06-48fe6672e2d2 None admin] PATH_INFO: `/v3/users/fb83fb289d42441d824eaf4052adb0eb` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:51.646102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218d480-3413-40e1-8c06-48fe6672e2d2 None admin] RBAC: Authorizing `identity:get_user(user_id=fb83fb289d42441d824eaf4052adb0eb)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:51.647578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e218d480-3413-40e1-8c06-48fe6672e2d2 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:51.649210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 154/309] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:51 2022] GET /identity/v3/users/fb83fb289d42441d824eaf4052adb0eb => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:51.654832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c2b26-5b8c-4a59-b0c1-368e224d3cf0 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:51.724567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:51.770903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c2b26-5b8c-4a59-b0c1-368e224d3cf0 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:51.805758 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13717273-02ad-45e1-a2ad-bc491e040b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:51.806667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13717273-02ad-45e1-a2ad-bc491e040b12 None admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:51.806955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13717273-02ad-45e1-a2ad-bc491e040b12 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:51.807237 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13717273-02ad-45e1-a2ad-bc491e040b12 None admin] PATH_INFO: `/v3/system/users/fb83fb289d42441d824eaf4052adb0eb/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:51.808846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13717273-02ad-45e1-a2ad-bc491e040b12 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fb83fb289d42441d824eaf4052adb0eb, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:51.810865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13717273-02ad-45e1-a2ad-bc491e040b12 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:51.877715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da14f9-18d4-4a84-9e79-94fd46384037 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:51.878025 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da14f9-18d4-4a84-9e79-94fd46384037 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:51.878437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da14f9-18d4-4a84-9e79-94fd46384037 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:51.879945 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 155/310] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:39:51.884544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdf99c-064d-4883-ac41-7ebb577cfd4e None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:51.884835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdf99c-064d-4883-ac41-7ebb577cfd4e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:51.885113 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cdf99c-064d-4883-ac41-7ebb577cfd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:51.902899 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b2cdf99c-064d-4883-ac41-7ebb577cfd4e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:51.904202 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b2cdf99c-064d-4883-ac41-7ebb577cfd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:51.906232 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 156/311] 10.222.0.15 () {58 vars in 1334 bytes} [Fri May 27 19:39:51 2022] PUT /identity/v3/system/users/fb83fb289d42441d824eaf4052adb0eb/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:39:51.986507 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 156/312] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:52.010742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13717273-02ad-45e1-a2ad-bc491e040b12 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:52.120845 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13717273-02ad-45e1-a2ad-bc491e040b12 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:52.150077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:52.163921 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afaeda-bfe9-41cc-bae0-0fcba5c8aaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:52.170559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afaeda-bfe9-41cc-bae0-0fcba5c8aaf4 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:52.170559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afaeda-bfe9-41cc-bae0-0fcba5c8aaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:52.170559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afaeda-bfe9-41cc-bae0-0fcba5c8aaf4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:52.178220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afaeda-bfe9-41cc-bae0-0fcba5c8aaf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-c5afaeda-bfe9-41cc-bae0-0fcba5c8aaf4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:52.186659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:52.187527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:52.188312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:52.188312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:52.188312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:52.188312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:52.188312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:52.188312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:52.188312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:52.188312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:52.188312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:52.188312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:52.188312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:52.188312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:52.188312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 157/313] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:52.195768 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdf99c-064d-4883-ac41-7ebb577cfd4e None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:52.303053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cdf99c-064d-4883-ac41-7ebb577cfd4e None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:52.310834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:52.338178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a786c6-215d-4f26-8511-1b7baabf8e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:52.338885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a786c6-215d-4f26-8511-1b7baabf8e7e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:52.339170 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a786c6-215d-4f26-8511-1b7baabf8e7e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:52.339448 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a786c6-215d-4f26-8511-1b7baabf8e7e None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:52.340197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a786c6-215d-4f26-8511-1b7baabf8e7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:52.340506 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a786c6-215d-4f26-8511-1b7baabf8e7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:52.342559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a786c6-215d-4f26-8511-1b7baabf8e7e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:52.353432 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 157/314] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:52.359952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afaeda-bfe9-41cc-bae0-0fcba5c8aaf4 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:52.464074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afaeda-bfe9-41cc-bae0-0fcba5c8aaf4 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:52.512598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34aa0f-26b8-4d0e-9459-5a1fc48ad6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:52.513512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34aa0f-26b8-4d0e-9459-5a1fc48ad6f3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:52.513801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34aa0f-26b8-4d0e-9459-5a1fc48ad6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:52.514082 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34aa0f-26b8-4d0e-9459-5a1fc48ad6f3 None admin] PATH_INFO: `/v3/users/750e1d69b2e748ef9216f382e1165479` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:52.515335 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34aa0f-26b8-4d0e-9459-5a1fc48ad6f3 None admin] RBAC: Authorizing `identity:get_user(user_id=750e1d69b2e748ef9216f382e1165479)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:52.516802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34aa0f-26b8-4d0e-9459-5a1fc48ad6f3 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:52.518764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 158/315] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:52 2022] GET /identity/v3/users/750e1d69b2e748ef9216f382e1165479 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:52.524047 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a786c6-215d-4f26-8511-1b7baabf8e7e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:52.631969 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a786c6-215d-4f26-8511-1b7baabf8e7e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:52.666882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c22304-b8b0-4b50-bcfc-7ee5989b9e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:52.667547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c22304-b8b0-4b50-bcfc-7ee5989b9e7b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:52.667842 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c22304-b8b0-4b50-bcfc-7ee5989b9e7b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:52.668131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c22304-b8b0-4b50-bcfc-7ee5989b9e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:52.704681 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:52.740178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c22304-b8b0-4b50-bcfc-7ee5989b9e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:52.741671 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c22304-b8b0-4b50-bcfc-7ee5989b9e7b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:52.847204 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 158/316] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:52.853034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34aa0f-26b8-4d0e-9459-5a1fc48ad6f3 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:52.910114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:52.967854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34aa0f-26b8-4d0e-9459-5a1fc48ad6f3 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:53.003587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfaee50-a7ce-4065-a77d-7b3881743f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:53.004808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaee50-a7ce-4065-a77d-7b3881743f5a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:53.005290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaee50-a7ce-4065-a77d-7b3881743f5a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:53.005760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfaee50-a7ce-4065-a77d-7b3881743f5a None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:53.007498 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfaee50-a7ce-4065-a77d-7b3881743f5a None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:53.009153 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfaee50-a7ce-4065-a77d-7b3881743f5a None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:53.011475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 159/317] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:52 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:53.018054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c22304-b8b0-4b50-bcfc-7ee5989b9e7b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:53.092866 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:53.127851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c22304-b8b0-4b50-bcfc-7ee5989b9e7b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:53.168355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e426a21-daa4-4db6-89d7-a8b66ec0ff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:53.168936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e426a21-daa4-4db6-89d7-a8b66ec0ff0d None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:53.169225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e426a21-daa4-4db6-89d7-a8b66ec0ff0d None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:53.169509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e426a21-daa4-4db6-89d7-a8b66ec0ff0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:53.171005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e426a21-daa4-4db6-89d7-a8b66ec0ff0d None admin] RBAC: Adding query filter params (role.id=c611325a95844e85b977b39f6a7decd1, scope.project.id=e7932e13323241e28bd6b9427eb8ea11, user.id=750e1d69b2e748ef9216f382e1165479) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:53.171324 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e426a21-daa4-4db6-89d7-a8b66ec0ff0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:53.172757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e426a21-daa4-4db6-89d7-a8b66ec0ff0d None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:53.179779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 159/318] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:39:53 2022] GET /identity/v3/role_assignments?user.id=750e1d69b2e748ef9216f382e1165479&scope.project.id=e7932e13323241e28bd6b9427eb8ea11&role.id=c611325a95844e85b977b39f6a7decd1 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:53.337108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996b20-dc77-4616-8a2c-533023b8b11f None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:53.337419 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996b20-dc77-4616-8a2c-533023b8b11f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:53.337667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a996b20-dc77-4616-8a2c-533023b8b11f None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:53.339541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 160/319] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:53.345478 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544c9d7-3673-4df7-aaaf-1763143ce7c6 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:53.345783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544c9d7-3673-4df7-aaaf-1763143ce7c6 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:53.346059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3544c9d7-3673-4df7-aaaf-1763143ce7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:53.364292 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-3544c9d7-3673-4df7-aaaf-1763143ce7c6 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:53.365490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-3544c9d7-3673-4df7-aaaf-1763143ce7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:53.440534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 160/320] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:53.462778 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996b20-dc77-4616-8a2c-533023b8b11f None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:53.525573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb80a87-e7d8-4d15-aa67-1a2355f93639 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:53.526455 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb80a87-e7d8-4d15-aa67-1a2355f93639 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:53.526736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb80a87-e7d8-4d15-aa67-1a2355f93639 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:53.528109 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 161/321] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:39:53.532961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7e53c-b7e8-40d9-9f46-32f9f097890b None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:53.533435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7e53c-b7e8-40d9-9f46-32f9f097890b None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:53.533548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7e53c-b7e8-40d9-9f46-32f9f097890b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:53.550452 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-3ea7e53c-b7e8-40d9-9f46-32f9f097890b None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:53.551619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-3ea7e53c-b7e8-40d9-9f46-32f9f097890b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:53.572798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a996b20-dc77-4616-8a2c-533023b8b11f None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:53.591353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:53.610188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef8c88-fc13-49b6-a381-d9d620740198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:53.611013 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef8c88-fc13-49b6-a381-d9d620740198 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:53.611300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef8c88-fc13-49b6-a381-d9d620740198 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:53.611712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef8c88-fc13-49b6-a381-d9d620740198 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:53.612673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:53.612872 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef8c88-fc13-49b6-a381-d9d620740198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:53.614319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef8c88-fc13-49b6-a381-d9d620740198 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:53.620393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 161/322] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:39:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:53.621343 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef8c88-fc13-49b6-a381-d9d620740198 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:53.623935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 162/323] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:53.645646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7e53c-b7e8-40d9-9f46-32f9f097890b None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:53.730290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef8c88-fc13-49b6-a381-d9d620740198 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:53.755222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7e53c-b7e8-40d9-9f46-32f9f097890b None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:53.770613 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd440ce-5dde-4c4d-a538-9f4a5a9b06f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:53.771421 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd440ce-5dde-4c4d-a538-9f4a5a9b06f6 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:53.771708 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd440ce-5dde-4c4d-a538-9f4a5a9b06f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:53.771991 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd440ce-5dde-4c4d-a538-9f4a5a9b06f6 None admin] PATH_INFO: `/v3/groups` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:53.772683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd440ce-5dde-4c4d-a538-9f4a5a9b06f6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:53.774364 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd440ce-5dde-4c4d-a538-9f4a5a9b06f6 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:53.791265 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaf27b-6077-449a-a2ef-df3026d28c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:53.792070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaf27b-6077-449a-a2ef-df3026d28c36 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:53.792357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaf27b-6077-449a-a2ef-df3026d28c36 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:53.792639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcaf27b-6077-449a-a2ef-df3026d28c36 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:53.803008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcaf27b-6077-449a-a2ef-df3026d28c36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-0fcaf27b-6077-449a-a2ef-df3026d28c36 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:53.811211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:53.812281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:53.813123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:53.813123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:53.813123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:53.813123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:53.813123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:53.813123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:53.813123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:53.813123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:53.813123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:53.813123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:53.813123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:53.813123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:39:53.813123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 163/324] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:39:53.817918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaf27b-6077-449a-a2ef-df3026d28c36 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:53.870808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:53.881814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 162/325] 10.222.0.15 () {60 vars in 1134 bytes} [Fri May 27 19:39:53 2022] POST /identity/v3/groups => generated 226 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:39:53.923822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcaf27b-6077-449a-a2ef-df3026d28c36 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:53.963626 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92cd08-1ac0-401e-9fd0-cbe339aaa042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:53.964310 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92cd08-1ac0-401e-9fd0-cbe339aaa042 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:53.964654 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92cd08-1ac0-401e-9fd0-cbe339aaa042 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:53.964932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92cd08-1ac0-401e-9fd0-cbe339aaa042 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:53.965717 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92cd08-1ac0-401e-9fd0-cbe339aaa042 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:53.966028 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92cd08-1ac0-401e-9fd0-cbe339aaa042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:53.968052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92cd08-1ac0-401e-9fd0-cbe339aaa042 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:53.977610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 164/326] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:53.983911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd440ce-5dde-4c4d-a538-9f4a5a9b06f6 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:54.041077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:54.100079 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd440ce-5dde-4c4d-a538-9f4a5a9b06f6 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:54.139234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964070d-86aa-4780-93c2-677af6bd9a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:54.140112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964070d-86aa-4780-93c2-677af6bd9a9a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:54.140401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964070d-86aa-4780-93c2-677af6bd9a9a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:54.140680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964070d-86aa-4780-93c2-677af6bd9a9a None admin] PATH_INFO: `/v3/users/ae79a8ad90424e07aab672f44f334a4e` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:54.141921 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964070d-86aa-4780-93c2-677af6bd9a9a None admin] RBAC: Authorizing `identity:get_user(user_id=ae79a8ad90424e07aab672f44f334a4e)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:54.143428 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964070d-86aa-4780-93c2-677af6bd9a9a None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:54.145062 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 163/327] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:53 2022] GET /identity/v3/users/ae79a8ad90424e07aab672f44f334a4e => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:39:54.150693 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92cd08-1ac0-401e-9fd0-cbe339aaa042 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:54.205185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4478-a0fd-4cba-9ecf-107f6a870a10 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:54.205520 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4478-a0fd-4cba-9ecf-107f6a870a10 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:54.205789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4478-a0fd-4cba-9ecf-107f6a870a10 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:54.208114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 164/328] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:54.213683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba42b01-cf3f-4194-b972-80719a3c70b1 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:54.213976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba42b01-cf3f-4194-b972-80719a3c70b1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:54.214381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba42b01-cf3f-4194-b972-80719a3c70b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:54.234471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-fba42b01-cf3f-4194-b972-80719a3c70b1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:54.236036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-fba42b01-cf3f-4194-b972-80719a3c70b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:54.283731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92cd08-1ac0-401e-9fd0-cbe339aaa042 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:54.305167 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:54.323232 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 165/329] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:39:54.328197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bc151-c93c-4b0b-92a3-f3ec1540ca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:54.329072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bc151-c93c-4b0b-92a3-f3ec1540ca9c None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:54.329359 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bc151-c93c-4b0b-92a3-f3ec1540ca9c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:54.329642 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bc151-c93c-4b0b-92a3-f3ec1540ca9c None admin] PATH_INFO: `/v3/system/users/ae79a8ad90424e07aab672f44f334a4e/roles/c611325a95844e85b977b39f6a7decd1` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:54.331293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bc151-c93c-4b0b-92a3-f3ec1540ca9c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ae79a8ad90424e07aab672f44f334a4e, role_id=c611325a95844e85b977b39f6a7decd1)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:54.332677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279bc151-c93c-4b0b-92a3-f3ec1540ca9c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:54.347951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba42b01-cf3f-4194-b972-80719a3c70b1 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:54.397170 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 165/330] 10.222.0.15 () {58 vars in 1334 bytes} [Fri May 27 19:39:54 2022] PUT /identity/v3/system/users/ae79a8ad90424e07aab672f44f334a4e/roles/c611325a95844e85b977b39f6a7decd1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:39:54.402994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:54.469216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba42b01-cf3f-4194-b972-80719a3c70b1 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:54.520411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59adb8d-dde3-426f-91d8-29c39d603311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:54.521176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59adb8d-dde3-426f-91d8-29c39d603311 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:54.521468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59adb8d-dde3-426f-91d8-29c39d603311 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:54.521752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59adb8d-dde3-426f-91d8-29c39d603311 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:54.534048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59adb8d-dde3-426f-91d8-29c39d603311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-f59adb8d-dde3-426f-91d8-29c39d603311 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:54.542372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:54.543319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:54.544087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:54.544087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:54.544087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:54.544087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:54.544087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:54.544087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:54.544087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:54.544087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:54.544087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:54.544087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:54.544087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:54.544087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:54.544087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 166/331] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:39:54.550787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bc151-c93c-4b0b-92a3-f3ec1540ca9c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:54.680765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279bc151-c93c-4b0b-92a3-f3ec1540ca9c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:54.726531 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b77f22-6ffe-463f-938e-3e555fad4cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:54.727215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b77f22-6ffe-463f-938e-3e555fad4cc2 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:54.727539 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b77f22-6ffe-463f-938e-3e555fad4cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:54.727770 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b77f22-6ffe-463f-938e-3e555fad4cc2 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:54.728527 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b77f22-6ffe-463f-938e-3e555fad4cc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:54.728839 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b77f22-6ffe-463f-938e-3e555fad4cc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:54.730219 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b77f22-6ffe-463f-938e-3e555fad4cc2 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:54.741920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 166/332] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:54.745167 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59adb8d-dde3-426f-91d8-29c39d603311 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:54.891003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59adb8d-dde3-426f-91d8-29c39d603311 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:54.893391 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:54.935624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bd43d-265a-4ef1-bc2d-818d5dae2c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:54.936517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bd43d-265a-4ef1-bc2d-818d5dae2c9b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:54.936798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bd43d-265a-4ef1-bc2d-818d5dae2c9b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:54.937077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bd43d-265a-4ef1-bc2d-818d5dae2c9b None admin] PATH_INFO: `/v3/users/fb83fb289d42441d824eaf4052adb0eb` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:54.938314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bd43d-265a-4ef1-bc2d-818d5dae2c9b None admin] RBAC: Authorizing `identity:get_user(user_id=fb83fb289d42441d824eaf4052adb0eb)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:54.939801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bd43d-265a-4ef1-bc2d-818d5dae2c9b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:54.941597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 167/333] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:54 2022] GET /identity/v3/users/fb83fb289d42441d824eaf4052adb0eb => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:54.947176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b77f22-6ffe-463f-938e-3e555fad4cc2 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:55.068715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:55.144163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b77f22-6ffe-463f-938e-3e555fad4cc2 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:55.187008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216f97d-a78a-482a-915a-cc8fac65931f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:55.188008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216f97d-a78a-482a-915a-cc8fac65931f None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:55.188493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216f97d-a78a-482a-915a-cc8fac65931f None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:55.188996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216f97d-a78a-482a-915a-cc8fac65931f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:55.190010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216f97d-a78a-482a-915a-cc8fac65931f None admin] RBAC: Adding query filter params (role.id=c638961e289c4d108d8c584cb350a509, user.id=fb83fb289d42441d824eaf4052adb0eb, scope.system=all) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:55.190542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216f97d-a78a-482a-915a-cc8fac65931f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:55.192259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216f97d-a78a-482a-915a-cc8fac65931f None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:55.204861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 167/334] 10.222.0.15 () {56 vars in 1308 bytes} [Fri May 27 19:39:54 2022] GET /identity/v3/role_assignments?user.id=fb83fb289d42441d824eaf4052adb0eb&scope.system=all&role.id=c638961e289c4d108d8c584cb350a509 => generated 510 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:56.803421 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76236e-2e37-4530-8810-16a8971380de None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:56.804029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76236e-2e37-4530-8810-16a8971380de None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:56.804029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76236e-2e37-4530-8810-16a8971380de None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:56.805508 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 168/335] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:56.811749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92770d-faa7-4c5c-bca3-f1183f00db9a None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:56.812638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92770d-faa7-4c5c-bca3-f1183f00db9a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:56.813119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92770d-faa7-4c5c-bca3-f1183f00db9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:56.838546 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-9d92770d-faa7-4c5c-bca3-f1183f00db9a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:56.840161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9d92770d-faa7-4c5c-bca3-f1183f00db9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:56.925718 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 168/336] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:56.963503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76236e-2e37-4530-8810-16a8971380de None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:57.087707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76236e-2e37-4530-8810-16a8971380de None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:57.135819 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1516d-635f-4fb0-9ee1-cd1490acb647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:57.137035 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1516d-635f-4fb0-9ee1-cd1490acb647 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:57.137539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1516d-635f-4fb0-9ee1-cd1490acb647 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:57.138023 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1516d-635f-4fb0-9ee1-cd1490acb647 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:57.158590 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1516d-635f-4fb0-9ee1-cd1490acb647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-26c1516d-635f-4fb0-9ee1-cd1490acb647 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:57.167137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:57.168057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:57.168863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:57.168863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:57.168863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:57.168863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:57.168863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:57.168863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:57.168863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:57.168863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:57.168863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:57.168863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:57.168863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:57.168863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:57.172220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 169/337] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:39:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:57.179508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92770d-faa7-4c5c-bca3-f1183f00db9a None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:57.216295 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:57.301236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92770d-faa7-4c5c-bca3-f1183f00db9a None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:57.340666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301317ed-9ed5-49e0-8b30-58003726ac48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:57.341765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301317ed-9ed5-49e0-8b30-58003726ac48 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:57.342254 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301317ed-9ed5-49e0-8b30-58003726ac48 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:57.343010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301317ed-9ed5-49e0-8b30-58003726ac48 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:57.344001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301317ed-9ed5-49e0-8b30-58003726ac48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:57.344524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301317ed-9ed5-49e0-8b30-58003726ac48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:57.346168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301317ed-9ed5-49e0-8b30-58003726ac48 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:57.356259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 169/338] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:39:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:57.362414 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1516d-635f-4fb0-9ee1-cd1490acb647 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:57.395673 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:57.477577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1516d-635f-4fb0-9ee1-cd1490acb647 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:57.522489 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b24f6f-22e7-41df-a69f-6b03889edfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:57.523145 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b24f6f-22e7-41df-a69f-6b03889edfa4 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:57.523429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b24f6f-22e7-41df-a69f-6b03889edfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:57.523703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b24f6f-22e7-41df-a69f-6b03889edfa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:57.580395 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e0b88-0870-4941-b6b6-907c9f348623 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:57.580755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e0b88-0870-4941-b6b6-907c9f348623 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:57.580961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e0b88-0870-4941-b6b6-907c9f348623 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:57.582391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 170/339] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:39:57.588441 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14a6fa-1519-417c-99bd-f2794a56ab06 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:57.588747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14a6fa-1519-417c-99bd-f2794a56ab06 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:57.589018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d14a6fa-1519-417c-99bd-f2794a56ab06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:57.620206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-1d14a6fa-1519-417c-99bd-f2794a56ab06 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:57.621488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-1d14a6fa-1519-417c-99bd-f2794a56ab06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:57.655288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b24f6f-22e7-41df-a69f-6b03889edfa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:57.656881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b24f6f-22e7-41df-a69f-6b03889edfa4 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:57.721414 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:57.766324 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 171/340] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:57.767732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338233d-1e20-4788-acb7-06b63bf79747 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:57.768002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338233d-1e20-4788-acb7-06b63bf79747 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:57.768282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338233d-1e20-4788-acb7-06b63bf79747 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:57.769596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 172/341] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:57.776546 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac0adb-348c-42ac-bd65-0d308aed8d3e None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:57.777115 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac0adb-348c-42ac-bd65-0d308aed8d3e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:57.777559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac0adb-348c-42ac-bd65-0d308aed8d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:57.823382 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-7dac0adb-348c-42ac-bd65-0d308aed8d3e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:57.825282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-7dac0adb-348c-42ac-bd65-0d308aed8d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:57.838065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 170/342] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:57.839522 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b24f6f-22e7-41df-a69f-6b03889edfa4 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:57.855180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:57.949358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 173/343] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:57.954991 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac0adb-348c-42ac-bd65-0d308aed8d3e None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:57.969206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b24f6f-22e7-41df-a69f-6b03889edfa4 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:58.007631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:58.014821 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74350f99-2a94-4493-9a22-0164925ab69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:58.015738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74350f99-2a94-4493-9a22-0164925ab69c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:58.016090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74350f99-2a94-4493-9a22-0164925ab69c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:58.016381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74350f99-2a94-4493-9a22-0164925ab69c None admin] PATH_INFO: `/v3/roles/member` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:58.032311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74350f99-2a94-4493-9a22-0164925ab69c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-74350f99-2a94-4493-9a22-0164925ab69c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:58.042555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:58.043657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:58.044593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:58.044593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:58.044593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:58.044593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:58.044593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:58.044593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:58.044593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:58.044593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:58.044593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:58.044593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:58.044593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:58.044593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:58.048328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 171/344] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:58.050021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158afe9f-45ba-4c0c-ace3-37ec4aeaabc0 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:58.050655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158afe9f-45ba-4c0c-ace3-37ec4aeaabc0 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:58.051209 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158afe9f-45ba-4c0c-ace3-37ec4aeaabc0 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:58.053374 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 172/345] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:58.054453 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158afe9f-45ba-4c0c-ace3-37ec4aeaabc0 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:58.104826 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac0adb-348c-42ac-bd65-0d308aed8d3e None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:58.141777 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd718a65-ddae-4148-8766-0977c914b03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:58.142749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd718a65-ddae-4148-8766-0977c914b03b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:58.143269 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd718a65-ddae-4148-8766-0977c914b03b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:58.143649 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd718a65-ddae-4148-8766-0977c914b03b None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:58.144970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd718a65-ddae-4148-8766-0977c914b03b None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:58.146551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd718a65-ddae-4148-8766-0977c914b03b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:58.148865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 174/346] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:57 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:58.149887 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd718a65-ddae-4148-8766-0977c914b03b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:58.188848 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158afe9f-45ba-4c0c-ace3-37ec4aeaabc0 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:58.200252 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:58.227686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff037b33-39bb-4691-9d64-69c6ffbe6ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:58.228834 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff037b33-39bb-4691-9d64-69c6ffbe6ab3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:58.229306 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff037b33-39bb-4691-9d64-69c6ffbe6ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:58.229772 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff037b33-39bb-4691-9d64-69c6ffbe6ab3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:58.243401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff037b33-39bb-4691-9d64-69c6ffbe6ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-ff037b33-39bb-4691-9d64-69c6ffbe6ab3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:58.252567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:58.253603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:58.254432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:58.254432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:58.254432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:58.254432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:58.254432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:58.254432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:58.254432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:58.254432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:58.254432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:58.254432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:58.254432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:39:58.254432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:58.257327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 173/347] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:58.263086 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47fb8a-5296-4f50-9579-96c40cd6e79e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:58.263631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47fb8a-5296-4f50-9579-96c40cd6e79e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:58.264112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47fb8a-5296-4f50-9579-96c40cd6e79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:58.276527 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd718a65-ddae-4148-8766-0977c914b03b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:58.283423 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-bc47fb8a-5296-4f50-9579-96c40cd6e79e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:58.284998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-bc47fb8a-5296-4f50-9579-96c40cd6e79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:58.340670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2ef59-c654-49f1-a380-c7d51e07b837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:58.342671 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2ef59-c654-49f1-a380-c7d51e07b837 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:58.343245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2ef59-c654-49f1-a380-c7d51e07b837 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:58.344093 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:58.345297 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2ef59-c654-49f1-a380-c7d51e07b837 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:58.346250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2ef59-c654-49f1-a380-c7d51e07b837 None admin] RBAC: Adding query filter params (name=member) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:58.346594 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2ef59-c654-49f1-a380-c7d51e07b837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:58.348083 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2ef59-c654-49f1-a380-c7d51e07b837 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:58.358783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 175/348] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:58.359864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2ef59-c654-49f1-a380-c7d51e07b837 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:58.366486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 174/349] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:58.367573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47fb8a-5296-4f50-9579-96c40cd6e79e None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:58.474809 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:58.507268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2ef59-c654-49f1-a380-c7d51e07b837 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:58.514320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47fb8a-5296-4f50-9579-96c40cd6e79e None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:58.554950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14bc66-4768-4561-9a34-eb30add59f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:58.555830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14bc66-4768-4561-9a34-eb30add59f9b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:58.556121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14bc66-4768-4561-9a34-eb30add59f9b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:58.556403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14bc66-4768-4561-9a34-eb30add59f9b None admin] PATH_INFO: `/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:58.563531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99684e23-43d9-4cc3-8bd0-5d67ce9188b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:58.563891 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14bc66-4768-4561-9a34-eb30add59f9b None admin] RBAC: Authorizing `identity:get_group(group_id=bb92eacbcb8e410f98e68f08c5190ca8)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:58.564464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99684e23-43d9-4cc3-8bd0-5d67ce9188b9 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:58.564757 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99684e23-43d9-4cc3-8bd0-5d67ce9188b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:58.565038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99684e23-43d9-4cc3-8bd0-5d67ce9188b9 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:58.565383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14bc66-4768-4561-9a34-eb30add59f9b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:58.565801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99684e23-43d9-4cc3-8bd0-5d67ce9188b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:58.566112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99684e23-43d9-4cc3-8bd0-5d67ce9188b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:58.567172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 176/350] 10.222.0.15 () {56 vars in 1180 bytes} [Fri May 27 19:39:58 2022] GET /identity/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:58.567564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99684e23-43d9-4cc3-8bd0-5d67ce9188b9 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:58.568177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14bc66-4768-4561-9a34-eb30add59f9b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:58.583835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 175/351] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:58.584195 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99684e23-43d9-4cc3-8bd0-5d67ce9188b9 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:58.661099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:58.700029 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14bc66-4768-4561-9a34-eb30add59f9b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:58.740288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99684e23-43d9-4cc3-8bd0-5d67ce9188b9 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:58.752239 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02a6ee-0118-4abe-80ad-c95a95557412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:58.752936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02a6ee-0118-4abe-80ad-c95a95557412 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:58.753537 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02a6ee-0118-4abe-80ad-c95a95557412 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:58.753828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02a6ee-0118-4abe-80ad-c95a95557412 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:58.774748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:58.792318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab18e9-8139-47b6-9c98-b63bd2382bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:58.794038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab18e9-8139-47b6-9c98-b63bd2382bbe None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:58.794837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab18e9-8139-47b6-9c98-b63bd2382bbe None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:58.795314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab18e9-8139-47b6-9c98-b63bd2382bbe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:58.809702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab18e9-8139-47b6-9c98-b63bd2382bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-3eab18e9-8139-47b6-9c98-b63bd2382bbe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:58.818602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:58.819547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:58.820333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:58.820333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:58.820333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:58.820333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:58.820333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:58.820333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:58.820333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:58.820333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:58.820333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:58.820333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:58.820333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 19:39:58.820333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:58.823167 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 176/352] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:39:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:58.824699 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049867a-c90d-4943-aef2-2c01934f43f4 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:58.825174 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049867a-c90d-4943-aef2-2c01934f43f4 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:58.826165 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049867a-c90d-4943-aef2-2c01934f43f4 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:58.827686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 177/353] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:58.828807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049867a-c90d-4943-aef2-2c01934f43f4 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:58.854406 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02a6ee-0118-4abe-80ad-c95a95557412 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:58.856050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02a6ee-0118-4abe-80ad-c95a95557412 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:58.977007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049867a-c90d-4943-aef2-2c01934f43f4 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:58.983593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:59.015338 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 177/354] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:59.016502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02a6ee-0118-4abe-80ad-c95a95557412 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:59.033805 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77d42d-9622-49f7-bbb3-48a565e5ee9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:59.035314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77d42d-9622-49f7-bbb3-48a565e5ee9a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:59.035314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77d42d-9622-49f7-bbb3-48a565e5ee9a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:59.035314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77d42d-9622-49f7-bbb3-48a565e5ee9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:59.036425 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77d42d-9622-49f7-bbb3-48a565e5ee9a None admin] RBAC: Adding query filter params (group.id=bb92eacbcb8e410f98e68f08c5190ca8, role.id=cba310daca814298b574fb2259749836, scope.project.id=bae51daa53924a5a9246a49472acf706) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:59.036425 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77d42d-9622-49f7-bbb3-48a565e5ee9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:59.037709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77d42d-9622-49f7-bbb3-48a565e5ee9a None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:59.043731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 178/355] 10.222.0.15 () {56 vars in 1376 bytes} [Fri May 27 19:39:58 2022] GET /identity/v3/role_assignments?group.id=bb92eacbcb8e410f98e68f08c5190ca8&scope.project.id=bae51daa53924a5a9246a49472acf706&role.id=cba310daca814298b574fb2259749836 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:59.045084 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77d42d-9622-49f7-bbb3-48a565e5ee9a None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:59.084026 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:59.160303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02a6ee-0118-4abe-80ad-c95a95557412 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:59.197455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77d42d-9622-49f7-bbb3-48a565e5ee9a None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:59.201706 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870aac5c-771b-4d3f-bd2f-f20c82bb489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:59.201994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aac5c-771b-4d3f-bd2f-f20c82bb489b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:59.202409 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aac5c-771b-4d3f-bd2f-f20c82bb489b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:59.202789 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870aac5c-771b-4d3f-bd2f-f20c82bb489b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:59.255691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b412840-fc01-4eb0-b0dc-14e26e13c6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:59.256667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b412840-fc01-4eb0-b0dc-14e26e13c6f3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:59.257056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b412840-fc01-4eb0-b0dc-14e26e13c6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:59.257547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b412840-fc01-4eb0-b0dc-14e26e13c6f3 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:59.258841 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b412840-fc01-4eb0-b0dc-14e26e13c6f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:39:59.259280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b412840-fc01-4eb0-b0dc-14e26e13c6f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:59.261440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b412840-fc01-4eb0-b0dc-14e26e13c6f3 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:59.278318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 179/356] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:39:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:59.282101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab06950-6ca1-487a-ab30-d4b4e55cb55a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:59.282583 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab06950-6ca1-487a-ab30-d4b4e55cb55a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:59.282987 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab06950-6ca1-487a-ab30-d4b4e55cb55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:59.301225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870aac5c-771b-4d3f-bd2f-f20c82bb489b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:59.303010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870aac5c-771b-4d3f-bd2f-f20c82bb489b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:59.308774 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-6ab06950-6ca1-487a-ab30-d4b4e55cb55a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:59.310896 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-6ab06950-6ca1-487a-ab30-d4b4e55cb55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:59.346298 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:59.366446 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:59.410474 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 180/357] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:59.411357 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab06950-6ca1-487a-ab30-d4b4e55cb55a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:59.457561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 178/358] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:39:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:39:59.460336 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b284b-0d83-4009-88f2-b3597d3ca6e2 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:59.461160 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b284b-0d83-4009-88f2-b3597d3ca6e2 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:59.461967 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b284b-0d83-4009-88f2-b3597d3ca6e2 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:59.464041 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 179/359] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:39:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:39:59.465522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b284b-0d83-4009-88f2-b3597d3ca6e2 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:59.552535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab06950-6ca1-487a-ab30-d4b4e55cb55a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:59.603307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31546941-a7cb-43a6-94f6-14eea584bdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:59.604371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31546941-a7cb-43a6-94f6-14eea584bdbb None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:59.604660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31546941-a7cb-43a6-94f6-14eea584bdbb None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:59.604941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31546941-a7cb-43a6-94f6-14eea584bdbb None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:59.606185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31546941-a7cb-43a6-94f6-14eea584bdbb None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:59.608304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31546941-a7cb-43a6-94f6-14eea584bdbb None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:59.610428 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 181/360] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:59 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:59.611370 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31546941-a7cb-43a6-94f6-14eea584bdbb None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:59.621968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b284b-0d83-4009-88f2-b3597d3ca6e2 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:59.641690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:59.672702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32f143-6aa9-464c-b2f0-e7d6feaac97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:59.673927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32f143-6aa9-464c-b2f0-e7d6feaac97b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:59.674394 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32f143-6aa9-464c-b2f0-e7d6feaac97b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:59.674674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32f143-6aa9-464c-b2f0-e7d6feaac97b None admin] PATH_INFO: `/v3/users/ae79a8ad90424e07aab672f44f334a4e` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:59.675921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32f143-6aa9-464c-b2f0-e7d6feaac97b None admin] RBAC: Authorizing `identity:get_user(user_id=ae79a8ad90424e07aab672f44f334a4e)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:59.677642 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32f143-6aa9-464c-b2f0-e7d6feaac97b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:59.679406 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 180/361] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:39:59 2022] GET /identity/v3/users/ae79a8ad90424e07aab672f44f334a4e => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:59.680186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32f143-6aa9-464c-b2f0-e7d6feaac97b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:59.705285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:39:59.781657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31546941-a7cb-43a6-94f6-14eea584bdbb None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:59.811576 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32f143-6aa9-464c-b2f0-e7d6feaac97b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:39:59.823078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1435c4-c283-4b8e-8f70-fdc7c4802d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:59.823900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1435c4-c283-4b8e-8f70-fdc7c4802d6d None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:59.824183 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1435c4-c283-4b8e-8f70-fdc7c4802d6d None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:59.824486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1435c4-c283-4b8e-8f70-fdc7c4802d6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:59.838161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1435c4-c283-4b8e-8f70-fdc7c4802d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-6a1435c4-c283-4b8e-8f70-fdc7c4802d6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:39:59.847517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:39:59.848445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:39:59.849341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:39:59.849341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:39:59.849341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:39:59.849341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:39:59.849341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:39:59.849341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:39:59.849341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:39:59.849341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:39:59.849341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:39:59.849341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:39:59.849341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:39:59.849341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:39:59.849341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 182/362] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:39:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:39:59.850001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a33a0e-a6a6-431d-a981-3bc15d6b5d14 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:59.850766 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a33a0e-a6a6-431d-a981-3bc15d6b5d14 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:59.851909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a33a0e-a6a6-431d-a981-3bc15d6b5d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:59.866266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bac9b-99d4-4e91-82ca-7d5398e75cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:39:59.867482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bac9b-99d4-4e91-82ca-7d5398e75cb0 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:39:59.867777 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bac9b-99d4-4e91-82ca-7d5398e75cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:39:59.868058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09bac9b-99d4-4e91-82ca-7d5398e75cb0 None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:39:59.869313 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bac9b-99d4-4e91-82ca-7d5398e75cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:39:59.870821 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09bac9b-99d4-4e91-82ca-7d5398e75cb0 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:39:59.871394 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-62a33a0e-a6a6-431d-a981-3bc15d6b5d14 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:39:59.873237 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 181/363] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:39:59 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:39:59.873338 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-62a33a0e-a6a6-431d-a981-3bc15d6b5d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:39:59.873861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bac9b-99d4-4e91-82ca-7d5398e75cb0 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:39:59.978802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 183/364] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:39:59.980519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a33a0e-a6a6-431d-a981-3bc15d6b5d14 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:00.005423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:00.014245 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:00.030167 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09bac9b-99d4-4e91-82ca-7d5398e75cb0 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:00.082365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd3d16-3fdb-4d19-bbe0-38bb0f98c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:00.083923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd3d16-3fdb-4d19-bbe0-38bb0f98c01a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:00.084320 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd3d16-3fdb-4d19-bbe0-38bb0f98c01a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:00.084909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd3d16-3fdb-4d19-bbe0-38bb0f98c01a None admin] PATH_INFO: `/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:00.087215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd3d16-3fdb-4d19-bbe0-38bb0f98c01a None admin] RBAC: Authorizing `identity:get_group(group_id=bb92eacbcb8e410f98e68f08c5190ca8)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:00.089158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd3d16-3fdb-4d19-bbe0-38bb0f98c01a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:00.091882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 182/365] 10.222.0.15 () {56 vars in 1180 bytes} [Fri May 27 19:39:59 2022] GET /identity/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:00.092782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd3d16-3fdb-4d19-bbe0-38bb0f98c01a None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:00.161185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a33a0e-a6a6-431d-a981-3bc15d6b5d14 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:00.212492 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab49e8-51a2-448f-b805-6a578a5e5297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:00.213568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab49e8-51a2-448f-b805-6a578a5e5297 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:00.214066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab49e8-51a2-448f-b805-6a578a5e5297 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:00.214913 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab49e8-51a2-448f-b805-6a578a5e5297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:00.215955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab49e8-51a2-448f-b805-6a578a5e5297 None admin] RBAC: Adding query filter params (role.id=c611325a95844e85b977b39f6a7decd1, user.id=ae79a8ad90424e07aab672f44f334a4e, scope.system=all) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:00.216318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab49e8-51a2-448f-b805-6a578a5e5297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:00.218386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab49e8-51a2-448f-b805-6a578a5e5297 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:00.233550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 184/366] 10.222.0.15 () {56 vars in 1308 bytes} [Fri May 27 19:39:59 2022] GET /identity/v3/role_assignments?user.id=ae79a8ad90424e07aab672f44f334a4e&scope.system=all&role.id=c611325a95844e85b977b39f6a7decd1 => generated 510 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:00.234507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab49e8-51a2-448f-b805-6a578a5e5297 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:00.244796 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd3d16-3fdb-4d19-bbe0-38bb0f98c01a None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:00.292894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb43b95-4940-405a-acdc-6a873993fcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:00.293596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb43b95-4940-405a-acdc-6a873993fcdf None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:00.294006 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb43b95-4940-405a-acdc-6a873993fcdf None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:00.294390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb43b95-4940-405a-acdc-6a873993fcdf None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:00.295355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb43b95-4940-405a-acdc-6a873993fcdf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:00.295675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb43b95-4940-405a-acdc-6a873993fcdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:00.297142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb43b95-4940-405a-acdc-6a873993fcdf None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:00.307335 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 183/367] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:00.308333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb43b95-4940-405a-acdc-6a873993fcdf None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:00.326535 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:00.345001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:00.373480 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab49e8-51a2-448f-b805-6a578a5e5297 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:00.417191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b63066-97d2-40a1-b1ff-d6b3a03db854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:00.418476 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b63066-97d2-40a1-b1ff-d6b3a03db854 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:00.418766 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b63066-97d2-40a1-b1ff-d6b3a03db854 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:00.419047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b63066-97d2-40a1-b1ff-d6b3a03db854 None admin] PATH_INFO: `/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:00.420427 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b63066-97d2-40a1-b1ff-d6b3a03db854 None admin] RBAC: Authorizing `identity:get_group(group_id=bb92eacbcb8e410f98e68f08c5190ca8)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:00.422078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b63066-97d2-40a1-b1ff-d6b3a03db854 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:00.425127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 185/368] 10.222.0.15 () {56 vars in 1180 bytes} [Fri May 27 19:40:00 2022] GET /identity/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:00.425928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b63066-97d2-40a1-b1ff-d6b3a03db854 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:00.456456 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb43b95-4940-405a-acdc-6a873993fcdf None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:00.506067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459c5f5-bc7c-4496-9659-fbc55121656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:00.507289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459c5f5-bc7c-4496-9659-fbc55121656e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:00.507579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459c5f5-bc7c-4496-9659-fbc55121656e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:00.507863 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459c5f5-bc7c-4496-9659-fbc55121656e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:00.522925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459c5f5-bc7c-4496-9659-fbc55121656e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-7459c5f5-bc7c-4496-9659-fbc55121656e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:00.534983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:00.535918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:00.536725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:00.536725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:00.536725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:00.536725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:00.536725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:00.536725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:00.536725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:00.536725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:00.536725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:00.536725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:00.536725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:00.536725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:00.539500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 184/369] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:40:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:00.541165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459c5f5-bc7c-4496-9659-fbc55121656e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:00.568685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b63066-97d2-40a1-b1ff-d6b3a03db854 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:00.623402 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887520a-462b-4f81-8717-acf17982e855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:00.624002 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887520a-462b-4f81-8717-acf17982e855 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:00.624288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887520a-462b-4f81-8717-acf17982e855 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:00.624566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887520a-462b-4f81-8717-acf17982e855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:00.625409 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887520a-462b-4f81-8717-acf17982e855 None admin] RBAC: Adding query filter params (group.id=bb92eacbcb8e410f98e68f08c5190ca8, role.id=c638961e289c4d108d8c584cb350a509, scope.project.id=bae51daa53924a5a9246a49472acf706) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:00.625723 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887520a-462b-4f81-8717-acf17982e855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:00.627206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887520a-462b-4f81-8717-acf17982e855 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:00.634672 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 186/370] 10.222.0.15 () {56 vars in 1376 bytes} [Fri May 27 19:40:00 2022] GET /identity/v3/role_assignments?group.id=bb92eacbcb8e410f98e68f08c5190ca8&scope.project.id=bae51daa53924a5a9246a49472acf706&role.id=c638961e289c4d108d8c584cb350a509 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:00.634672 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887520a-462b-4f81-8717-acf17982e855 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:00.640276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:00.646695 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:00.678908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459c5f5-bc7c-4496-9659-fbc55121656e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:00.730638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add99e81-af49-4e26-85ce-b12030eb1503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:00.732942 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add99e81-af49-4e26-85ce-b12030eb1503 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:00.733462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add99e81-af49-4e26-85ce-b12030eb1503 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:00.734232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add99e81-af49-4e26-85ce-b12030eb1503 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:00.754390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887520a-462b-4f81-8717-acf17982e855 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:00.795323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c597f-be67-47c7-8e93-8b65115fc21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:00.796457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c597f-be67-47c7-8e93-8b65115fc21c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:00.796948 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c597f-be67-47c7-8e93-8b65115fc21c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:00.797490 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c597f-be67-47c7-8e93-8b65115fc21c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:00.799875 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c597f-be67-47c7-8e93-8b65115fc21c None admin] RBAC: Adding query filter params (group.id=bb92eacbcb8e410f98e68f08c5190ca8, role.id=c638961e289c4d108d8c584cb350a509, scope.project.id=e7932e13323241e28bd6b9427eb8ea11) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:00.800481 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c597f-be67-47c7-8e93-8b65115fc21c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:00.802478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c597f-be67-47c7-8e93-8b65115fc21c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:00.809597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 187/371] 10.222.0.15 () {56 vars in 1376 bytes} [Fri May 27 19:40:00 2022] GET /identity/v3/role_assignments?group.id=bb92eacbcb8e410f98e68f08c5190ca8&scope.project.id=e7932e13323241e28bd6b9427eb8ea11&role.id=c638961e289c4d108d8c584cb350a509 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:00.811396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c597f-be67-47c7-8e93-8b65115fc21c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:00.823110 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add99e81-af49-4e26-85ce-b12030eb1503 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:00.824634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add99e81-af49-4e26-85ce-b12030eb1503 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:00.918165 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:00.949021 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:00.954614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c597f-be67-47c7-8e93-8b65115fc21c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:00.992512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947697a-157c-4ebc-8bf6-c844c91df0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:00.993259 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947697a-157c-4ebc-8bf6-c844c91df0d0 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:00.993553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947697a-157c-4ebc-8bf6-c844c91df0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:00.993837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947697a-157c-4ebc-8bf6-c844c91df0d0 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:00.994707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947697a-157c-4ebc-8bf6-c844c91df0d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:00.995027 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947697a-157c-4ebc-8bf6-c844c91df0d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:00.996513 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947697a-157c-4ebc-8bf6-c844c91df0d0 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:01.006550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 188/372] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:01.014944 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947697a-157c-4ebc-8bf6-c844c91df0d0 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:01.041561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 185/373] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:40:01.047995 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add99e81-af49-4e26-85ce-b12030eb1503 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:01.136966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947697a-157c-4ebc-8bf6-c844c91df0d0 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:01.175637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae7c7a-0a74-49d3-897e-49c173dedb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:01.176226 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae7c7a-0a74-49d3-897e-49c173dedb21 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:01.176783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae7c7a-0a74-49d3-897e-49c173dedb21 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:01.177065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae7c7a-0a74-49d3-897e-49c173dedb21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:01.180371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:01.265068 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add99e81-af49-4e26-85ce-b12030eb1503 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:01.266901 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae7c7a-0a74-49d3-897e-49c173dedb21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:01.268513 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae7c7a-0a74-49d3-897e-49c173dedb21 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:01.319084 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608e4c6-de5a-4026-b9dd-53d8a09da195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:01.320048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608e4c6-de5a-4026-b9dd-53d8a09da195 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:01.320334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608e4c6-de5a-4026-b9dd-53d8a09da195 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:01.320613 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608e4c6-de5a-4026-b9dd-53d8a09da195 None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:01.327162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608e4c6-de5a-4026-b9dd-53d8a09da195 None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:01.328636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608e4c6-de5a-4026-b9dd-53d8a09da195 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:01.330435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 186/374] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:40:01 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:01.336094 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608e4c6-de5a-4026-b9dd-53d8a09da195 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:01.383605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 189/375] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:40:01.389935 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae7c7a-0a74-49d3-897e-49c173dedb21 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:01.422805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:01.436176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:01.521206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae7c7a-0a74-49d3-897e-49c173dedb21 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:01.563239 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e228d15-a390-4d72-8735-d7004d6a707b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:01.564119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e228d15-a390-4d72-8735-d7004d6a707b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:01.564408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e228d15-a390-4d72-8735-d7004d6a707b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:01.564688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e228d15-a390-4d72-8735-d7004d6a707b None admin] PATH_INFO: `/v3/projects/b60b3b1e79a5473da57ed66a39a9281a` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:01.567156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e228d15-a390-4d72-8735-d7004d6a707b None admin] RBAC: Authorizing `identity:get_project(project_id=b60b3b1e79a5473da57ed66a39a9281a)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:01.568643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e228d15-a390-4d72-8735-d7004d6a707b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:01.570746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 190/376] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:40:01 2022] GET /identity/v3/projects/b60b3b1e79a5473da57ed66a39a9281a => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:01.577184 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e228d15-a390-4d72-8735-d7004d6a707b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:01.600549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608e4c6-de5a-4026-b9dd-53d8a09da195 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:01.690793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e228d15-a390-4d72-8735-d7004d6a707b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:01.692556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:01.712039 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185747cf-11aa-47fd-99b2-0f5471bf433b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:01.712918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185747cf-11aa-47fd-99b2-0f5471bf433b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:01.713207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185747cf-11aa-47fd-99b2-0f5471bf433b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:01.713546 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185747cf-11aa-47fd-99b2-0f5471bf433b None admin] PATH_INFO: `/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:01.715365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185747cf-11aa-47fd-99b2-0f5471bf433b None admin] RBAC: Authorizing `identity:get_group(group_id=bb92eacbcb8e410f98e68f08c5190ca8)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:01.717131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185747cf-11aa-47fd-99b2-0f5471bf433b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:01.722438 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 187/377] 10.222.0.15 () {56 vars in 1180 bytes} [Fri May 27 19:40:01 2022] GET /identity/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8 => generated 226 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:01.723857 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac261af-8c6d-4ca5-89a3-5677c57d21b4 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:01.724151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac261af-8c6d-4ca5-89a3-5677c57d21b4 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:01.724433 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac261af-8c6d-4ca5-89a3-5677c57d21b4 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:01.725773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 188/378] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:01.726507 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac261af-8c6d-4ca5-89a3-5677c57d21b4 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:01.740962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835ab1c-0911-48ab-8a4f-8e5fe8a63f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:01.741959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835ab1c-0911-48ab-8a4f-8e5fe8a63f4b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:01.742273 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835ab1c-0911-48ab-8a4f-8e5fe8a63f4b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:01.742653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835ab1c-0911-48ab-8a4f-8e5fe8a63f4b None admin] PATH_INFO: `/v3/groups/3e7429ce2280493780e27dc04053efcb` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:01.749793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835ab1c-0911-48ab-8a4f-8e5fe8a63f4b None admin] RBAC: Authorizing `identity:get_group(group_id=3e7429ce2280493780e27dc04053efcb)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:01.751307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8835ab1c-0911-48ab-8a4f-8e5fe8a63f4b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:01.753178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 191/379] 10.222.0.15 () {56 vars in 1180 bytes} [Fri May 27 19:40:01 2022] GET /identity/v3/groups/3e7429ce2280493780e27dc04053efcb => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:01.754432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec6847-c9da-4cd8-bcb6-4207c6b64e5d None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:01.754721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec6847-c9da-4cd8-bcb6-4207c6b64e5d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:01.754999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec6847-c9da-4cd8-bcb6-4207c6b64e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:01.772673 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-69ec6847-c9da-4cd8-bcb6-4207c6b64e5d None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:01.773836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-69ec6847-c9da-4cd8-bcb6-4207c6b64e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:01.882481 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 192/380] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:01.883830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec6847-c9da-4cd8-bcb6-4207c6b64e5d None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:01.910986 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac261af-8c6d-4ca5-89a3-5677c57d21b4 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:01.934786 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:01.974232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc18981-fafb-4473-b793-75755c395ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:01.974874 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc18981-fafb-4473-b793-75755c395ba4 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:01.975139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc18981-fafb-4473-b793-75755c395ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:01.975422 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc18981-fafb-4473-b793-75755c395ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:01.976291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc18981-fafb-4473-b793-75755c395ba4 None admin] RBAC: Adding query filter params (group.id=bb92eacbcb8e410f98e68f08c5190ca8, role.id=cba310daca814298b574fb2259749836, scope.project.id=e7932e13323241e28bd6b9427eb8ea11) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:01.976668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc18981-fafb-4473-b793-75755c395ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:01.978192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc18981-fafb-4473-b793-75755c395ba4 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:01.987573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 189/381] 10.222.0.15 () {56 vars in 1376 bytes} [Fri May 27 19:40:01 2022] GET /identity/v3/role_assignments?group.id=bb92eacbcb8e410f98e68f08c5190ca8&scope.project.id=e7932e13323241e28bd6b9427eb8ea11&role.id=cba310daca814298b574fb2259749836 => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:01.988476 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc18981-fafb-4473-b793-75755c395ba4 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:02.033994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:02.041679 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec6847-c9da-4cd8-bcb6-4207c6b64e5d None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:02.115217 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39be346-744a-4425-a941-cbb1ff1266bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:02.115918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39be346-744a-4425-a941-cbb1ff1266bd None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:02.116209 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39be346-744a-4425-a941-cbb1ff1266bd None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:02.116500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39be346-744a-4425-a941-cbb1ff1266bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:02.117398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39be346-744a-4425-a941-cbb1ff1266bd None admin] RBAC: Adding query filter params (group.id=3e7429ce2280493780e27dc04053efcb, role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=b60b3b1e79a5473da57ed66a39a9281a) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:02.117940 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39be346-744a-4425-a941-cbb1ff1266bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:02.119252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39be346-744a-4425-a941-cbb1ff1266bd None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:02.128760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc18981-fafb-4473-b793-75755c395ba4 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:02.130731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 193/382] 10.222.0.15 () {56 vars in 1376 bytes} [Fri May 27 19:40:01 2022] GET /identity/v3/role_assignments?group.id=3e7429ce2280493780e27dc04053efcb&scope.project.id=b60b3b1e79a5473da57ed66a39a9281a&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 260 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:02.171045 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f379dd3-e6b4-4292-9813-0a053b6cb98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:02.172439 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f379dd3-e6b4-4292-9813-0a053b6cb98c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:02.172886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f379dd3-e6b4-4292-9813-0a053b6cb98c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:02.173322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f379dd3-e6b4-4292-9813-0a053b6cb98c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:02.186885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f379dd3-e6b4-4292-9813-0a053b6cb98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-9f379dd3-e6b4-4292-9813-0a053b6cb98c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:02.196003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:02.197172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:02.198180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:02.198180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:02.198180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:02.198180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:02.198180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:02.198180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:02.198180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:02.198180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:02.198180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:02.198180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:02.198180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:40:02.198180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:02.200943 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 190/383] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:40:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:02.207160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39be346-744a-4425-a941-cbb1ff1266bd None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:02.372777 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39be346-744a-4425-a941-cbb1ff1266bd None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:02.410073 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b770cd6-2f53-4464-ba76-2a96c82690e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:02.410784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b770cd6-2f53-4464-ba76-2a96c82690e5 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:02.411078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b770cd6-2f53-4464-ba76-2a96c82690e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:02.411365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b770cd6-2f53-4464-ba76-2a96c82690e5 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:02.412132 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b770cd6-2f53-4464-ba76-2a96c82690e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:02.412449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b770cd6-2f53-4464-ba76-2a96c82690e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:02.413828 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b770cd6-2f53-4464-ba76-2a96c82690e5 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:02.422575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 194/384] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:02.428353 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f379dd3-e6b4-4292-9813-0a053b6cb98c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:02.462569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:02.557229 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f379dd3-e6b4-4292-9813-0a053b6cb98c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:02.606740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62aa902-f0e5-4b7f-ac7e-840bd2fea872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:02.607677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62aa902-f0e5-4b7f-ac7e-840bd2fea872 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:02.607968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62aa902-f0e5-4b7f-ac7e-840bd2fea872 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:02.608302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62aa902-f0e5-4b7f-ac7e-840bd2fea872 None admin] PATH_INFO: `/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:02.615083 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62aa902-f0e5-4b7f-ac7e-840bd2fea872 None admin] RBAC: Authorizing `identity:get_group(group_id=bb92eacbcb8e410f98e68f08c5190ca8)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:02.616556 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62aa902-f0e5-4b7f-ac7e-840bd2fea872 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:02.618253 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 191/385] 10.222.0.15 () {56 vars in 1180 bytes} [Fri May 27 19:40:02 2022] GET /identity/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:02.623878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b770cd6-2f53-4464-ba76-2a96c82690e5 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:02.665243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:02.763436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b770cd6-2f53-4464-ba76-2a96c82690e5 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:02.811100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675782fb-43a1-42e0-8c6a-b7c8000771d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:02.811985 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675782fb-43a1-42e0-8c6a-b7c8000771d9 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:02.812273 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675782fb-43a1-42e0-8c6a-b7c8000771d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:02.812555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675782fb-43a1-42e0-8c6a-b7c8000771d9 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:02.813790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675782fb-43a1-42e0-8c6a-b7c8000771d9 None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:02.815274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675782fb-43a1-42e0-8c6a-b7c8000771d9 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:02.817299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 195/386] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:40:02 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:02.822675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62aa902-f0e5-4b7f-ac7e-840bd2fea872 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:02.978422 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:02.987125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62aa902-f0e5-4b7f-ac7e-840bd2fea872 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:03.027974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5babcf-cdb2-4ae6-bf2a-3a0b9ce07ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:03.029390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5babcf-cdb2-4ae6-bf2a-3a0b9ce07ce8 None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:03.029677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5babcf-cdb2-4ae6-bf2a-3a0b9ce07ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:03.029954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5babcf-cdb2-4ae6-bf2a-3a0b9ce07ce8 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706/groups/bb92eacbcb8e410f98e68f08c5190ca8/roles/cba310daca814298b574fb2259749836` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:03.032226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5babcf-cdb2-4ae6-bf2a-3a0b9ce07ce8 None admin] RBAC: Authorizing `identity:create_grant(project_id=bae51daa53924a5a9246a49472acf706, group_id=bb92eacbcb8e410f98e68f08c5190ca8, role_id=cba310daca814298b574fb2259749836)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:03.033690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5babcf-cdb2-4ae6-bf2a-3a0b9ce07ce8 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:03.144961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 192/387] 10.222.0.15 () {58 vars in 1442 bytes} [Fri May 27 19:40:02 2022] PUT /identity/v3/projects/bae51daa53924a5a9246a49472acf706/groups/bb92eacbcb8e410f98e68f08c5190ca8/roles/cba310daca814298b574fb2259749836 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:40:03.360662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a857ddf-80c3-402a-9711-fb46a6138af1 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:03.361206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a857ddf-80c3-402a-9711-fb46a6138af1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:03.361294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a857ddf-80c3-402a-9711-fb46a6138af1 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:03.362916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 196/388] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:03.368597 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3cef9-d367-462b-8431-2064de28a7ac None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:03.368888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3cef9-d367-462b-8431-2064de28a7ac None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:03.369173 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3cef9-d367-462b-8431-2064de28a7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:03.387540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b4c3cef9-d367-462b-8431-2064de28a7ac None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:03.388854 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b4c3cef9-d367-462b-8431-2064de28a7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:03.475438 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 193/389] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:03.498611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a857ddf-80c3-402a-9711-fb46a6138af1 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:03.598623 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:03.618164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a857ddf-80c3-402a-9711-fb46a6138af1 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:03.662632 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1fefc-160c-4a7d-92d2-165151d5af86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:03.663460 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1fefc-160c-4a7d-92d2-165151d5af86 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:03.663747 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1fefc-160c-4a7d-92d2-165151d5af86 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:03.664027 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1fefc-160c-4a7d-92d2-165151d5af86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:03.681813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1fefc-160c-4a7d-92d2-165151d5af86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-9fa1fefc-160c-4a7d-92d2-165151d5af86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:03.694548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:03.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:03.697071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:03.697071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:03.697071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:03.697071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:03.697071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:03.697071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:03.697071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:03.697071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:03.697071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:03.697071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:03.697071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:40:03.697071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:03.697071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 197/390] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:03.702695 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3cef9-d367-462b-8431-2064de28a7ac None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:03.841327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:03.855286 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3cef9-d367-462b-8431-2064de28a7ac None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:03.868018 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d70453-57c7-42b5-834b-cce3676a6b85 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:03.868692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d70453-57c7-42b5-834b-cce3676a6b85 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:03.869192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d70453-57c7-42b5-834b-cce3676a6b85 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:03.874445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 198/391] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:03.876587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f83f3-989b-4860-b177-ebbec964f9ae None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:03.877103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f83f3-989b-4860-b177-ebbec964f9ae None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:03.877582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f83f3-989b-4860-b177-ebbec964f9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:03.895765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-331f83f3-989b-4860-b177-ebbec964f9ae None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:03.897265 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-331f83f3-989b-4860-b177-ebbec964f9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:03.902083 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9029d4-aa26-43ca-ba4e-bd21b47611ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:03.902801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9029d4-aa26-43ca-ba4e-bd21b47611ee None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:03.903089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9029d4-aa26-43ca-ba4e-bd21b47611ee None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:03.904894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9029d4-aa26-43ca-ba4e-bd21b47611ee None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:03.904894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9029d4-aa26-43ca-ba4e-bd21b47611ee None admin] RBAC: Adding query filter params (name=member) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:03.905055 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9029d4-aa26-43ca-ba4e-bd21b47611ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:03.906515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9029d4-aa26-43ca-ba4e-bd21b47611ee None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:03.919416 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 194/392] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:40:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:03.925114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9029d4-aa26-43ca-ba4e-bd21b47611ee None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:04.002441 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 199/393] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:40:04.020473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f83f3-989b-4860-b177-ebbec964f9ae None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:04.104694 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:04.107232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9029d4-aa26-43ca-ba4e-bd21b47611ee None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:04.146421 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f83f3-989b-4860-b177-ebbec964f9ae None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:04.172176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bec1ce-5cb4-4c77-99a0-0fa88c52ca5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:04.173397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bec1ce-5cb4-4c77-99a0-0fa88c52ca5e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:04.173934 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bec1ce-5cb4-4c77-99a0-0fa88c52ca5e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:04.174403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bec1ce-5cb4-4c77-99a0-0fa88c52ca5e None admin] PATH_INFO: `/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:04.179046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bec1ce-5cb4-4c77-99a0-0fa88c52ca5e None admin] RBAC: Authorizing `identity:get_group(group_id=bb92eacbcb8e410f98e68f08c5190ca8)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:04.180902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bec1ce-5cb4-4c77-99a0-0fa88c52ca5e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:04.183061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 195/394] 10.222.0.15 () {56 vars in 1180 bytes} [Fri May 27 19:40:03 2022] GET /identity/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8 => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:04.188909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bec1ce-5cb4-4c77-99a0-0fa88c52ca5e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:04.189505 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777a8f1-ee25-45ef-89b4-89b5c7cc7041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:04.190609 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777a8f1-ee25-45ef-89b4-89b5c7cc7041 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:04.191139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777a8f1-ee25-45ef-89b4-89b5c7cc7041 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:04.191616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777a8f1-ee25-45ef-89b4-89b5c7cc7041 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:04.209654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777a8f1-ee25-45ef-89b4-89b5c7cc7041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:04.214321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-7777a8f1-ee25-45ef-89b4-89b5c7cc7041 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:04.218416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:04.219320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:04.220152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:04.220152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:04.220152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:04.220152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:04.220152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:04.220152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:04.220152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:04.220152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:04.220152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:04.220152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:04.220152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:40:04.220152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:04.228699 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 200/395] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:04.234747 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777a8f1-ee25-45ef-89b4-89b5c7cc7041 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:04.310678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bec1ce-5cb4-4c77-99a0-0fa88c52ca5e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:04.352130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b87ec9-0dde-4ef8-a14e-6a31e0291b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:04.354519 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b87ec9-0dde-4ef8-a14e-6a31e0291b50 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:04.355009 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b87ec9-0dde-4ef8-a14e-6a31e0291b50 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:04.355482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b87ec9-0dde-4ef8-a14e-6a31e0291b50 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:04.357113 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b87ec9-0dde-4ef8-a14e-6a31e0291b50 None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:04.359735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b87ec9-0dde-4ef8-a14e-6a31e0291b50 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:04.364161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 196/396] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:40:04 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:04.370797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b87ec9-0dde-4ef8-a14e-6a31e0291b50 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:04.453231 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777a8f1-ee25-45ef-89b4-89b5c7cc7041 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:04.516008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9df165-ae24-4a72-95a6-46310fa18dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:04.517328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9df165-ae24-4a72-95a6-46310fa18dfc None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:04.519173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9df165-ae24-4a72-95a6-46310fa18dfc None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:04.519653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9df165-ae24-4a72-95a6-46310fa18dfc None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:04.520623 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9df165-ae24-4a72-95a6-46310fa18dfc None admin] RBAC: Adding query filter params (name=member) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:04.522049 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9df165-ae24-4a72-95a6-46310fa18dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:04.524758 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9df165-ae24-4a72-95a6-46310fa18dfc None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:04.545727 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 201/397] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:40:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:04.551664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9df165-ae24-4a72-95a6-46310fa18dfc None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:04.557386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:04.572294 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:04.608359 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b87ec9-0dde-4ef8-a14e-6a31e0291b50 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:04.691226 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9df165-ae24-4a72-95a6-46310fa18dfc None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:04.703740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceb080-98a1-4db3-917c-42056800bc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:04.704521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb080-98a1-4db3-917c-42056800bc45 None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:04.704801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb080-98a1-4db3-917c-42056800bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:04.705083 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceb080-98a1-4db3-917c-42056800bc45 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706/groups/bb92eacbcb8e410f98e68f08c5190ca8/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:04.711750 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ceb080-98a1-4db3-917c-42056800bc45 None admin] RBAC: Authorizing `identity:create_grant(project_id=bae51daa53924a5a9246a49472acf706, group_id=bb92eacbcb8e410f98e68f08c5190ca8, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:04.713222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ceb080-98a1-4db3-917c-42056800bc45 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:04.729763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f76c86-c7b7-47e8-8439-5b38dbb29140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:04.730696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f76c86-c7b7-47e8-8439-5b38dbb29140 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:04.734255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f76c86-c7b7-47e8-8439-5b38dbb29140 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:04.734255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f76c86-c7b7-47e8-8439-5b38dbb29140 None admin] PATH_INFO: `/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:04.734255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f76c86-c7b7-47e8-8439-5b38dbb29140 None admin] RBAC: Authorizing `identity:get_group(group_id=bb92eacbcb8e410f98e68f08c5190ca8)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:04.734712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f76c86-c7b7-47e8-8439-5b38dbb29140 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:04.736551 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 202/398] 10.222.0.15 () {56 vars in 1180 bytes} [Fri May 27 19:40:04 2022] GET /identity/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:04.737654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d49d9b-221e-4393-9f7c-6ce36f12ef27 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:04.737943 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d49d9b-221e-4393-9f7c-6ce36f12ef27 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:04.738222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d49d9b-221e-4393-9f7c-6ce36f12ef27 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:04.739624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 203/399] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:04.743263 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d49d9b-221e-4393-9f7c-6ce36f12ef27 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:04.777979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 197/400] 10.222.0.15 () {58 vars in 1442 bytes} [Fri May 27 19:40:04 2022] PUT /identity/v3/projects/bae51daa53924a5a9246a49472acf706/groups/bb92eacbcb8e410f98e68f08c5190ca8/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:40:04.779655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1ee48-3505-4851-a23b-95dd524393cb None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:04.780155 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1ee48-3505-4851-a23b-95dd524393cb None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:04.780655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1ee48-3505-4851-a23b-95dd524393cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:04.813614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-8be1ee48-3505-4851-a23b-95dd524393cb None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:04.817666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-8be1ee48-3505-4851-a23b-95dd524393cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:04.859002 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:04.914603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d49d9b-221e-4393-9f7c-6ce36f12ef27 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:04.957353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d9e61-939e-4719-9ba4-a98480cfb1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:04.958693 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d9e61-939e-4719-9ba4-a98480cfb1c5 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:04.959186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d9e61-939e-4719-9ba4-a98480cfb1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:04.959697 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d9e61-939e-4719-9ba4-a98480cfb1c5 None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:04.961161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d9e61-939e-4719-9ba4-a98480cfb1c5 None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:04.963049 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d9e61-939e-4719-9ba4-a98480cfb1c5 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:04.964170 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 198/401] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:04.970007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 204/402] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:40:04 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:04.972121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1ee48-3505-4851-a23b-95dd524393cb None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:04.991804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d9e61-939e-4719-9ba4-a98480cfb1c5 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:05.089453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:05.121379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1ee48-3505-4851-a23b-95dd524393cb None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:05.151355 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d9e61-939e-4719-9ba4-a98480cfb1c5 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:05.159785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a55059-2ee5-40f3-b280-401e127796a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:05.160995 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a55059-2ee5-40f3-b280-401e127796a5 None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:05.161455 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a55059-2ee5-40f3-b280-401e127796a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:05.162139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a55059-2ee5-40f3-b280-401e127796a5 None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11/groups/bb92eacbcb8e410f98e68f08c5190ca8/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:05.164524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a55059-2ee5-40f3-b280-401e127796a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7932e13323241e28bd6b9427eb8ea11, group_id=bb92eacbcb8e410f98e68f08c5190ca8, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:05.166069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a55059-2ee5-40f3-b280-401e127796a5 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:05.189936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40293e-ae2f-4482-8d66-6b6938552c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:05.190828 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40293e-ae2f-4482-8d66-6b6938552c51 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:05.191113 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40293e-ae2f-4482-8d66-6b6938552c51 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:05.191391 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40293e-ae2f-4482-8d66-6b6938552c51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:05.198627 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:05.203843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40293e-ae2f-4482-8d66-6b6938552c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-ab40293e-ae2f-4482-8d66-6b6938552c51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:05.211631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:05.212564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:05.213923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:05.213923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:05.213923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:05.213923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:05.213923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:05.213923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:05.213923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:05.213923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:05.213923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:05.213923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:05.213923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:05.213923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:05.213923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 205/403] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:40:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:05.214655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848968f-026e-4fe2-a5db-aca9a7dd9e8e None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:05.214655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848968f-026e-4fe2-a5db-aca9a7dd9e8e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:05.215008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848968f-026e-4fe2-a5db-aca9a7dd9e8e None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:05.218393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 206/404] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:05.221134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848968f-026e-4fe2-a5db-aca9a7dd9e8e None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:05.238665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 199/405] 10.222.0.15 () {58 vars in 1442 bytes} [Fri May 27 19:40:04 2022] PUT /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11/groups/bb92eacbcb8e410f98e68f08c5190ca8/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:40:05.240902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6856b2f-209f-4331-82ec-51b01a22b3cd None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:05.241403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6856b2f-209f-4331-82ec-51b01a22b3cd None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:05.241882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6856b2f-209f-4331-82ec-51b01a22b3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:05.267062 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-d6856b2f-209f-4331-82ec-51b01a22b3cd None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:05.269310 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d6856b2f-209f-4331-82ec-51b01a22b3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:05.335154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848968f-026e-4fe2-a5db-aca9a7dd9e8e None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:05.385478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90641e0-ee88-4132-9b63-3dba842e2ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:05.386244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90641e0-ee88-4132-9b63-3dba842e2ddc None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:05.386570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90641e0-ee88-4132-9b63-3dba842e2ddc None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:05.387051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90641e0-ee88-4132-9b63-3dba842e2ddc None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:05.388517 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 200/406] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:05.388627 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90641e0-ee88-4132-9b63-3dba842e2ddc None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:05.388812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90641e0-ee88-4132-9b63-3dba842e2ddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:05.390287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90641e0-ee88-4132-9b63-3dba842e2ddc None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:05.409063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 207/407] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:05.415530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6856b2f-209f-4331-82ec-51b01a22b3cd None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:05.424770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90641e0-ee88-4132-9b63-3dba842e2ddc None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:05.506730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:05.552354 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90641e0-ee88-4132-9b63-3dba842e2ddc None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:05.555359 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:05.598036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6856b2f-209f-4331-82ec-51b01a22b3cd None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:05.605957 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec474f8-1e96-4280-850e-ab98fcc3869d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:05.607146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec474f8-1e96-4280-850e-ab98fcc3869d None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:05.608015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec474f8-1e96-4280-850e-ab98fcc3869d None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:05.608474 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec474f8-1e96-4280-850e-ab98fcc3869d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:05.629123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec474f8-1e96-4280-850e-ab98fcc3869d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-9ec474f8-1e96-4280-850e-ab98fcc3869d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:05.637225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:05.638702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:05.639495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:05.639495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:05.639495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:05.639495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:05.639495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:05.639495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:05.639495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:05.639495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:05.639495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:05.639495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:05.639495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:40:05.639495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:05.639495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 208/408] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:40:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:05.651408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec474f8-1e96-4280-850e-ab98fcc3869d None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:05.667511 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d376e-d16b-4a92-86de-5415791072a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:05.668606 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d376e-d16b-4a92-86de-5415791072a1 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:05.669069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d376e-d16b-4a92-86de-5415791072a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:05.669512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d376e-d16b-4a92-86de-5415791072a1 None admin] PATH_INFO: `/v3/groups/3e7429ce2280493780e27dc04053efcb` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:05.670976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d376e-d16b-4a92-86de-5415791072a1 None admin] RBAC: Authorizing `identity:get_group(group_id=3e7429ce2280493780e27dc04053efcb)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:05.672591 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d376e-d16b-4a92-86de-5415791072a1 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:05.674725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 201/409] 10.222.0.15 () {56 vars in 1180 bytes} [Fri May 27 19:40:05 2022] GET /identity/v3/groups/3e7429ce2280493780e27dc04053efcb => generated 229 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:05.680081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d376e-d16b-4a92-86de-5415791072a1 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:05.853389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec474f8-1e96-4280-850e-ab98fcc3869d None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:05.876071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d376e-d16b-4a92-86de-5415791072a1 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:05.891522 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:05.919336 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38876849-e9a1-4060-b16e-2cfbeb7019eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:05.920407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38876849-e9a1-4060-b16e-2cfbeb7019eb None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:05.921144 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38876849-e9a1-4060-b16e-2cfbeb7019eb None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:05.921450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38876849-e9a1-4060-b16e-2cfbeb7019eb None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:05.922274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38876849-e9a1-4060-b16e-2cfbeb7019eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:05.922674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38876849-e9a1-4060-b16e-2cfbeb7019eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:05.924187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38876849-e9a1-4060-b16e-2cfbeb7019eb None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:05.933394 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 209/410] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:05.938975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38876849-e9a1-4060-b16e-2cfbeb7019eb None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:05.939451 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e511ba3-97a4-4798-af0b-b44347266294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:05.940543 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e511ba3-97a4-4798-af0b-b44347266294 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:05.941023 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e511ba3-97a4-4798-af0b-b44347266294 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:05.941527 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e511ba3-97a4-4798-af0b-b44347266294 None admin] PATH_INFO: `/v3/projects/b60b3b1e79a5473da57ed66a39a9281a` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:05.942976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e511ba3-97a4-4798-af0b-b44347266294 None admin] RBAC: Authorizing `identity:get_project(project_id=b60b3b1e79a5473da57ed66a39a9281a)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:05.944432 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e511ba3-97a4-4798-af0b-b44347266294 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:05.946433 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 202/411] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:40:05 2022] GET /identity/v3/projects/b60b3b1e79a5473da57ed66a39a9281a => generated 344 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:05.951848 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e511ba3-97a4-4798-af0b-b44347266294 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:05.954660 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:06.056586 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38876849-e9a1-4060-b16e-2cfbeb7019eb None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:06.074819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e511ba3-97a4-4798-af0b-b44347266294 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:06.101385 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6223a1-2921-4aa8-aeff-7e39ed783e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:06.102248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6223a1-2921-4aa8-aeff-7e39ed783e27 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:06.102564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6223a1-2921-4aa8-aeff-7e39ed783e27 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:06.102843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6223a1-2921-4aa8-aeff-7e39ed783e27 None admin] PATH_INFO: `/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:06.104593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6223a1-2921-4aa8-aeff-7e39ed783e27 None admin] RBAC: Authorizing `identity:get_group(group_id=bb92eacbcb8e410f98e68f08c5190ca8)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:06.106904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6223a1-2921-4aa8-aeff-7e39ed783e27 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:06.113599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 210/412] 10.222.0.15 () {56 vars in 1180 bytes} [Fri May 27 19:40:05 2022] GET /identity/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:06.113599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89bcf0-6770-4bdc-8573-d18a1a012880 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:06.113599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89bcf0-6770-4bdc-8573-d18a1a012880 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:06.113599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89bcf0-6770-4bdc-8573-d18a1a012880 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:06.113599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 211/413] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:06.115165 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89bcf0-6770-4bdc-8573-d18a1a012880 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:06.127249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3db3e-1603-4477-be90-6487a948a1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:06.128168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3db3e-1603-4477-be90-6487a948a1eb None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:06.128455 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3db3e-1603-4477-be90-6487a948a1eb None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:06.128735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3db3e-1603-4477-be90-6487a948a1eb None admin] PATH_INFO: `/v3/projects/b60b3b1e79a5473da57ed66a39a9281a/groups/3e7429ce2280493780e27dc04053efcb/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:06.130973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3db3e-1603-4477-be90-6487a948a1eb None admin] RBAC: Authorizing `identity:create_grant(project_id=b60b3b1e79a5473da57ed66a39a9281a, group_id=3e7429ce2280493780e27dc04053efcb, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:06.132524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3db3e-1603-4477-be90-6487a948a1eb None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:06.175934 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:06.210380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 203/414] 10.222.0.15 () {58 vars in 1442 bytes} [Fri May 27 19:40:05 2022] PUT /identity/v3/projects/b60b3b1e79a5473da57ed66a39a9281a/groups/3e7429ce2280493780e27dc04053efcb/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 19:40:06.210380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9284d1-0d80-44e3-b4bf-1ece2961698c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:06.210380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9284d1-0d80-44e3-b4bf-1ece2961698c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:06.210380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9284d1-0d80-44e3-b4bf-1ece2961698c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:06.251314 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-0b9284d1-0d80-44e3-b4bf-1ece2961698c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:06.252579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-0b9284d1-0d80-44e3-b4bf-1ece2961698c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:06.293057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89bcf0-6770-4bdc-8573-d18a1a012880 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:06.351405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:06.364419 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 204/415] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:06.376456 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd757684-9e19-4f52-bcc4-e17cde32360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:06.377605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd757684-9e19-4f52-bcc4-e17cde32360d None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:06.378427 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd757684-9e19-4f52-bcc4-e17cde32360d None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:06.378860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd757684-9e19-4f52-bcc4-e17cde32360d None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:06.381579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd757684-9e19-4f52-bcc4-e17cde32360d None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:06.383424 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd757684-9e19-4f52-bcc4-e17cde32360d None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:06.390316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 212/416] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:40:06 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:06.391283 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9284d1-0d80-44e3-b4bf-1ece2961698c None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:06.404732 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd757684-9e19-4f52-bcc4-e17cde32360d None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:06.529786 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9284d1-0d80-44e3-b4bf-1ece2961698c None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:06.547854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd757684-9e19-4f52-bcc4-e17cde32360d None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:06.568629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:06.572504 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b825b-1b01-483e-b768-3b512201f12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:06.573816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b825b-1b01-483e-b768-3b512201f12f None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:06.574101 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b825b-1b01-483e-b768-3b512201f12f None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:06.574414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b825b-1b01-483e-b768-3b512201f12f None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11/groups/bb92eacbcb8e410f98e68f08c5190ca8/roles/cba310daca814298b574fb2259749836` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:06.577814 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b825b-1b01-483e-b768-3b512201f12f None admin] RBAC: Authorizing `identity:create_grant(project_id=e7932e13323241e28bd6b9427eb8ea11, group_id=bb92eacbcb8e410f98e68f08c5190ca8, role_id=cba310daca814298b574fb2259749836)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:06.579896 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b825b-1b01-483e-b768-3b512201f12f None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:06.589586 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3202d-9924-4aee-8ed5-987a15409f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:06.591805 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3202d-9924-4aee-8ed5-987a15409f82 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:06.591805 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3202d-9924-4aee-8ed5-987a15409f82 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:06.591805 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3202d-9924-4aee-8ed5-987a15409f82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:06.609494 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d3202d-9924-4aee-8ed5-987a15409f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-c1d3202d-9924-4aee-8ed5-987a15409f82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:06.617983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:06.626883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:06.627738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:06.627738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:06.627738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:06.627738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:06.627738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:06.627738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:06.627738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:06.627738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:06.627738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:06.627738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:06.627738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:40:06.627738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:06.627738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 213/417] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:40:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:06.628800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3202d-9924-4aee-8ed5-987a15409f82 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:06.677669 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 205/418] 10.222.0.15 () {58 vars in 1442 bytes} [Fri May 27 19:40:06 2022] PUT /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11/groups/bb92eacbcb8e410f98e68f08c5190ca8/roles/cba310daca814298b574fb2259749836 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 19:40:06.754443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3202d-9924-4aee-8ed5-987a15409f82 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:06.802441 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9ca55-bbfd-40aa-bac3-2567fcaafb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:06.803133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9ca55-bbfd-40aa-bac3-2567fcaafb66 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:06.803421 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9ca55-bbfd-40aa-bac3-2567fcaafb66 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:06.803756 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9ca55-bbfd-40aa-bac3-2567fcaafb66 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:06.804529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9ca55-bbfd-40aa-bac3-2567fcaafb66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:06.804846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9ca55-bbfd-40aa-bac3-2567fcaafb66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:06.806354 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9ca55-bbfd-40aa-bac3-2567fcaafb66 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:06.820885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 214/419] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:06.827277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b825b-1b01-483e-b768-3b512201f12f None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:06.897708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:06.968953 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b825b-1b01-483e-b768-3b512201f12f None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:07.006126 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb403bb2-7526-48f9-ad9e-3686fe38707e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:07.007082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb403bb2-7526-48f9-ad9e-3686fe38707e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:07.007513 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb403bb2-7526-48f9-ad9e-3686fe38707e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:07.007937 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb403bb2-7526-48f9-ad9e-3686fe38707e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:07.081484 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb403bb2-7526-48f9-ad9e-3686fe38707e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:07.083201 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb403bb2-7526-48f9-ad9e-3686fe38707e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:07.137940 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:07.195811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 206/420] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:40:07.203453 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9ca55-bbfd-40aa-bac3-2567fcaafb66 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:07.270743 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:07.348176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9ca55-bbfd-40aa-bac3-2567fcaafb66 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:07.390360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08093a88-76bc-41a4-8671-f28d9fcfa522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:07.391235 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08093a88-76bc-41a4-8671-f28d9fcfa522 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:07.391520 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08093a88-76bc-41a4-8671-f28d9fcfa522 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:07.391800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08093a88-76bc-41a4-8671-f28d9fcfa522 None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:07.393036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08093a88-76bc-41a4-8671-f28d9fcfa522 None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:07.394519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08093a88-76bc-41a4-8671-f28d9fcfa522 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:07.396545 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 215/421] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:40:07 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:07.402243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb403bb2-7526-48f9-ad9e-3686fe38707e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:07.513682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb22c3-ff63-403d-b86d-855b3217ca71 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:07.514004 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb22c3-ff63-403d-b86d-855b3217ca71 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:07.514256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb22c3-ff63-403d-b86d-855b3217ca71 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:07.515815 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 216/422] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:07.521665 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3957f-6ba7-4efa-be59-eb91a24d95fd None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:07.521962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3957f-6ba7-4efa-be59-eb91a24d95fd None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:07.522243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3957f-6ba7-4efa-be59-eb91a24d95fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:07.547567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-0dc3957f-6ba7-4efa-be59-eb91a24d95fd None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:07.548741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-0dc3957f-6ba7-4efa-be59-eb91a24d95fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:07.578200 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb403bb2-7526-48f9-ad9e-3686fe38707e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:07.646150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbd6ed-c529-4194-9e3b-0c2f1c68bc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:07.647065 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbd6ed-c529-4194-9e3b-0c2f1c68bc50 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:07.647350 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbd6ed-c529-4194-9e3b-0c2f1c68bc50 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:07.647910 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbd6ed-c529-4194-9e3b-0c2f1c68bc50 None admin] PATH_INFO: `/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:07.649543 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbd6ed-c529-4194-9e3b-0c2f1c68bc50 None admin] RBAC: Authorizing `identity:get_group(group_id=bb92eacbcb8e410f98e68f08c5190ca8)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:07.651073 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbd6ed-c529-4194-9e3b-0c2f1c68bc50 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:07.652811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 207/423] 10.222.0.15 () {56 vars in 1180 bytes} [Fri May 27 19:40:07 2022] GET /identity/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:07.659936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbd6ed-c529-4194-9e3b-0c2f1c68bc50 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:07.679295 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 217/424] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:07.700740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:07.702466 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3957f-6ba7-4efa-be59-eb91a24d95fd None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:07.746863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:07.848721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3957f-6ba7-4efa-be59-eb91a24d95fd None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:07.860196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbd6ed-c529-4194-9e3b-0c2f1c68bc50 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:07.905511 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9fa8a-b0ee-4768-a1eb-a825b6fb7f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:07.906438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9fa8a-b0ee-4768-a1eb-a825b6fb7f33 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:07.906726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9fa8a-b0ee-4768-a1eb-a825b6fb7f33 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:07.907005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9fa8a-b0ee-4768-a1eb-a825b6fb7f33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:07.911573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709206de-ed6c-4ced-ab48-a1f8cbbeca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:07.912606 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709206de-ed6c-4ced-ab48-a1f8cbbeca0d None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:07.913005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709206de-ed6c-4ced-ab48-a1f8cbbeca0d None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:07.913429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709206de-ed6c-4ced-ab48-a1f8cbbeca0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:07.914615 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709206de-ed6c-4ced-ab48-a1f8cbbeca0d None admin] RBAC: Adding query filter params (group.id=bb92eacbcb8e410f98e68f08c5190ca8, role.id=cba310daca814298b574fb2259749836, scope.project.id=bae51daa53924a5a9246a49472acf706) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:07.915329 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709206de-ed6c-4ced-ab48-a1f8cbbeca0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:07.916825 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709206de-ed6c-4ced-ab48-a1f8cbbeca0d None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:07.917749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9fa8a-b0ee-4768-a1eb-a825b6fb7f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:07.923514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 208/425] 10.222.0.15 () {56 vars in 1376 bytes} [Fri May 27 19:40:07 2022] GET /identity/v3/role_assignments?group.id=bb92eacbcb8e410f98e68f08c5190ca8&scope.project.id=bae51daa53924a5a9246a49472acf706&role.id=cba310daca814298b574fb2259749836 => generated 611 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:07.924856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f4ef2-8da7-456e-b204-ccd55d48e74c None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:07.925152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f4ef2-8da7-456e-b204-ccd55d48e74c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:07.925429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f4ef2-8da7-456e-b204-ccd55d48e74c None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-45f9fa8a-b0ee-4768-a1eb-a825b6fb7f33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:07.925687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:07.926864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:07.927670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:07.927670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:07.927670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:07.927670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:07.927670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:07.927670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:07.927670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:07.927670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:07.927670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:07.927670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:07.927670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:40:07.927670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:07.927670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 218/427] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:07.931581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 209/427] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:07.936480 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e579b-f760-4541-90a3-159b0fef6690 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:07.936782 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e579b-f760-4541-90a3-159b0fef6690 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:07.937035 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e579b-f760-4541-90a3-159b0fef6690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:07.939439 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f4ef2-8da7-456e-b204-ccd55d48e74c None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:07.969076 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-d57e579b-f760-4541-90a3-159b0fef6690 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:07.970281 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d57e579b-f760-4541-90a3-159b0fef6690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:08.104732 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 219/428] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:08.130731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:08.147009 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f4ef2-8da7-456e-b204-ccd55d48e74c None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:08.157730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e579b-f760-4541-90a3-159b0fef6690 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:08.203410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:08.206058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88800-2ee0-48e0-a44d-34324a6f16e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:08.207014 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88800-2ee0-48e0-a44d-34324a6f16e6 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:08.207527 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88800-2ee0-48e0-a44d-34324a6f16e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:08.208002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a88800-2ee0-48e0-a44d-34324a6f16e6 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:08.210743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a88800-2ee0-48e0-a44d-34324a6f16e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:08.211235 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a88800-2ee0-48e0-a44d-34324a6f16e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:08.212769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a88800-2ee0-48e0-a44d-34324a6f16e6 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:08.221806 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 210/429] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:40:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:08.227882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88800-2ee0-48e0-a44d-34324a6f16e6 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:08.294410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e579b-f760-4541-90a3-159b0fef6690 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:08.335130 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a89258-1722-400f-85a4-0ce87c2c27dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:08.335653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a88800-2ee0-48e0-a44d-34324a6f16e6 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:08.335939 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a89258-1722-400f-85a4-0ce87c2c27dd None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:08.336230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a89258-1722-400f-85a4-0ce87c2c27dd None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:08.336512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a89258-1722-400f-85a4-0ce87c2c27dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:08.347915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a89258-1722-400f-85a4-0ce87c2c27dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-27a89258-1722-400f-85a4-0ce87c2c27dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:08.361496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:08.362438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:08.363462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:08.363462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:08.363462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:08.363462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:08.363462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:08.363462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:08.363462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:08.363462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:08.363462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:08.363462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:08.363462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 19:40:08.363462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:08.363462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 220/430] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:08.368302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a89258-1722-400f-85a4-0ce87c2c27dd None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:08.376561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e5b0e-801b-4219-824d-49a6dfbb9b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:08.377511 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e5b0e-801b-4219-824d-49a6dfbb9b62 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:08.378055 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e5b0e-801b-4219-824d-49a6dfbb9b62 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:08.378575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e5b0e-801b-4219-824d-49a6dfbb9b62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:08.395395 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:08.451675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e5b0e-801b-4219-824d-49a6dfbb9b62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:08.453573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e5b0e-801b-4219-824d-49a6dfbb9b62 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:08.474907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:08.486915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a89258-1722-400f-85a4-0ce87c2c27dd None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:08.535908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a5cca-ada5-42d5-99c1-b8136c6a9393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:08.537782 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a5cca-ada5-42d5-99c1-b8136c6a9393 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:08.538279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a5cca-ada5-42d5-99c1-b8136c6a9393 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:08.538996 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a5cca-ada5-42d5-99c1-b8136c6a9393 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:08.539960 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a5cca-ada5-42d5-99c1-b8136c6a9393 None admin] RBAC: Adding query filter params (name=member) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:08.540522 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a5cca-ada5-42d5-99c1-b8136c6a9393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:08.542684 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a5cca-ada5-42d5-99c1-b8136c6a9393 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:08.560852 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 221/431] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:40:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:08.561722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a5cca-ada5-42d5-99c1-b8136c6a9393 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:08.580844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 211/432] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 19:40:08.582272 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e5b0e-801b-4219-824d-49a6dfbb9b62 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:08.632898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:08.694234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a5cca-ada5-42d5-99c1-b8136c6a9393 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:08.714815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e5b0e-801b-4219-824d-49a6dfbb9b62 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:08.732810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccb0c5-8ea1-437d-af5f-cc6d48032162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:08.733606 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb0c5-8ea1-437d-af5f-cc6d48032162 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:08.733877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb0c5-8ea1-437d-af5f-cc6d48032162 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:08.734158 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb0c5-8ea1-437d-af5f-cc6d48032162 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:08.755492 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:08.764903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfb8c6-eabc-4be6-aa0f-2cefabdddc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:08.765780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfb8c6-eabc-4be6-aa0f-2cefabdddc7e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:08.769505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfb8c6-eabc-4be6-aa0f-2cefabdddc7e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:08.769505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfb8c6-eabc-4be6-aa0f-2cefabdddc7e None admin] PATH_INFO: `/v3/projects/bae51daa53924a5a9246a49472acf706` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:08.769505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfb8c6-eabc-4be6-aa0f-2cefabdddc7e None admin] RBAC: Authorizing `identity:get_project(project_id=bae51daa53924a5a9246a49472acf706)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:08.769505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfb8c6-eabc-4be6-aa0f-2cefabdddc7e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:08.775607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 212/433] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:40:08 2022] GET /identity/v3/projects/bae51daa53924a5a9246a49472acf706 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:08.776970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfb8c6-eabc-4be6-aa0f-2cefabdddc7e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:08.820564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccb0c5-8ea1-437d-af5f-cc6d48032162 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:08.822797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccb0c5-8ea1-437d-af5f-cc6d48032162 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:08.884559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfb8c6-eabc-4be6-aa0f-2cefabdddc7e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:08.899462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:08.925482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd46e3-6aa4-42ee-8a3e-870f67bbdde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:08.926637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd46e3-6aa4-42ee-8a3e-870f67bbdde3 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:08.926926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd46e3-6aa4-42ee-8a3e-870f67bbdde3 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:08.927205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd46e3-6aa4-42ee-8a3e-870f67bbdde3 None admin] PATH_INFO: `/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:08.928547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd46e3-6aa4-42ee-8a3e-870f67bbdde3 None admin] RBAC: Authorizing `identity:get_group(group_id=bb92eacbcb8e410f98e68f08c5190ca8)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:08.930482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd46e3-6aa4-42ee-8a3e-870f67bbdde3 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:08.932449 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 213/434] 10.222.0.15 () {56 vars in 1180 bytes} [Fri May 27 19:40:08 2022] GET /identity/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:08.933505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b796e4-524a-438c-805c-5f49da09f171 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:08.933860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b796e4-524a-438c-805c-5f49da09f171 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:08.934228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b796e4-524a-438c-805c-5f49da09f171 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:08.935646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 214/435] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:08.939187 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b796e4-524a-438c-805c-5f49da09f171 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:08.948305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 222/436] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 19:40:08.948305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383b914-78ef-46fb-aa8e-2270efb44e8b None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:08.948305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383b914-78ef-46fb-aa8e-2270efb44e8b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:08.948305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383b914-78ef-46fb-aa8e-2270efb44e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:08.963087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-0383b914-78ef-46fb-aa8e-2270efb44e8b None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:08.964276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-0383b914-78ef-46fb-aa8e-2270efb44e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:09.014905 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:09.035898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 223/437] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:09.036744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383b914-78ef-46fb-aa8e-2270efb44e8b None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:09.069399 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b796e4-524a-438c-805c-5f49da09f171 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:09.105468 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a12c48-39d6-47c2-af43-10e36309586c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:09.106838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a12c48-39d6-47c2-af43-10e36309586c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:09.107130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a12c48-39d6-47c2-af43-10e36309586c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:09.107412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a12c48-39d6-47c2-af43-10e36309586c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:09.108245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a12c48-39d6-47c2-af43-10e36309586c None admin] RBAC: Adding query filter params (group.id=bb92eacbcb8e410f98e68f08c5190ca8, role.id=c638961e289c4d108d8c584cb350a509, scope.project.id=bae51daa53924a5a9246a49472acf706) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:09.108559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a12c48-39d6-47c2-af43-10e36309586c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:09.109996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a12c48-39d6-47c2-af43-10e36309586c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:09.118494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 215/438] 10.222.0.15 () {56 vars in 1376 bytes} [Fri May 27 19:40:08 2022] GET /identity/v3/role_assignments?group.id=bb92eacbcb8e410f98e68f08c5190ca8&scope.project.id=bae51daa53924a5a9246a49472acf706&role.id=c638961e289c4d108d8c584cb350a509 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:09.119329 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a12c48-39d6-47c2-af43-10e36309586c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:09.169912 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383b914-78ef-46fb-aa8e-2270efb44e8b None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:09.181371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:09.224186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1540aa-f62c-4f14-9712-32fc116f24af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:09.225444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1540aa-f62c-4f14-9712-32fc116f24af None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:09.225937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1540aa-f62c-4f14-9712-32fc116f24af None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:09.226479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1540aa-f62c-4f14-9712-32fc116f24af None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:09.228119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1540aa-f62c-4f14-9712-32fc116f24af None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:09.230022 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1540aa-f62c-4f14-9712-32fc116f24af None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:09.237777 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 224/439] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:40:09 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:09.239217 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1540aa-f62c-4f14-9712-32fc116f24af None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:09.262884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a12c48-39d6-47c2-af43-10e36309586c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:09.302903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:09.317533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203eb2b-0979-46cd-9e14-2ef79d368687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:09.318480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203eb2b-0979-46cd-9e14-2ef79d368687 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:09.318915 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203eb2b-0979-46cd-9e14-2ef79d368687 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:09.319206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203eb2b-0979-46cd-9e14-2ef79d368687 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:09.334962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203eb2b-0979-46cd-9e14-2ef79d368687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-c203eb2b-0979-46cd-9e14-2ef79d368687 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:09.344998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:09.346099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:09.347172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:09.347172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:09.347172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:09.347172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:09.347172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:09.347172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:09.347172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:09.347172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:09.347172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:09.347172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:09.347172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:09.347172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:09.347938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 216/440] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:40:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:09.354629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203eb2b-0979-46cd-9e14-2ef79d368687 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:09.367835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1540aa-f62c-4f14-9712-32fc116f24af None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:09.407827 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9de71-a7a3-442c-b81b-b9dec8c7a990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:09.409071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9de71-a7a3-442c-b81b-b9dec8c7a990 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:09.409533 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9de71-a7a3-442c-b81b-b9dec8c7a990 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:09.409996 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9de71-a7a3-442c-b81b-b9dec8c7a990 None admin] PATH_INFO: `/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:09.411429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9de71-a7a3-442c-b81b-b9dec8c7a990 None admin] RBAC: Authorizing `identity:get_group(group_id=bb92eacbcb8e410f98e68f08c5190ca8)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:09.413057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9de71-a7a3-442c-b81b-b9dec8c7a990 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:09.415219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 225/441] 10.222.0.15 () {56 vars in 1180 bytes} [Fri May 27 19:40:09 2022] GET /identity/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:09.422130 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9de71-a7a3-442c-b81b-b9dec8c7a990 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:09.490841 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203eb2b-0979-46cd-9e14-2ef79d368687 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:09.500340 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:09.534785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e114e8-7820-45ef-aa57-feb9cfdf5b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:09.534785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e114e8-7820-45ef-aa57-feb9cfdf5b87 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:09.534785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e114e8-7820-45ef-aa57-feb9cfdf5b87 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:09.534785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e114e8-7820-45ef-aa57-feb9cfdf5b87 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:09.535211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e114e8-7820-45ef-aa57-feb9cfdf5b87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:09.535463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e114e8-7820-45ef-aa57-feb9cfdf5b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:09.536831 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e114e8-7820-45ef-aa57-feb9cfdf5b87 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:09.547393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 217/442] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:09.548903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8598752-ccb2-440b-b559-191af2ebb69d None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:09.548903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8598752-ccb2-440b-b559-191af2ebb69d None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:09.549105 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8598752-ccb2-440b-b559-191af2ebb69d None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:09.550555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 218/443] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:09.551747 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9de71-a7a3-442c-b81b-b9dec8c7a990 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:09.553286 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8598752-ccb2-440b-b559-191af2ebb69d None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:09.575573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:09.596138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9418767-63ab-4f9e-b796-ea789e7c529e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:09.597732 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9418767-63ab-4f9e-b796-ea789e7c529e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:09.597928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9418767-63ab-4f9e-b796-ea789e7c529e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:09.598169 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9418767-63ab-4f9e-b796-ea789e7c529e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:09.600051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9418767-63ab-4f9e-b796-ea789e7c529e None admin] RBAC: Adding query filter params (group.id=bb92eacbcb8e410f98e68f08c5190ca8, role.id=c638961e289c4d108d8c584cb350a509, scope.project.id=e7932e13323241e28bd6b9427eb8ea11) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:09.600377 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9418767-63ab-4f9e-b796-ea789e7c529e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:09.602299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9418767-63ab-4f9e-b796-ea789e7c529e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:09.608942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 226/444] 10.222.0.15 () {56 vars in 1376 bytes} [Fri May 27 19:40:09 2022] GET /identity/v3/role_assignments?group.id=bb92eacbcb8e410f98e68f08c5190ca8&scope.project.id=e7932e13323241e28bd6b9427eb8ea11&role.id=c638961e289c4d108d8c584cb350a509 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:09.611430 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df29f2-b86d-4371-8346-4417c4e0235e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:09.611725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df29f2-b86d-4371-8346-4417c4e0235e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:09.612021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df29f2-b86d-4371-8346-4417c4e0235e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:09.629972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e4df29f2-b86d-4371-8346-4417c4e0235e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:09.631425 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e4df29f2-b86d-4371-8346-4417c4e0235e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:09.690892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8598752-ccb2-440b-b559-191af2ebb69d None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:09.729977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 227/445] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:09.739844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e58ea8-f620-4ee6-8155-1a55226aca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:09.740512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e58ea8-f620-4ee6-8155-1a55226aca59 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:09.740797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e58ea8-f620-4ee6-8155-1a55226aca59 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:09.741073 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e58ea8-f620-4ee6-8155-1a55226aca59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:09.754640 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df29f2-b86d-4371-8346-4417c4e0235e None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:09.798050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:09.844805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e58ea8-f620-4ee6-8155-1a55226aca59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:09.846259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e58ea8-f620-4ee6-8155-1a55226aca59 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:09.874645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df29f2-b86d-4371-8346-4417c4e0235e None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:09.889104 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:09.914113 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73fe4e-c50d-427b-ae46-17c54cab1156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:09.914997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73fe4e-c50d-427b-ae46-17c54cab1156 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:09.915292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73fe4e-c50d-427b-ae46-17c54cab1156 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:09.915575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73fe4e-c50d-427b-ae46-17c54cab1156 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:09.929415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73fe4e-c50d-427b-ae46-17c54cab1156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-2e73fe4e-c50d-427b-ae46-17c54cab1156 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:09.938560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:09.939468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:09.940269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:09.940269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:09.940269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:09.940269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:09.940269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:09.940269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:09.940269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:09.940269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:09.940269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:09.940269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:09.940269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:40:09.940269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:09.945703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 228/446] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:40:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:09.946461 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73fe4e-c50d-427b-ae46-17c54cab1156 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:09.975892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 219/447] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 19:40:09.982527 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e58ea8-f620-4ee6-8155-1a55226aca59 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:10.060948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:10.062366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73fe4e-c50d-427b-ae46-17c54cab1156 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:10.094178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e58ea8-f620-4ee6-8155-1a55226aca59 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:10.098250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7b55f-d714-4d8d-9fcc-87177d92bc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:10.098959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7b55f-d714-4d8d-9fcc-87177d92bc31 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:10.099246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7b55f-d714-4d8d-9fcc-87177d92bc31 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:10.099527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7b55f-d714-4d8d-9fcc-87177d92bc31 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:10.100281 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7b55f-d714-4d8d-9fcc-87177d92bc31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:10.100593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7b55f-d714-4d8d-9fcc-87177d92bc31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:10.101987 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7b55f-d714-4d8d-9fcc-87177d92bc31 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:10.110757 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 229/448] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:10.116431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7b55f-d714-4d8d-9fcc-87177d92bc31 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:10.128702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0370e2-242a-4dd3-b30a-bf26237a9ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:10.129582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0370e2-242a-4dd3-b30a-bf26237a9ee9 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:10.129874 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0370e2-242a-4dd3-b30a-bf26237a9ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:10.130156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0370e2-242a-4dd3-b30a-bf26237a9ee9 None admin] PATH_INFO: `/v3/projects/b60b3b1e79a5473da57ed66a39a9281a` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:10.131379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0370e2-242a-4dd3-b30a-bf26237a9ee9 None admin] RBAC: Authorizing `identity:get_project(project_id=b60b3b1e79a5473da57ed66a39a9281a)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:10.132814 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0370e2-242a-4dd3-b30a-bf26237a9ee9 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:10.134569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 220/449] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:40:09 2022] GET /identity/v3/projects/b60b3b1e79a5473da57ed66a39a9281a => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:10.139899 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0370e2-242a-4dd3-b30a-bf26237a9ee9 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:10.146970 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:10.214801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7b55f-d714-4d8d-9fcc-87177d92bc31 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:10.237061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0370e2-242a-4dd3-b30a-bf26237a9ee9 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:10.248921 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf75568-b005-4fb1-9fb9-fb78e6e17d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:10.249567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf75568-b005-4fb1-9fb9-fb78e6e17d1f None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:10.249854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf75568-b005-4fb1-9fb9-fb78e6e17d1f None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:10.250132 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf75568-b005-4fb1-9fb9-fb78e6e17d1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:10.270775 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89bdfe-4cbf-4d24-9dc6-57496bace3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:10.271632 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89bdfe-4cbf-4d24-9dc6-57496bace3a8 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:10.271919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89bdfe-4cbf-4d24-9dc6-57496bace3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:10.272197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89bdfe-4cbf-4d24-9dc6-57496bace3a8 None admin] PATH_INFO: `/v3/groups/3e7429ce2280493780e27dc04053efcb` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:10.273372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89bdfe-4cbf-4d24-9dc6-57496bace3a8 None admin] RBAC: Authorizing `identity:get_group(group_id=3e7429ce2280493780e27dc04053efcb)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:10.274850 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89bdfe-4cbf-4d24-9dc6-57496bace3a8 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:10.276458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 221/450] 10.222.0.15 () {56 vars in 1180 bytes} [Fri May 27 19:40:10 2022] GET /identity/v3/groups/3e7429ce2280493780e27dc04053efcb => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:10.282745 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89bdfe-4cbf-4d24-9dc6-57496bace3a8 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:10.286248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:10.316472 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf75568-b005-4fb1-9fb9-fb78e6e17d1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:10.317927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf75568-b005-4fb1-9fb9-fb78e6e17d1f None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:10.347903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:10.381148 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89bdfe-4cbf-4d24-9dc6-57496bace3a8 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:10.414389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98783f-cefd-4d0f-b72c-c30ef980bc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:10.415036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98783f-cefd-4d0f-b72c-c30ef980bc75 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:10.415327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98783f-cefd-4d0f-b72c-c30ef980bc75 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:10.415606 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98783f-cefd-4d0f-b72c-c30ef980bc75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:10.415833 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 230/451] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 19:40:10.416428 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98783f-cefd-4d0f-b72c-c30ef980bc75 None admin] RBAC: Adding query filter params (group.id=3e7429ce2280493780e27dc04053efcb, role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=b60b3b1e79a5473da57ed66a39a9281a) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:10.416742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98783f-cefd-4d0f-b72c-c30ef980bc75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:10.418161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98783f-cefd-4d0f-b72c-c30ef980bc75 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:10.421923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf75568-b005-4fb1-9fb9-fb78e6e17d1f None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:10.425448 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 222/452] 10.222.0.15 () {56 vars in 1376 bytes} [Fri May 27 19:40:10 2022] GET /identity/v3/role_assignments?group.id=3e7429ce2280493780e27dc04053efcb&scope.project.id=b60b3b1e79a5473da57ed66a39a9281a&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:10.529335 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf75568-b005-4fb1-9fb9-fb78e6e17d1f None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:10.559716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:10.564585 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922265a-8a6f-4c41-8720-65cd468d1947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:10.570288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922265a-8a6f-4c41-8720-65cd468d1947 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:10.570288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922265a-8a6f-4c41-8720-65cd468d1947 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:10.570288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922265a-8a6f-4c41-8720-65cd468d1947 None admin] PATH_INFO: `/v3/projects/e7932e13323241e28bd6b9427eb8ea11` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:10.570288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922265a-8a6f-4c41-8720-65cd468d1947 None admin] RBAC: Authorizing `identity:get_project(project_id=e7932e13323241e28bd6b9427eb8ea11)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:10.570288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922265a-8a6f-4c41-8720-65cd468d1947 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:10.570809 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 231/453] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:40:10 2022] GET /identity/v3/projects/e7932e13323241e28bd6b9427eb8ea11 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:10.576176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98783f-cefd-4d0f-b72c-c30ef980bc75 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:10.645926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:10.681405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98783f-cefd-4d0f-b72c-c30ef980bc75 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:10.714043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca111c-9ac2-4018-9cfd-4338c4e14e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:10.714920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca111c-9ac2-4018-9cfd-4338c4e14e77 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:10.715250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca111c-9ac2-4018-9cfd-4338c4e14e77 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:10.716153 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca111c-9ac2-4018-9cfd-4338c4e14e77 None admin] PATH_INFO: `/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:10.717303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca111c-9ac2-4018-9cfd-4338c4e14e77 None admin] RBAC: Authorizing `identity:get_group(group_id=bb92eacbcb8e410f98e68f08c5190ca8)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:10.718760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca111c-9ac2-4018-9cfd-4338c4e14e77 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:10.720442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 223/454] 10.222.0.15 () {56 vars in 1180 bytes} [Fri May 27 19:40:10 2022] GET /identity/v3/groups/bb92eacbcb8e410f98e68f08c5190ca8 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:10.726292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922265a-8a6f-4c41-8720-65cd468d1947 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:10.821783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922265a-8a6f-4c41-8720-65cd468d1947 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:10.854214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352f889-5d29-4b0d-a233-75954501b4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:10.854884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352f889-5d29-4b0d-a233-75954501b4cc None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:10.855172 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352f889-5d29-4b0d-a233-75954501b4cc None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:10.855457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352f889-5d29-4b0d-a233-75954501b4cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:10.856307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352f889-5d29-4b0d-a233-75954501b4cc None admin] RBAC: Adding query filter params (group.id=bb92eacbcb8e410f98e68f08c5190ca8, role.id=cba310daca814298b574fb2259749836, scope.project.id=e7932e13323241e28bd6b9427eb8ea11) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:10.856618 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352f889-5d29-4b0d-a233-75954501b4cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:10.858053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352f889-5d29-4b0d-a233-75954501b4cc None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:10.863729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 232/455] 10.222.0.15 () {56 vars in 1376 bytes} [Fri May 27 19:40:10 2022] GET /identity/v3/role_assignments?group.id=bb92eacbcb8e410f98e68f08c5190ca8&scope.project.id=e7932e13323241e28bd6b9427eb8ea11&role.id=cba310daca814298b574fb2259749836 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:13.529627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c66f1-6ee0-4efc-83d1-69f9774c95d6 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:13.530152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c66f1-6ee0-4efc-83d1-69f9774c95d6 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:13.530242 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c66f1-6ee0-4efc-83d1-69f9774c95d6 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:13.531848 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 224/456] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:13.536821 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0de5e-93c4-45a6-bc85-2b410ccc4777 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:13.537227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0de5e-93c4-45a6-bc85-2b410ccc4777 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:13.537383 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0de5e-93c4-45a6-bc85-2b410ccc4777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:13.563291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e4f0de5e-93c4-45a6-bc85-2b410ccc4777 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:13.564690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e4f0de5e-93c4-45a6-bc85-2b410ccc4777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:13.647826 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:13.655854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 233/457] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:13.703985 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c66f1-6ee0-4efc-83d1-69f9774c95d6 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:13.862134 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c66f1-6ee0-4efc-83d1-69f9774c95d6 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:13.908414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b43d5-f38d-4b2e-869d-806f0b1e6615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:13.909215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b43d5-f38d-4b2e-869d-806f0b1e6615 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:13.909499 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b43d5-f38d-4b2e-869d-806f0b1e6615 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:13.909772 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b43d5-f38d-4b2e-869d-806f0b1e6615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:13.912734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:13.926333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b43d5-f38d-4b2e-869d-806f0b1e6615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:13.927813 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b43d5-f38d-4b2e-869d-806f0b1e6615 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:13.932774 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68615cfb-30ae-4b43-b21b-d278c15d2303 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:13.933258 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68615cfb-30ae-4b43-b21b-d278c15d2303 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:13.933690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68615cfb-30ae-4b43-b21b-d278c15d2303 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:13.935549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 234/458] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:13.941774 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603990b-a002-4a66-9c69-f734c37b67ea None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:13.942447 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603990b-a002-4a66-9c69-f734c37b67ea None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:13.943270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603990b-a002-4a66-9c69-f734c37b67ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:13.948277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-852b43d5-f38d-4b2e-869d-806f0b1e6615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:13.948277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:13.948277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:13.948277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:13.948277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:13.948277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:13.948277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:13.948277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:13.948277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:13.948277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:13.948277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:13.948277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:13.948277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:13.948277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:13.948277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:13.949158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:13.950586 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:13.950586 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:13.950586 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:13.950586 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:13.957347 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 225/459] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:13.958377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b43d5-f38d-4b2e-869d-806f0b1e6615 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:13.981787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a603990b-a002-4a66-9c69-f734c37b67ea None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:13.984980 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a603990b-a002-4a66-9c69-f734c37b67ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:14.074959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 235/460] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:14.082654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3263128-77b2-4f61-beda-c0ebf3751766 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:14.082654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3263128-77b2-4f61-beda-c0ebf3751766 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:14.082654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3263128-77b2-4f61-beda-c0ebf3751766 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:14.082654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 236/461] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:14.084600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823aad1-a76f-4d10-b795-8c9266916acb None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:14.085204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823aad1-a76f-4d10-b795-8c9266916acb None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:14.086673 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823aad1-a76f-4d10-b795-8c9266916acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:14.108224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b43d5-f38d-4b2e-869d-806f0b1e6615 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:14.112498 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-2823aad1-a76f-4d10-b795-8c9266916acb None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:14.113638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2823aad1-a76f-4d10-b795-8c9266916acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:14.145002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f992c-84bc-4128-b28a-945d19bc6e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:14.145903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f992c-84bc-4128-b28a-945d19bc6e33 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:14.146333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f992c-84bc-4128-b28a-945d19bc6e33 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:14.146815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f992c-84bc-4128-b28a-945d19bc6e33 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:14.147746 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f992c-84bc-4128-b28a-945d19bc6e33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:14.148197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f992c-84bc-4128-b28a-945d19bc6e33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:14.149780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f992c-84bc-4128-b28a-945d19bc6e33 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:14.163460 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 226/462] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:14.164501 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f992c-84bc-4128-b28a-945d19bc6e33 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:14.214372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 237/463] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:14.214372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823aad1-a76f-4d10-b795-8c9266916acb None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:14.240881 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:14.282258 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:14.300823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f992c-84bc-4128-b28a-945d19bc6e33 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:14.332519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823aad1-a76f-4d10-b795-8c9266916acb None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:14.339098 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a66a3-6dae-4a61-915e-a2e1ce9c25ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:14.340703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a66a3-6dae-4a61-915e-a2e1ce9c25ea None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:14.341137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a66a3-6dae-4a61-915e-a2e1ce9c25ea None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:14.341559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a66a3-6dae-4a61-915e-a2e1ce9c25ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:14.352346 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a66a3-6dae-4a61-915e-a2e1ce9c25ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:14.354213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a66a3-6dae-4a61-915e-a2e1ce9c25ea None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:14.367886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2c4fc-b3ca-4ad9-9734-b539c052d498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:14.368539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2c4fc-b3ca-4ad9-9734-b539c052d498 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:14.368824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2c4fc-b3ca-4ad9-9734-b539c052d498 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:14.369099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2c4fc-b3ca-4ad9-9734-b539c052d498 None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:14.369856 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2c4fc-b3ca-4ad9-9734-b539c052d498 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:14.372023 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2c4fc-b3ca-4ad9-9734-b539c052d498 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:14.374019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-154a66a3-6dae-4a61-915e-a2e1ce9c25ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:14.374019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:14.374019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:14.374019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:14.374019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:14.374019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:14.374019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:14.374019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:14.374019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:14.374019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:14.374019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:14.374019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:14.374019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:14.374019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:14.374019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:14.375079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:14.376129 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:14.376129 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:14.376129 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:14.376129 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:14.377974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 227/464] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:14.379041 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a66a3-6dae-4a61-915e-a2e1ce9c25ea None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:14.446421 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 238/465] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:40:14 2022] POST /identity/v3/users => generated 246 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:40:14.446421 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2c4fc-b3ca-4ad9-9734-b539c052d498 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:14.561996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a66a3-6dae-4a61-915e-a2e1ce9c25ea None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:14.571960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:14.628798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b743cd-f4d2-4127-b7c9-1ea7e2c85a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:14.629703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b743cd-f4d2-4127-b7c9-1ea7e2c85a7a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:14.630087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b743cd-f4d2-4127-b7c9-1ea7e2c85a7a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:14.630530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b743cd-f4d2-4127-b7c9-1ea7e2c85a7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:14.643337 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b743cd-f4d2-4127-b7c9-1ea7e2c85a7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:14.644830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b743cd-f4d2-4127-b7c9-1ea7e2c85a7a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:14.649159 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2c4fc-b3ca-4ad9-9734-b539c052d498 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:14.661808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:14.670443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-41b743cd-f4d2-4127-b7c9-1ea7e2c85a7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:14.670443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:14.670443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:14.670443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:14.670443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:14.670443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:14.670443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:14.670443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:14.670443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:14.670443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:14.670443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:14.670443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:14.670443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:14.670443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:14.670443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:14.675266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:14.676490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:14.676490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:14.676490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:14.676490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:14.676490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 228/466] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:14.676490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7236e-5135-4a32-a1c4-39fb991a37c5 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:14.676490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7236e-5135-4a32-a1c4-39fb991a37c5 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:14.676490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7236e-5135-4a32-a1c4-39fb991a37c5 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:14.678117 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 229/467] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:14.680138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7236e-5135-4a32-a1c4-39fb991a37c5 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:14.693144 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10057bd-f5ca-4ccf-8b3b-fda2985e74af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:14.694042 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10057bd-f5ca-4ccf-8b3b-fda2985e74af None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:14.696216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10057bd-f5ca-4ccf-8b3b-fda2985e74af None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:14.696216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10057bd-f5ca-4ccf-8b3b-fda2985e74af None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:14.696216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10057bd-f5ca-4ccf-8b3b-fda2985e74af None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:14.696216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10057bd-f5ca-4ccf-8b3b-fda2985e74af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:14.697072 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10057bd-f5ca-4ccf-8b3b-fda2985e74af None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:14.716064 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 239/468] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:14.721021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0a7d3-427d-4023-9cbd-b4e63ccda820 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:14.721021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0a7d3-427d-4023-9cbd-b4e63ccda820 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:14.721021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0a7d3-427d-4023-9cbd-b4e63ccda820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:14.799205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-58a0a7d3-427d-4023-9cbd-b4e63ccda820 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:14.801246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-58a0a7d3-427d-4023-9cbd-b4e63ccda820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:14.865302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7236e-5135-4a32-a1c4-39fb991a37c5 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:14.884154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 240/469] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:14.885525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0a7d3-427d-4023-9cbd-b4e63ccda820 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:14.928476 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec843f-9f1b-493e-a427-baa2a8b9dc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:14.929516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec843f-9f1b-493e-a427-baa2a8b9dc71 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:14.930000 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec843f-9f1b-493e-a427-baa2a8b9dc71 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:14.930506 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec843f-9f1b-493e-a427-baa2a8b9dc71 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:14.931450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec843f-9f1b-493e-a427-baa2a8b9dc71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:14.931965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec843f-9f1b-493e-a427-baa2a8b9dc71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:14.933621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec843f-9f1b-493e-a427-baa2a8b9dc71 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:14.946538 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 230/470] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:14.947814 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec843f-9f1b-493e-a427-baa2a8b9dc71 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:14.966630 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:15.023615 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:15.027468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0a7d3-427d-4023-9cbd-b4e63ccda820 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:15.058563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec843f-9f1b-493e-a427-baa2a8b9dc71 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:15.065241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d96bdd-bb35-4d4c-a712-2f86b7aca628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:15.065912 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d96bdd-bb35-4d4c-a712-2f86b7aca628 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:15.066196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d96bdd-bb35-4d4c-a712-2f86b7aca628 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:15.066503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d96bdd-bb35-4d4c-a712-2f86b7aca628 None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:15.067206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d96bdd-bb35-4d4c-a712-2f86b7aca628 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:15.069087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d96bdd-bb35-4d4c-a712-2f86b7aca628 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:15.095951 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6cc8d-339a-4111-b384-4f4a870cee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:15.096875 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6cc8d-339a-4111-b384-4f4a870cee84 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:15.098225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6cc8d-339a-4111-b384-4f4a870cee84 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:15.098225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6cc8d-339a-4111-b384-4f4a870cee84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:15.108731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6cc8d-339a-4111-b384-4f4a870cee84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:15.110183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6cc8d-339a-4111-b384-4f4a870cee84 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:15.127954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-acf6cc8d-339a-4111-b384-4f4a870cee84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:15.127954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:15.127954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:15.127954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:15.127954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:15.127954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:15.127954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:15.127954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:15.127954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:15.127954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:15.127954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:15.127954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:15.127954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:15.127954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:15.127954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:15.128979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:15.129829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:15.129829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:15.129829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:15.129829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:15.129829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 231/471] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:15.130090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6cc8d-339a-4111-b384-4f4a870cee84 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:15.158078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 241/472] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:40:14 2022] POST /identity/v3/users => generated 248 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:40:15.158078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de3497-5150-4d25-bdf4-11ecec012b91 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:15.158078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de3497-5150-4d25-bdf4-11ecec012b91 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:15.158078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de3497-5150-4d25-bdf4-11ecec012b91 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:15.158078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 242/473] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:15.158078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de3497-5150-4d25-bdf4-11ecec012b91 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:15.219130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:15.268471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6cc8d-339a-4111-b384-4f4a870cee84 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:15.298051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de3497-5150-4d25-bdf4-11ecec012b91 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:15.308916 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04413305-7b20-4671-bd4e-03e927665068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:15.309615 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04413305-7b20-4671-bd4e-03e927665068 None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:15.309902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04413305-7b20-4671-bd4e-03e927665068 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:15.310184 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04413305-7b20-4671-bd4e-03e927665068 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:15.311072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04413305-7b20-4671-bd4e-03e927665068 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:15.312706 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04413305-7b20-4671-bd4e-03e927665068 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:15.344334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d17481-a235-4e35-91ab-e3128131717f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:15.345150 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d17481-a235-4e35-91ab-e3128131717f None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:15.345516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d17481-a235-4e35-91ab-e3128131717f None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:15.345817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d17481-a235-4e35-91ab-e3128131717f None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:15.346692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d17481-a235-4e35-91ab-e3128131717f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:15.347001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d17481-a235-4e35-91ab-e3128131717f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:15.349134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d17481-a235-4e35-91ab-e3128131717f None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:15.367824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 243/474] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:15.367824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f35ceb-66a2-429b-85ee-956608eb8a5e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:15.367824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f35ceb-66a2-429b-85ee-956608eb8a5e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:15.367824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f35ceb-66a2-429b-85ee-956608eb8a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:15.382541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-b1f35ceb-66a2-429b-85ee-956608eb8a5e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:15.383744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b1f35ceb-66a2-429b-85ee-956608eb8a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:15.395358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:15.407250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 232/475] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:40:15 2022] POST /identity/v3/users => generated 248 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:40:15.408071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04413305-7b20-4671-bd4e-03e927665068 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:15.474410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 244/476] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:15.510717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f35ceb-66a2-429b-85ee-956608eb8a5e None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:15.567887 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04413305-7b20-4671-bd4e-03e927665068 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:15.599325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:15.620534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0268b94-712b-43c2-80fb-18a133e27f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:15.621504 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0268b94-712b-43c2-80fb-18a133e27f9c None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:15.621888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0268b94-712b-43c2-80fb-18a133e27f9c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:15.622267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0268b94-712b-43c2-80fb-18a133e27f9c None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:15.623110 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0268b94-712b-43c2-80fb-18a133e27f9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:15.624857 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0268b94-712b-43c2-80fb-18a133e27f9c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:15.648964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f35ceb-66a2-429b-85ee-956608eb8a5e None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:15.692556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba0bbb-a7fc-438b-8c2d-d2e075f5ea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:15.693406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba0bbb-a7fc-438b-8c2d-d2e075f5ea91 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:15.693695 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba0bbb-a7fc-438b-8c2d-d2e075f5ea91 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:15.694051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba0bbb-a7fc-438b-8c2d-d2e075f5ea91 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:15.694956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba0bbb-a7fc-438b-8c2d-d2e075f5ea91 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:15.696402 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba0bbb-a7fc-438b-8c2d-d2e075f5ea91 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:15.739537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.sql.core [None req-c7ba0bbb-a7fc-438b-8c2d-d2e075f5ea91 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 19:40:15.739537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 19:40:15.739537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [parameters: {'id': '392272398cf74c258aa87251d8e6762a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 19:40:15.739537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92145) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 19:40:15.739872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 233/477] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:40:15 2022] POST /identity/v3/users => generated 249 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:40:15.756932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-c7ba0bbb-a7fc-438b-8c2d-d2e075f5ea91 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 19:40:15.756932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:15.756932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 19:40:15.756932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 19:40:15.756932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 19:40:15.756932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 19:40:15.756932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 19:40:15.756932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application result = self._query(query) May 27 19:40:15.756932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 19:40:15.756932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application conn.query(q) May 27 19:40:15.756932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 19:40:15.756932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 19:40:15.756932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 19:40:15.756932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application result.read() May 27 19:40:15.756932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return ref.to_dict() May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 19:40:15.761212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application next(self.gen) May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application yield resource May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application next(self.gen) May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self.session.rollback() May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self.force_reraise() May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise self.value May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application session.commit() May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 19:40:15.762867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._prepare_impl() May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self.session.flush() May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._flush(objects) May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application compat.raise_( May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application flush_context.execute() May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rec.execute(self) May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 19:40:15.765188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 19:40:15.767222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application result = self._query(query) May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application conn.query(q) May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application result.read() May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 19:40:15.769126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [parameters: {'id': '392272398cf74c258aa87251d8e6762a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:15.774959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 19:40:15.776101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:15.778029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 245/478] 10.222.0.15 () {60 vars in 1131 bytes} [Fri May 27 19:40:15 2022] POST /identity/v3/roles => generated 144 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:15.778108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0268b94-712b-43c2-80fb-18a133e27f9c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:15.899338 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0268b94-712b-43c2-80fb-18a133e27f9c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:15.936754 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9b1bb-de7c-4416-9f35-a304bed38a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:15.937583 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9b1bb-de7c-4416-9f35-a304bed38a03 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:15.937917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9b1bb-de7c-4416-9f35-a304bed38a03 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:15.938199 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9b1bb-de7c-4416-9f35-a304bed38a03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:15.951212 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9b1bb-de7c-4416-9f35-a304bed38a03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-78f9b1bb-de7c-4416-9f35-a304bed38a03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:15.959547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:15.961736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:15.963732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:15.963732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:15.963732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:15.963732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:15.963732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:15.963732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:15.963732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:15.963732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:15.963732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:15.963732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:15.963732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 19:40:15.963732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:15.963732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 234/479] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:40:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:15.970386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba0bbb-a7fc-438b-8c2d-d2e075f5ea91 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:15.982786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:16.079360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba0bbb-a7fc-438b-8c2d-d2e075f5ea91 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:16.116303 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212f3c7-e470-43f1-8685-170cb77a9fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:16.116980 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212f3c7-e470-43f1-8685-170cb77a9fc0 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:16.117267 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212f3c7-e470-43f1-8685-170cb77a9fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:16.117546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212f3c7-e470-43f1-8685-170cb77a9fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:16.118310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212f3c7-e470-43f1-8685-170cb77a9fc0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:16.118642 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212f3c7-e470-43f1-8685-170cb77a9fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:16.120019 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212f3c7-e470-43f1-8685-170cb77a9fc0 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:16.129742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 246/480] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:16.943307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396a657-6475-4e8f-8f71-55edd35e997f None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:16.944021 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396a657-6475-4e8f-8f71-55edd35e997f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:16.944021 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396a657-6475-4e8f-8f71-55edd35e997f None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:16.945471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 235/481] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:16.951384 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b322006-d6cc-4036-ab34-f980c72d32cc None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:16.951868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b322006-d6cc-4036-ab34-f980c72d32cc None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:16.952016 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b322006-d6cc-4036-ab34-f980c72d32cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:16.973435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-9b322006-d6cc-4036-ab34-f980c72d32cc None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:16.974646 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9b322006-d6cc-4036-ab34-f980c72d32cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:17.063772 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 247/482] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:17.098920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396a657-6475-4e8f-8f71-55edd35e997f None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:17.154993 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:17.248050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396a657-6475-4e8f-8f71-55edd35e997f None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:17.291065 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d0f42-2dbe-444d-9ff7-68ad149f76ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:17.291871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d0f42-2dbe-444d-9ff7-68ad149f76ed None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:17.292158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d0f42-2dbe-444d-9ff7-68ad149f76ed None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:17.292436 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d0f42-2dbe-444d-9ff7-68ad149f76ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:17.313952 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d0f42-2dbe-444d-9ff7-68ad149f76ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-d87d0f42-2dbe-444d-9ff7-68ad149f76ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:17.321675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:17.322590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:17.323392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:17.323392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:17.323392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:17.323392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:17.323392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:17.323392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:17.323392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:17.323392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:17.323392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:17.323392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:17.323392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:17.323392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:17.326441 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 236/483] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:17.328719 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b322006-d6cc-4036-ab34-f980c72d32cc None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:17.333063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:17.539262 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b322006-d6cc-4036-ab34-f980c72d32cc None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:17.586916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96b60d-2df3-4cb2-af8e-04360ebc3b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:17.588014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96b60d-2df3-4cb2-af8e-04360ebc3b4e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:17.588493 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96b60d-2df3-4cb2-af8e-04360ebc3b4e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:17.588963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96b60d-2df3-4cb2-af8e-04360ebc3b4e None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:17.589964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96b60d-2df3-4cb2-af8e-04360ebc3b4e None admin] RBAC: Adding query filter params (name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:17.594378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96b60d-2df3-4cb2-af8e-04360ebc3b4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:17.596009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96b60d-2df3-4cb2-af8e-04360ebc3b4e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:17.610811 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 248/484] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:17.615935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d0f42-2dbe-444d-9ff7-68ad149f76ed None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:17.791013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:17.797122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d0f42-2dbe-444d-9ff7-68ad149f76ed None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:17.856908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a13bbe-19bb-48bf-bb19-45a556a31edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:17.857719 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a13bbe-19bb-48bf-bb19-45a556a31edf None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:17.858009 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a13bbe-19bb-48bf-bb19-45a556a31edf None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:17.858288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a13bbe-19bb-48bf-bb19-45a556a31edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:17.878315 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a13bbe-19bb-48bf-bb19-45a556a31edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:17.879808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a13bbe-19bb-48bf-bb19-45a556a31edf None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:17.900946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-86a13bbe-19bb-48bf-bb19-45a556a31edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:17.900946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:17.900946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:17.900946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:17.900946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:17.900946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:17.900946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:17.900946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:17.900946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:17.900946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:17.900946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:17.900946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:17.900946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:17.900946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:17.900946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:17.901828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:17.903238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:17.903238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:17.903238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:17.903238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:17.903238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 237/485] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:17.908243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96b60d-2df3-4cb2-af8e-04360ebc3b4e None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:17.973582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:18.044643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96b60d-2df3-4cb2-af8e-04360ebc3b4e None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:18.065470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7247cf5-4330-4386-96c0-7153f3685500 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:18.065981 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7247cf5-4330-4386-96c0-7153f3685500 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:18.066069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7247cf5-4330-4386-96c0-7153f3685500 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:18.067676 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 238/486] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:18.084009 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9c4f5-3ff5-4388-ab46-f5a77e827546 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:18.084302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9c4f5-3ff5-4388-ab46-f5a77e827546 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:18.084588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9c4f5-3ff5-4388-ab46-f5a77e827546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:18.097000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ad3aa-09f2-4c90-afdc-3e114886bbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:18.097677 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ad3aa-09f2-4c90-afdc-3e114886bbc6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:18.097973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ad3aa-09f2-4c90-afdc-3e114886bbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:18.098255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ad3aa-09f2-4c90-afdc-3e114886bbc6 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:18.099024 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ad3aa-09f2-4c90-afdc-3e114886bbc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:18.099341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ad3aa-09f2-4c90-afdc-3e114886bbc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:18.100736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ad3aa-09f2-4c90-afdc-3e114886bbc6 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:18.118846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-e0e9c4f5-3ff5-4388-ab46-f5a77e827546 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:18.120066 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e0e9c4f5-3ff5-4388-ab46-f5a77e827546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:18.129936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 249/487] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:18.140287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ad3aa-09f2-4c90-afdc-3e114886bbc6 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:18.234709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 239/488] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:40:18.236072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7329e-a4a9-45c1-9e54-fe960504107b None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:18.236373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7329e-a4a9-45c1-9e54-fe960504107b None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:18.236658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7329e-a4a9-45c1-9e54-fe960504107b None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:18.237922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 240/489] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:18.243113 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74770a2e-e533-408a-9d5e-7e9a061b4335 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:18.243412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74770a2e-e533-408a-9d5e-7e9a061b4335 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:18.243695 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74770a2e-e533-408a-9d5e-7e9a061b4335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:18.264801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-74770a2e-e533-408a-9d5e-7e9a061b4335 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:18.266000 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-74770a2e-e533-408a-9d5e-7e9a061b4335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:18.295865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ad3aa-09f2-4c90-afdc-3e114886bbc6 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:18.322250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:18.335205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b725b-9e15-4712-9f9d-f0d9f5afd713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:18.336736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b725b-9e15-4712-9f9d-f0d9f5afd713 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:18.337274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b725b-9e15-4712-9f9d-f0d9f5afd713 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:18.337717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b725b-9e15-4712-9f9d-f0d9f5afd713 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:18.346267 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b725b-9e15-4712-9f9d-f0d9f5afd713 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:18.348103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b725b-9e15-4712-9f9d-f0d9f5afd713 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:18.348376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 241/490] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:40:18.349223 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74770a2e-e533-408a-9d5e-7e9a061b4335 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:18.377489 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-973b725b-9e15-4712-9f9d-f0d9f5afd713 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:18.385106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:18.392077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:18.393056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:18.393056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:18.393056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:18.393056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:18.393056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:18.393056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:18.393056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:18.393056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:18.393056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 19:40:18.393056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:18.393056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 250/491] 10.222.0.15 () {56 vars in 1093 bytes} [Fri May 27 19:40:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:18.393056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b725b-9e15-4712-9f9d-f0d9f5afd713 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:18.484818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74770a2e-e533-408a-9d5e-7e9a061b4335 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:18.495762 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b725b-9e15-4712-9f9d-f0d9f5afd713 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:18.524372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72210e3e-5563-4863-acbd-967bc5b798c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:18.525658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72210e3e-5563-4863-acbd-967bc5b798c3 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:18.526190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72210e3e-5563-4863-acbd-967bc5b798c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:18.526703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72210e3e-5563-4863-acbd-967bc5b798c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:18.530904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc28486-9549-48b0-94e0-952da3eb7171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:18.531703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc28486-9549-48b0-94e0-952da3eb7171 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:18.531992 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc28486-9549-48b0-94e0-952da3eb7171 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:18.532274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc28486-9549-48b0-94e0-952da3eb7171 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:18.539993 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72210e3e-5563-4863-acbd-967bc5b798c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:18.542725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc28486-9549-48b0-94e0-952da3eb7171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-72210e3e-5563-4863-acbd-967bc5b798c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:18.548498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:18.549358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:18.550158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:18.550158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:18.550158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:18.550158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:18.550158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:18.550158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:18.550158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:18.550158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:18.550158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:18.550158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:18.550158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:18.550158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-1dc28486-9549-48b0-94e0-952da3eb7171 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:18.551074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:18.551855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:18.552637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:18.552637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:18.552637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:18.552637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:18.552637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:18.552637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:18.552637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:18.552637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:18.552637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:18.552637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:18.552637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:18.552637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:18.555874 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 242/493] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:18.556658 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 251/493] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:18.557130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72210e3e-5563-4863-acbd-967bc5b798c3 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:18.557610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc28486-9549-48b0-94e0-952da3eb7171 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:18.605005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:18.632718 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:18.660462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc28486-9549-48b0-94e0-952da3eb7171 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:18.674703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72210e3e-5563-4863-acbd-967bc5b798c3 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:18.700678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f676d8b-ee31-4ba1-89aa-33190190d452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:18.701382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f676d8b-ee31-4ba1-89aa-33190190d452 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:18.701674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f676d8b-ee31-4ba1-89aa-33190190d452 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:18.701958 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f676d8b-ee31-4ba1-89aa-33190190d452 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:18.702801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f676d8b-ee31-4ba1-89aa-33190190d452 None admin] RBAC: Adding query filter params (name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:18.703120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f676d8b-ee31-4ba1-89aa-33190190d452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:18.704581 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f676d8b-ee31-4ba1-89aa-33190190d452 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:18.718908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 252/494] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:18.719624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f676d8b-ee31-4ba1-89aa-33190190d452 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:18.724313 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787d371-dd40-4965-a7db-4ecf60eff19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:18.725320 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787d371-dd40-4965-a7db-4ecf60eff19e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:18.725803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787d371-dd40-4965-a7db-4ecf60eff19e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:18.726288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787d371-dd40-4965-a7db-4ecf60eff19e None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:18.727479 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787d371-dd40-4965-a7db-4ecf60eff19e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:18.734222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787d371-dd40-4965-a7db-4ecf60eff19e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:18.734222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787d371-dd40-4965-a7db-4ecf60eff19e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:18.773791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 243/495] 10.222.0.15 () {56 vars in 1133 bytes} [Fri May 27 19:40:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:18.775119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787d371-dd40-4965-a7db-4ecf60eff19e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:18.827764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f676d8b-ee31-4ba1-89aa-33190190d452 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:18.835013 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:18.862606 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67af7f0-b90c-4b54-a6ff-38eba58eab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:18.863285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67af7f0-b90c-4b54-a6ff-38eba58eab5b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:18.863565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67af7f0-b90c-4b54-a6ff-38eba58eab5b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:18.863840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67af7f0-b90c-4b54-a6ff-38eba58eab5b None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:18.864598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67af7f0-b90c-4b54-a6ff-38eba58eab5b None admin] RBAC: Adding query filter params (name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:18.864912 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67af7f0-b90c-4b54-a6ff-38eba58eab5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:18.866289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67af7f0-b90c-4b54-a6ff-38eba58eab5b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:18.875728 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 253/496] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:18.876681 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67af7f0-b90c-4b54-a6ff-38eba58eab5b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:18.895030 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787d371-dd40-4965-a7db-4ecf60eff19e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:18.920274 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:18.928551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394af71-8cc6-4c2b-84aa-43d8789419eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:18.929350 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394af71-8cc6-4c2b-84aa-43d8789419eb None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:18.929635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394af71-8cc6-4c2b-84aa-43d8789419eb None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:18.929911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394af71-8cc6-4c2b-84aa-43d8789419eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:18.940285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394af71-8cc6-4c2b-84aa-43d8789419eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:18.941764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394af71-8cc6-4c2b-84aa-43d8789419eb None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:18.959268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-6394af71-8cc6-4c2b-84aa-43d8789419eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:18.959268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:18.959268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:18.959268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:18.959268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:18.959268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:18.959268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:18.959268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:18.959268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:18.959268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:18.959268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:18.959268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:18.959268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:18.959268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:18.959268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:18.960103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:18.966018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:18.966018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:18.966018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:18.966018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:18.966018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 244/497] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:18.966018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704b420-20f2-45cf-a880-f751a3d3eef1 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:18.966018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704b420-20f2-45cf-a880-f751a3d3eef1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:18.966018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704b420-20f2-45cf-a880-f751a3d3eef1 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:18.966018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 245/498] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:18.966527 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0707d7-adc4-44a8-a870-3acafacea1ce None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:18.966607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0707d7-adc4-44a8-a870-3acafacea1ce None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:18.966926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0707d7-adc4-44a8-a870-3acafacea1ce None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:18.968286 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 246/499] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:18.968980 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0707d7-adc4-44a8-a870-3acafacea1ce None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:18.975972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67af7f0-b90c-4b54-a6ff-38eba58eab5b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:19.009902 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af1956-0aa2-42c8-b4ff-070a3e70068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:19.010580 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af1956-0aa2-42c8-b4ff-070a3e70068b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:19.010869 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af1956-0aa2-42c8-b4ff-070a3e70068b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:19.011151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af1956-0aa2-42c8-b4ff-070a3e70068b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:19.045355 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:19.070962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0707d7-adc4-44a8-a870-3acafacea1ce None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:19.080016 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af1956-0aa2-42c8-b4ff-070a3e70068b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:19.081641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af1956-0aa2-42c8-b4ff-070a3e70068b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:19.105655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61f588-3704-4b4c-b23d-38824acd28fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:19.106469 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61f588-3704-4b4c-b23d-38824acd28fa None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:19.106757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61f588-3704-4b4c-b23d-38824acd28fa None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:19.107031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61f588-3704-4b4c-b23d-38824acd28fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:19.117146 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61f588-3704-4b4c-b23d-38824acd28fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:19.118712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61f588-3704-4b4c-b23d-38824acd28fa None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:19.135832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-6f61f588-3704-4b4c-b23d-38824acd28fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:19.135832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:19.135832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:19.135832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:19.135832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:19.135832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:19.135832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:19.135832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:19.135832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:19.135832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:19.135832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:19.135832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:19.135832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:19.135832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:19.135832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:19.137365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:19.138411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:19.138411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:19.138411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:19.138411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:19.138411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 247/500] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:19.138411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61f588-3704-4b4c-b23d-38824acd28fa None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:19.172014 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:19.179289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 254/501] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:40:19.180452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce6bd6-e89e-4b3c-9d90-84a1b80d0446 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:19.180744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce6bd6-e89e-4b3c-9d90-84a1b80d0446 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:19.181019 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce6bd6-e89e-4b3c-9d90-84a1b80d0446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:19.196963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-b9ce6bd6-e89e-4b3c-9d90-84a1b80d0446 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:19.198378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b9ce6bd6-e89e-4b3c-9d90-84a1b80d0446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:19.248851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61f588-3704-4b4c-b23d-38824acd28fa None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:19.260620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:19.266047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 255/502] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:19.267322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb515928-4885-402e-84db-00ebc9e2d355 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:19.267615 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb515928-4885-402e-84db-00ebc9e2d355 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:19.267896 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb515928-4885-402e-84db-00ebc9e2d355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:19.284096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-eb515928-4885-402e-84db-00ebc9e2d355 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:19.285418 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-eb515928-4885-402e-84db-00ebc9e2d355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:19.288534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b383dba-2f16-4835-a7f0-274a000a9013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:19.289262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b383dba-2f16-4835-a7f0-274a000a9013 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:19.289555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b383dba-2f16-4835-a7f0-274a000a9013 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:19.289835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b383dba-2f16-4835-a7f0-274a000a9013 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:19.290590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b383dba-2f16-4835-a7f0-274a000a9013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:19.290903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b383dba-2f16-4835-a7f0-274a000a9013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:19.292277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b383dba-2f16-4835-a7f0-274a000a9013 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:19.305415 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 248/503] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:19.307291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b383dba-2f16-4835-a7f0-274a000a9013 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:19.356036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 256/504] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:19.356793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb515928-4885-402e-84db-00ebc9e2d355 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:19.408027 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:19.417292 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b383dba-2f16-4835-a7f0-274a000a9013 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:19.452529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe9954-8de7-4b18-9d59-862f10efb467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:19.453192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe9954-8de7-4b18-9d59-862f10efb467 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:19.453319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb515928-4885-402e-84db-00ebc9e2d355 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:19.453480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe9954-8de7-4b18-9d59-862f10efb467 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:19.453761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe9954-8de7-4b18-9d59-862f10efb467 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:19.454534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe9954-8de7-4b18-9d59-862f10efb467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:19.454845 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe9954-8de7-4b18-9d59-862f10efb467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:19.456226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe9954-8de7-4b18-9d59-862f10efb467 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:19.468164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 249/505] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:19.468164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe9954-8de7-4b18-9d59-862f10efb467 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:19.487168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:19.495246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a4291-5bf9-4490-a5f7-407743c0fee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:19.500851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a4291-5bf9-4490-a5f7-407743c0fee7 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:19.500851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a4291-5bf9-4490-a5f7-407743c0fee7 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:19.500851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a4291-5bf9-4490-a5f7-407743c0fee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:19.507219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a4291-5bf9-4490-a5f7-407743c0fee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:19.508672 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a4291-5bf9-4490-a5f7-407743c0fee7 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:19.526598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-c40a4291-5bf9-4490-a5f7-407743c0fee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:19.526598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:19.526598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:19.526598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:19.526598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:19.526598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:19.526598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:19.526598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:19.526598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:19.526598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:19.526598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:19.526598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:19.526598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:19.526598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:19.526598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:19.528114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:19.533730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:19.533730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:19.533730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:19.533730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:19.533730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 257/506] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:19.533730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a4291-5bf9-4490-a5f7-407743c0fee7 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:19.569860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe9954-8de7-4b18-9d59-862f10efb467 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:19.602566 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f11a8f-8158-4026-87b7-b5a4d9b292d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:19.603360 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f11a8f-8158-4026-87b7-b5a4d9b292d6 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:19.603644 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f11a8f-8158-4026-87b7-b5a4d9b292d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:19.603925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f11a8f-8158-4026-87b7-b5a4d9b292d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:19.613840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f11a8f-8158-4026-87b7-b5a4d9b292d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-b3f11a8f-8158-4026-87b7-b5a4d9b292d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:19.621885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:19.622871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:19.623879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:19.623879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:19.623879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:19.623879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:19.623879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:19.623879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:19.623879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:19.623879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:19.623879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:19.623879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:19.623879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:19.623879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:19.623879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 250/507] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:19.624713 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f11a8f-8158-4026-87b7-b5a4d9b292d6 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:19.632008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a4291-5bf9-4490-a5f7-407743c0fee7 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:19.638977 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:19.668292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa4cc5-181a-4377-b1f7-dd0e7d228253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:19.669356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa4cc5-181a-4377-b1f7-dd0e7d228253 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:19.669648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa4cc5-181a-4377-b1f7-dd0e7d228253 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:19.669930 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa4cc5-181a-4377-b1f7-dd0e7d228253 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:19.677381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa4cc5-181a-4377-b1f7-dd0e7d228253 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:19.678876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa4cc5-181a-4377-b1f7-dd0e7d228253 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-03fa4cc5-181a-4377-b1f7-dd0e7d228253 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:19.693999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:19.695067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:19.695941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:19.695941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:19.695941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:19.695941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:19.695941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:19.695941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:19.695941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:19.695941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:19.695941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 19:40:19.695941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:19.695941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 258/508] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:19.696527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa4cc5-181a-4377-b1f7-dd0e7d228253 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:19.732196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f11a8f-8158-4026-87b7-b5a4d9b292d6 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:19.738489 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:19.765743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647cdeb-aaaf-46ec-be94-b5df4cc23913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:19.766725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647cdeb-aaaf-46ec-be94-b5df4cc23913 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:19.767012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647cdeb-aaaf-46ec-be94-b5df4cc23913 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:19.767288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647cdeb-aaaf-46ec-be94-b5df4cc23913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:19.778270 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647cdeb-aaaf-46ec-be94-b5df4cc23913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:19.779769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647cdeb-aaaf-46ec-be94-b5df4cc23913 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:19.797071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-b647cdeb-aaaf-46ec-be94-b5df4cc23913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:19.797071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:19.797071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:19.797071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:19.797071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:19.797071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:19.797071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:19.797071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:19.797071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:19.797071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:19.797071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:19.797071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:19.797071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:19.797071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:19.797071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:19.797925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:19.799007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:19.799007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:19.799007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:19.799007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:19.799213 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa4cc5-181a-4377-b1f7-dd0e7d228253 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:19.799281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 251/509] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:19.799281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647cdeb-aaaf-46ec-be94-b5df4cc23913 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:19.836891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c6a4e-e50e-4203-951f-4ac7adba80c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:19.837684 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c6a4e-e50e-4203-951f-4ac7adba80c6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:19.837970 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c6a4e-e50e-4203-951f-4ac7adba80c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:19.838249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c6a4e-e50e-4203-951f-4ac7adba80c6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:19.845260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c6a4e-e50e-4203-951f-4ac7adba80c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:19.846737 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c6a4e-e50e-4203-951f-4ac7adba80c6 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:19.858454 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-0a6c6a4e-e50e-4203-951f-4ac7adba80c6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:19.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:19.862561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:19.863909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:19.863909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:19.863909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:19.863909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:19.863909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:19.863909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:19.863909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:19.863909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:19.863909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 19:40:19.863909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:19.863909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 259/510] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:19.863909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c6a4e-e50e-4203-951f-4ac7adba80c6 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:19.900289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647cdeb-aaaf-46ec-be94-b5df4cc23913 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:19.933337 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44c617-4a2e-4101-8deb-6521558aa5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:19.934614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44c617-4a2e-4101-8deb-6521558aa5c5 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:19.934902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44c617-4a2e-4101-8deb-6521558aa5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:19.935180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44c617-4a2e-4101-8deb-6521558aa5c5 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:19.935894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44c617-4a2e-4101-8deb-6521558aa5c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:19.936196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44c617-4a2e-4101-8deb-6521558aa5c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:19.937559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44c617-4a2e-4101-8deb-6521558aa5c5 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:19.949195 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 252/511] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:19.949990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44c617-4a2e-4101-8deb-6521558aa5c5 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:19.962984 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:19.965885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c6a4e-e50e-4203-951f-4ac7adba80c6 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:20.001766 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef3a6b-c013-4386-b6f1-d867de10aa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:20.002463 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef3a6b-c013-4386-b6f1-d867de10aa80 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:20.002749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef3a6b-c013-4386-b6f1-d867de10aa80 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:20.003043 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef3a6b-c013-4386-b6f1-d867de10aa80 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:20.003787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef3a6b-c013-4386-b6f1-d867de10aa80 None admin] RBAC: Adding query filter params (name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:20.004096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef3a6b-c013-4386-b6f1-d867de10aa80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:20.005466 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef3a6b-c013-4386-b6f1-d867de10aa80 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:20.013757 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 260/512] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:20.014629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef3a6b-c013-4386-b6f1-d867de10aa80 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:20.050934 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44c617-4a2e-4101-8deb-6521558aa5c5 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:20.072928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:20.085247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c74d15-4bd8-443e-8998-773fdbbfe5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:20.090217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c74d15-4bd8-443e-8998-773fdbbfe5e9 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:20.090217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c74d15-4bd8-443e-8998-773fdbbfe5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:20.090217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c74d15-4bd8-443e-8998-773fdbbfe5e9 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:20.090217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c74d15-4bd8-443e-8998-773fdbbfe5e9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:20.090217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c74d15-4bd8-443e-8998-773fdbbfe5e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:20.090217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c74d15-4bd8-443e-8998-773fdbbfe5e9 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:20.107475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 253/513] 10.222.0.15 () {56 vars in 1137 bytes} [Fri May 27 19:40:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:20.108977 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c74d15-4bd8-443e-8998-773fdbbfe5e9 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:20.114490 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef3a6b-c013-4386-b6f1-d867de10aa80 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:20.148653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485147b4-9d70-4857-b6cf-33fd3ae7102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:20.149319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485147b4-9d70-4857-b6cf-33fd3ae7102c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:20.149607 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485147b4-9d70-4857-b6cf-33fd3ae7102c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:20.149888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485147b4-9d70-4857-b6cf-33fd3ae7102c None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:20.150652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485147b4-9d70-4857-b6cf-33fd3ae7102c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:20.150967 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485147b4-9d70-4857-b6cf-33fd3ae7102c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:20.152365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485147b4-9d70-4857-b6cf-33fd3ae7102c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:20.164034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 261/514] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:20.164817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485147b4-9d70-4857-b6cf-33fd3ae7102c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:20.190018 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:20.208831 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c74d15-4bd8-443e-8998-773fdbbfe5e9 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:20.241947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bc073-87ef-41ab-8a16-2dfd3b6750be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:20.242648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bc073-87ef-41ab-8a16-2dfd3b6750be None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:20.242942 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bc073-87ef-41ab-8a16-2dfd3b6750be None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:20.243224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bc073-87ef-41ab-8a16-2dfd3b6750be None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:20.244054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bc073-87ef-41ab-8a16-2dfd3b6750be None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:20.244366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bc073-87ef-41ab-8a16-2dfd3b6750be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:20.246307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bc073-87ef-41ab-8a16-2dfd3b6750be None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:20.264451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485147b4-9d70-4857-b6cf-33fd3ae7102c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:20.264809 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 254/515] 10.222.0.15 () {56 vars in 1137 bytes} [Fri May 27 19:40:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:20.265614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bc073-87ef-41ab-8a16-2dfd3b6750be None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:20.301779 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7401d93-ce96-4cb6-8ae2-de4f3ecd6c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:20.302616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7401d93-ce96-4cb6-8ae2-de4f3ecd6c8d None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:20.302911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7401d93-ce96-4cb6-8ae2-de4f3ecd6c8d None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:20.303198 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7401d93-ce96-4cb6-8ae2-de4f3ecd6c8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:20.303913 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:20.310265 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7401d93-ce96-4cb6-8ae2-de4f3ecd6c8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:20.311755 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7401d93-ce96-4cb6-8ae2-de4f3ecd6c8d None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:20.326287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-c7401d93-ce96-4cb6-8ae2-de4f3ecd6c8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:20.326287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:20.326287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:20.326287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:20.326287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:20.326287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:20.326287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:20.326287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:20.326287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:20.326287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:20.326287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:20.326287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:20.326287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:20.326287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:20.326287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:20.327216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:20.328060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:20.328060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:20.328060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:20.328060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:20.328060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:20.328060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:20.328060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:20.328060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:20.328060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 262/516] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:20.328540 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7401d93-ce96-4cb6-8ae2-de4f3ecd6c8d None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:20.363469 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bc073-87ef-41ab-8a16-2dfd3b6750be None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:20.397024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa23bda-4c25-48bb-b45e-e5d6dc9aaf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:20.397737 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa23bda-4c25-48bb-b45e-e5d6dc9aaf30 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:20.398019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa23bda-4c25-48bb-b45e-e5d6dc9aaf30 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:20.398292 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa23bda-4c25-48bb-b45e-e5d6dc9aaf30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:20.408201 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa23bda-4c25-48bb-b45e-e5d6dc9aaf30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:20.409633 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa23bda-4c25-48bb-b45e-e5d6dc9aaf30 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:20.410269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:20.427397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-9fa23bda-4c25-48bb-b45e-e5d6dc9aaf30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:20.427397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:20.427397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:20.427397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:20.427397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:20.427397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:20.427397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:20.427397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:20.427397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:20.427397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:20.427397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:20.427397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:20.427397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:20.427397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:20.427397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:20.428279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:20.429130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:20.429130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:20.429130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:20.429130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:20.429339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7401d93-ce96-4cb6-8ae2-de4f3ecd6c8d None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:20.429407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 255/517] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:20.429407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa23bda-4c25-48bb-b45e-e5d6dc9aaf30 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:20.464737 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c822f-6f6f-44ef-8dab-8b34201d2eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:20.465417 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c822f-6f6f-44ef-8dab-8b34201d2eb6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:20.465705 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c822f-6f6f-44ef-8dab-8b34201d2eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:20.465983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c822f-6f6f-44ef-8dab-8b34201d2eb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:20.522495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:20.531939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa23bda-4c25-48bb-b45e-e5d6dc9aaf30 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:20.534397 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c822f-6f6f-44ef-8dab-8b34201d2eb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:20.535898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c822f-6f6f-44ef-8dab-8b34201d2eb6 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:20.565988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e0866-643a-4c78-980a-adf041aa58b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:20.566678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e0866-643a-4c78-980a-adf041aa58b2 None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:20.566964 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e0866-643a-4c78-980a-adf041aa58b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:20.567242 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e0866-643a-4c78-980a-adf041aa58b2 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:20.567935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e0866-643a-4c78-980a-adf041aa58b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:20.569339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e0866-643a-4c78-980a-adf041aa58b2 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:20.613772 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:20.631523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 263/518] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:40:20.632317 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c822f-6f6f-44ef-8dab-8b34201d2eb6 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:20.673651 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 256/519] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:40:20 2022] POST /identity/v3/users => generated 247 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:40:20.674468 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e0866-643a-4c78-980a-adf041aa58b2 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:20.740216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c822f-6f6f-44ef-8dab-8b34201d2eb6 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:20.782888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbda8eb-195b-4028-b5f7-60654d993d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:20.783559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbda8eb-195b-4028-b5f7-60654d993d31 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:20.783847 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbda8eb-195b-4028-b5f7-60654d993d31 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:20.784134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbda8eb-195b-4028-b5f7-60654d993d31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:20.790517 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e0866-643a-4c78-980a-adf041aa58b2 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:20.826743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe595fa-4bfb-4371-9d52-475c5ee70b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:20.827428 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe595fa-4bfb-4371-9d52-475c5ee70b53 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:20.827718 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe595fa-4bfb-4371-9d52-475c5ee70b53 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:20.828001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe595fa-4bfb-4371-9d52-475c5ee70b53 None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:20.828801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe595fa-4bfb-4371-9d52-475c5ee70b53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:20.829114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe595fa-4bfb-4371-9d52-475c5ee70b53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:20.830603 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe595fa-4bfb-4371-9d52-475c5ee70b53 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:20.840622 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:20.850465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 257/520] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:20.851980 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe595fa-4bfb-4371-9d52-475c5ee70b53 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:20.861785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:20.864901 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbda8eb-195b-4028-b5f7-60654d993d31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:20.866618 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbda8eb-195b-4028-b5f7-60654d993d31 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:20.969071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe595fa-4bfb-4371-9d52-475c5ee70b53 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:20.982515 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 264/521] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:40:20.982515 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbda8eb-195b-4028-b5f7-60654d993d31 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:21.007357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5de56-911b-4f9c-a6bb-473669e383fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:21.008543 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5de56-911b-4f9c-a6bb-473669e383fd None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:21.008983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5de56-911b-4f9c-a6bb-473669e383fd None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:21.009567 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5de56-911b-4f9c-a6bb-473669e383fd None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:21.010788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5de56-911b-4f9c-a6bb-473669e383fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:21.011569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5de56-911b-4f9c-a6bb-473669e383fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:21.013593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5de56-911b-4f9c-a6bb-473669e383fd None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:21.028802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 258/522] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:21.030131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5de56-911b-4f9c-a6bb-473669e383fd None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:21.067835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:21.086261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbda8eb-195b-4028-b5f7-60654d993d31 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:21.113154 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:21.123631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15151c6-10e6-42a1-bcff-07a71197a713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:21.124426 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15151c6-10e6-42a1-bcff-07a71197a713 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:21.124710 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15151c6-10e6-42a1-bcff-07a71197a713 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:21.124993 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15151c6-10e6-42a1-bcff-07a71197a713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:21.135220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15151c6-10e6-42a1-bcff-07a71197a713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:21.137291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15151c6-10e6-42a1-bcff-07a71197a713 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:21.149412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5de56-911b-4f9c-a6bb-473669e383fd None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:21.154655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-c15151c6-10e6-42a1-bcff-07a71197a713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:21.154655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:21.154655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:21.154655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:21.154655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:21.154655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:21.154655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:21.154655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:21.154655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:21.154655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:21.154655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:21.154655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:21.154655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:21.154655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:21.154655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:21.155680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:21.156692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:21.156692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:21.156692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:21.156692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:21.160240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 265/523] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:21.161134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15151c6-10e6-42a1-bcff-07a71197a713 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:21.189337 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea4fbd-4a28-4b03-9aaa-fc9dacc4a36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:21.189992 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea4fbd-4a28-4b03-9aaa-fc9dacc4a36c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:21.190277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea4fbd-4a28-4b03-9aaa-fc9dacc4a36c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:21.190583 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea4fbd-4a28-4b03-9aaa-fc9dacc4a36c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:21.191412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea4fbd-4a28-4b03-9aaa-fc9dacc4a36c None admin] RBAC: Adding query filter params (role.id=30112fca4d6549a790f2eadf20635343, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=105353b6b1a941ac81df7ad35567ba7c) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:21.191912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea4fbd-4a28-4b03-9aaa-fc9dacc4a36c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:21.193146 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea4fbd-4a28-4b03-9aaa-fc9dacc4a36c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:21.199016 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 259/524] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:40:21 2022] GET /identity/v3/role_assignments?user.id=105353b6b1a941ac81df7ad35567ba7c&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=30112fca4d6549a790f2eadf20635343 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:21.199725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea4fbd-4a28-4b03-9aaa-fc9dacc4a36c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:21.292756 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15151c6-10e6-42a1-bcff-07a71197a713 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:21.333902 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41830adc-f141-4702-8de0-d2a9b3f05054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:21.335226 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41830adc-f141-4702-8de0-d2a9b3f05054 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:21.335737 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41830adc-f141-4702-8de0-d2a9b3f05054 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:21.336209 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41830adc-f141-4702-8de0-d2a9b3f05054 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:21.338961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:21.349421 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41830adc-f141-4702-8de0-d2a9b3f05054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:21.350819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea4fbd-4a28-4b03-9aaa-fc9dacc4a36c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:21.351629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41830adc-f141-4702-8de0-d2a9b3f05054 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:21.373125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-41830adc-f141-4702-8de0-d2a9b3f05054 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:21.373125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:21.373125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:21.373125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:21.373125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:21.373125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:21.373125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:21.373125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:21.373125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:21.373125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:21.373125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:21.373125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:21.373125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:21.373125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:21.373125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:21.374053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:21.375346 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:21.375346 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:21.375346 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:21.375346 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:21.382512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 266/525] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:21.383709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41830adc-f141-4702-8de0-d2a9b3f05054 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:21.384330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:21.391723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df78c8e-bcc9-4feb-9791-e5f5662dd9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:21.392004 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df78c8e-bcc9-4feb-9791-e5f5662dd9f9 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:21.395279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df78c8e-bcc9-4feb-9791-e5f5662dd9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:21.395279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df78c8e-bcc9-4feb-9791-e5f5662dd9f9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:21.401921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df78c8e-bcc9-4feb-9791-e5f5662dd9f9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:21.403968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df78c8e-bcc9-4feb-9791-e5f5662dd9f9 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-1df78c8e-bcc9-4feb-9791-e5f5662dd9f9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:21.420897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:21.421849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:21.422764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:21.422764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:21.422764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:21.422764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:21.422764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:21.422764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:21.422764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:21.422764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:21.422764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 19:40:21.422764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:21.422764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 260/526] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:21.423321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df78c8e-bcc9-4feb-9791-e5f5662dd9f9 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:21.520911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41830adc-f141-4702-8de0-d2a9b3f05054 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:21.546298 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df78c8e-bcc9-4feb-9791-e5f5662dd9f9 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:21.567000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933f3da-9a7c-49ce-a198-4834d51d4698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:21.567675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933f3da-9a7c-49ce-a198-4834d51d4698 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:21.567961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933f3da-9a7c-49ce-a198-4834d51d4698 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:21.568238 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933f3da-9a7c-49ce-a198-4834d51d4698 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:21.569069 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933f3da-9a7c-49ce-a198-4834d51d4698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:21.569434 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933f3da-9a7c-49ce-a198-4834d51d4698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:21.570940 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933f3da-9a7c-49ce-a198-4834d51d4698 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:21.587884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 267/527] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:21.588807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933f3da-9a7c-49ce-a198-4834d51d4698 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:21.594287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d358da5-10b0-4de2-8374-4fe7fb8c39ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:21.595264 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d358da5-10b0-4de2-8374-4fe7fb8c39ec None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:21.595751 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d358da5-10b0-4de2-8374-4fe7fb8c39ec None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:21.596232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d358da5-10b0-4de2-8374-4fe7fb8c39ec None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:21.597231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d358da5-10b0-4de2-8374-4fe7fb8c39ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:21.597759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d358da5-10b0-4de2-8374-4fe7fb8c39ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:21.599936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d358da5-10b0-4de2-8374-4fe7fb8c39ec None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:21.617430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 261/528] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:21.619163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d358da5-10b0-4de2-8374-4fe7fb8c39ec None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:21.641175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:21.684832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:21.706048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933f3da-9a7c-49ce-a198-4834d51d4698 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:21.739069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d358da5-10b0-4de2-8374-4fe7fb8c39ec None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:21.748360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49fe4e-de40-40e6-bcf8-f2c1df79e3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:21.749215 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49fe4e-de40-40e6-bcf8-f2c1df79e3a2 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:21.749562 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49fe4e-de40-40e6-bcf8-f2c1df79e3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:21.749904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49fe4e-de40-40e6-bcf8-f2c1df79e3a2 None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:21.751305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49fe4e-de40-40e6-bcf8-f2c1df79e3a2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:21.751721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49fe4e-de40-40e6-bcf8-f2c1df79e3a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:21.753841 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b49fe4e-de40-40e6-bcf8-f2c1df79e3a2 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:21.777999 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f465fe-3389-49f4-8a37-90aad3e2065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:21.779095 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f465fe-3389-49f4-8a37-90aad3e2065e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:21.779562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f465fe-3389-49f4-8a37-90aad3e2065e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:21.780008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f465fe-3389-49f4-8a37-90aad3e2065e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:21.787293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f465fe-3389-49f4-8a37-90aad3e2065e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:21.788956 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f465fe-3389-49f4-8a37-90aad3e2065e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:21.806447 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 268/529] 10.222.0.15 () {56 vars in 1139 bytes} [Fri May 27 19:40:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:21.806447 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49fe4e-de40-40e6-bcf8-f2c1df79e3a2 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:21.809281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-a5f465fe-3389-49f4-8a37-90aad3e2065e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:21.809281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:21.809281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:21.809281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:21.809281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:21.809281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:21.809281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:21.809281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:21.809281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:21.809281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:21.809281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:21.809281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:21.809281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:21.809281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:21.809281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:21.810119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:21.811002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:21.811002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:21.811002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:21.811002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:21.811002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:21.811002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:21.811002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:21.811002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:21.813950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 262/530] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:21.815157 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f465fe-3389-49f4-8a37-90aad3e2065e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:21.924783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f465fe-3389-49f4-8a37-90aad3e2065e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:21.930245 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49fe4e-de40-40e6-bcf8-f2c1df79e3a2 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:21.933106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:21.943005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:21.974278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae44407-69a5-40a0-bef2-bffe4f51a96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:21.974278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae44407-69a5-40a0-bef2-bffe4f51a96c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:21.974278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae44407-69a5-40a0-bef2-bffe4f51a96c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:21.974666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738d75d-f8b9-497b-a032-a7c443afd802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:21.974770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae44407-69a5-40a0-bef2-bffe4f51a96c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:21.974841 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738d75d-f8b9-497b-a032-a7c443afd802 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:21.974841 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738d75d-f8b9-497b-a032-a7c443afd802 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:21.974841 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b738d75d-f8b9-497b-a032-a7c443afd802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:21.983280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae44407-69a5-40a0-bef2-bffe4f51a96c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:21.984927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae44407-69a5-40a0-bef2-bffe4f51a96c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:22.004818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-1ae44407-69a5-40a0-bef2-bffe4f51a96c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:22.004818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:22.004818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:22.004818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:22.004818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:22.004818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:22.004818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:22.004818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:22.004818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:22.004818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:22.004818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:22.004818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:22.004818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:22.004818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:22.004818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:22.005725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:22.006597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:22.006597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:22.006597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:22.006597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:22.006597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:22.006597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:22.006597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:22.006597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:22.012039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 269/531] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:22.012928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae44407-69a5-40a0-bef2-bffe4f51a96c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:22.069307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738d75d-f8b9-497b-a032-a7c443afd802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:22.071853 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b738d75d-f8b9-497b-a032-a7c443afd802 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:22.115829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae44407-69a5-40a0-bef2-bffe4f51a96c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:22.150780 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd71a4-bb52-4cac-998f-f84f6efddc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:22.151502 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd71a4-bb52-4cac-998f-f84f6efddc2f None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:22.151790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd71a4-bb52-4cac-998f-f84f6efddc2f None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:22.152207 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd71a4-bb52-4cac-998f-f84f6efddc2f None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:22.153145 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd71a4-bb52-4cac-998f-f84f6efddc2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:22.153472 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd71a4-bb52-4cac-998f-f84f6efddc2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:22.156200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd71a4-bb52-4cac-998f-f84f6efddc2f None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:22.181108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 270/532] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:22.181984 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd71a4-bb52-4cac-998f-f84f6efddc2f None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:22.204146 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 263/533] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:40:22.205098 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738d75d-f8b9-497b-a032-a7c443afd802 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:22.209615 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:22.217923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:22.290061 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd71a4-bb52-4cac-998f-f84f6efddc2f None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:22.315443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b738d75d-f8b9-497b-a032-a7c443afd802 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:22.326800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21bc8e-db7d-4082-ba3e-6aae3fc3cbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:22.327519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21bc8e-db7d-4082-ba3e-6aae3fc3cbf3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:22.327905 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21bc8e-db7d-4082-ba3e-6aae3fc3cbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:22.328281 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21bc8e-db7d-4082-ba3e-6aae3fc3cbf3 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:22.329270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21bc8e-db7d-4082-ba3e-6aae3fc3cbf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:22.329680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21bc8e-db7d-4082-ba3e-6aae3fc3cbf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:22.331268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21bc8e-db7d-4082-ba3e-6aae3fc3cbf3 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:22.350405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 271/534] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:22.350405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21bc8e-db7d-4082-ba3e-6aae3fc3cbf3 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:22.362067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4e759-cb91-42fe-a16d-0fcfe1393274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:22.362764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4e759-cb91-42fe-a16d-0fcfe1393274 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:22.363050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4e759-cb91-42fe-a16d-0fcfe1393274 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:22.363319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4e759-cb91-42fe-a16d-0fcfe1393274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:22.364644 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4e759-cb91-42fe-a16d-0fcfe1393274 None admin] RBAC: Adding query filter params (role.id=30112fca4d6549a790f2eadf20635343, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=8a892d3f80464f9e9ced137c5de8bd60) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:22.364960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4e759-cb91-42fe-a16d-0fcfe1393274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:22.366885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4e759-cb91-42fe-a16d-0fcfe1393274 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:22.374939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 264/535] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:40:22 2022] GET /identity/v3/role_assignments?user.id=8a892d3f80464f9e9ced137c5de8bd60&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=30112fca4d6549a790f2eadf20635343 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:22.375920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4e759-cb91-42fe-a16d-0fcfe1393274 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:22.494753 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:22.520805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:22.530381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21bc8e-db7d-4082-ba3e-6aae3fc3cbf3 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:22.581761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4e759-cb91-42fe-a16d-0fcfe1393274 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:22.606601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23118f-8328-4f0b-a34c-fce369d5b6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:22.607410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23118f-8328-4f0b-a34c-fce369d5b6da None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:22.607693 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23118f-8328-4f0b-a34c-fce369d5b6da None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:22.607971 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23118f-8328-4f0b-a34c-fce369d5b6da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:22.619528 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23118f-8328-4f0b-a34c-fce369d5b6da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:22.621307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23118f-8328-4f0b-a34c-fce369d5b6da None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:22.640142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-fe23118f-8328-4f0b-a34c-fce369d5b6da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:22.640142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:22.640142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:22.640142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:22.640142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:22.640142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:22.640142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:22.640142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:22.640142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:22.640142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:22.640142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:22.640142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:22.640142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:22.640142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:22.640142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:22.641003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:22.642588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:22.642588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:22.642588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:22.642588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:22.642588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 272/536] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:22.648428 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23118f-8328-4f0b-a34c-fce369d5b6da None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:22.665357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048ad51-47ea-44fc-8e6e-c00a68e2cecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:22.666075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048ad51-47ea-44fc-8e6e-c00a68e2cecb None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:22.666378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048ad51-47ea-44fc-8e6e-c00a68e2cecb None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:22.666662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048ad51-47ea-44fc-8e6e-c00a68e2cecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:22.667647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048ad51-47ea-44fc-8e6e-c00a68e2cecb None admin] RBAC: Adding query filter params (role.id=30112fca4d6549a790f2eadf20635343, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=cc2b57ae83164912a4e23dda9dc239f4) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:22.667965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048ad51-47ea-44fc-8e6e-c00a68e2cecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:22.669402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048ad51-47ea-44fc-8e6e-c00a68e2cecb None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:22.682062 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 265/537] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:40:22 2022] GET /identity/v3/role_assignments?user.id=cc2b57ae83164912a4e23dda9dc239f4&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=30112fca4d6549a790f2eadf20635343 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:22.773391 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23118f-8328-4f0b-a34c-fce369d5b6da None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:22.814979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389048ec-c6c1-4236-bf54-924f32019698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:22.815651 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389048ec-c6c1-4236-bf54-924f32019698 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:22.815941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389048ec-c6c1-4236-bf54-924f32019698 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:22.816224 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389048ec-c6c1-4236-bf54-924f32019698 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:22.816956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389048ec-c6c1-4236-bf54-924f32019698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:22.817265 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389048ec-c6c1-4236-bf54-924f32019698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:22.818854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389048ec-c6c1-4236-bf54-924f32019698 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:22.821431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:22.832994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 273/538] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:22.840098 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048ad51-47ea-44fc-8e6e-c00a68e2cecb None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:22.981591 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048ad51-47ea-44fc-8e6e-c00a68e2cecb None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:22.991904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ff9c5-a9e9-4e59-8861-91f296ede996 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:22.992485 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ff9c5-a9e9-4e59-8861-91f296ede996 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:22.992975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ff9c5-a9e9-4e59-8861-91f296ede996 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:22.994832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 274/539] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:22.999703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffc3a6-b167-4179-ae23-3a2dd10e7a53 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:23.000234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffc3a6-b167-4179-ae23-3a2dd10e7a53 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:23.000714 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dffc3a6-b167-4179-ae23-3a2dd10e7a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:23.018996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a34b4-dac9-4bf9-970a-3c29a8ac8824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:23.019806 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a34b4-dac9-4bf9-970a-3c29a8ac8824 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:23.020096 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a34b4-dac9-4bf9-970a-3c29a8ac8824 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:23.020381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a34b4-dac9-4bf9-970a-3c29a8ac8824 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:23.029883 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a34b4-dac9-4bf9-970a-3c29a8ac8824 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:23.029883 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a34b4-dac9-4bf9-970a-3c29a8ac8824 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:23.035929 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:23.036749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-5dffc3a6-b167-4179-ae23-3a2dd10e7a53 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:23.038184 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5dffc3a6-b167-4179-ae23-3a2dd10e7a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:23.059431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-1c5a34b4-dac9-4bf9-970a-3c29a8ac8824 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:23.059431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:23.059431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:23.059431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:23.059431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:23.059431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:23.059431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:23.059431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:23.059431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:23.059431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:23.059431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:23.059431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:23.059431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:23.059431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:23.059431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:23.070413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:23.071271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:23.071271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:23.071271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:23.071271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:23.071271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:23.071271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:23.071271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:23.071271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:23.071271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 266/540] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:23.072613 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a34b4-dac9-4bf9-970a-3c29a8ac8824 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:23.173182 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 275/541] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:23.195460 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffc3a6-b167-4179-ae23-3a2dd10e7a53 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:23.237627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a34b4-dac9-4bf9-970a-3c29a8ac8824 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:23.286650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fd3d5-c593-4de6-bb53-1452ded3644f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:23.287679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fd3d5-c593-4de6-bb53-1452ded3644f None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:23.288190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fd3d5-c593-4de6-bb53-1452ded3644f None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:23.288670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fd3d5-c593-4de6-bb53-1452ded3644f None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:23.289681 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fd3d5-c593-4de6-bb53-1452ded3644f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:23.290191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fd3d5-c593-4de6-bb53-1452ded3644f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:23.291869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64fd3d5-c593-4de6-bb53-1452ded3644f None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:23.307014 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 267/542] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:23.313597 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fd3d5-c593-4de6-bb53-1452ded3644f None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:23.380867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dffc3a6-b167-4179-ae23-3a2dd10e7a53 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:23.408069 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:23.418145 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a5fac-3b52-4d4f-a973-953e5558df3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:23.419592 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a5fac-3b52-4d4f-a973-953e5558df3b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:23.420082 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a5fac-3b52-4d4f-a973-953e5558df3b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:23.420577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a5fac-3b52-4d4f-a973-953e5558df3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:23.433866 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a5fac-3b52-4d4f-a973-953e5558df3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-766a5fac-3b52-4d4f-a973-953e5558df3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:23.442976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:23.444000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:23.444789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:23.444789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:23.444789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:23.444789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:23.444789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:23.444789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:23.444789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:23.444789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:23.444789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:23.444789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:23.444789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:23.444789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:23.447950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:23.448498 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 276/543] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:23.454787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a5fac-3b52-4d4f-a973-953e5558df3b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:23.568817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a5fac-3b52-4d4f-a973-953e5558df3b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:23.592462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fd3d5-c593-4de6-bb53-1452ded3644f None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:23.608853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321bba8-f03e-42f3-bb54-7d380e0e996f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:23.609537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321bba8-f03e-42f3-bb54-7d380e0e996f None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:23.609827 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321bba8-f03e-42f3-bb54-7d380e0e996f None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:23.610110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321bba8-f03e-42f3-bb54-7d380e0e996f None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:23.610898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321bba8-f03e-42f3-bb54-7d380e0e996f None admin] RBAC: Adding query filter params (name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:23.611211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321bba8-f03e-42f3-bb54-7d380e0e996f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:23.613177 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321bba8-f03e-42f3-bb54-7d380e0e996f None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:23.623436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 277/544] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:23.630094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321bba8-f03e-42f3-bb54-7d380e0e996f None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:23.684472 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec3360-6179-4881-b8fb-5967c857ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:23.685070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec3360-6179-4881-b8fb-5967c857ede4 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:23.685357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec3360-6179-4881-b8fb-5967c857ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:23.685635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec3360-6179-4881-b8fb-5967c857ede4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:23.686500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec3360-6179-4881-b8fb-5967c857ede4 None admin] RBAC: Adding query filter params (role.id=30112fca4d6549a790f2eadf20635343, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=af7e51b89f4c4dcc9963061e6e509eb7) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:23.686817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec3360-6179-4881-b8fb-5967c857ede4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:23.688261 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec3360-6179-4881-b8fb-5967c857ede4 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:23.690571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:23.709651 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 268/545] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:40:23 2022] GET /identity/v3/role_assignments?user.id=af7e51b89f4c4dcc9963061e6e509eb7&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=30112fca4d6549a790f2eadf20635343 => generated 259 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:23.753130 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321bba8-f03e-42f3-bb54-7d380e0e996f None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:23.791272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53af7-20f9-4314-aa56-258f88766484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:23.792093 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53af7-20f9-4314-aa56-258f88766484 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:23.792382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53af7-20f9-4314-aa56-258f88766484 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:23.792754 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53af7-20f9-4314-aa56-258f88766484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:23.805339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf53af7-20f9-4314-aa56-258f88766484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:23.806859 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf53af7-20f9-4314-aa56-258f88766484 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:23.826241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-1cf53af7-20f9-4314-aa56-258f88766484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:23.826241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:23.826241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:23.826241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:23.826241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:23.826241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:23.826241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:23.826241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:23.826241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:23.826241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:23.826241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:23.826241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:23.826241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:23.826241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:23.826241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:23.827163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:23.829486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:23.829486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:23.829486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:23.829486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:23.829486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 278/546] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:23.833109 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec3360-6179-4881-b8fb-5967c857ede4 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:23.982299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d507d6-ee3a-4521-b975-632c11bf0b34 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:23.983133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d507d6-ee3a-4521-b975-632c11bf0b34 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:23.984750 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d507d6-ee3a-4521-b975-632c11bf0b34 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:23.987385 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 279/547] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:40:23.994363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5279f9-35cb-488f-b84e-481783b26d59 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:23.994363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5279f9-35cb-488f-b84e-481783b26d59 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:23.994363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5279f9-35cb-488f-b84e-481783b26d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:24.003157 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec3360-6179-4881-b8fb-5967c857ede4 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:24.011968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-ae5279f9-35cb-488f-b84e-481783b26d59 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:24.014369 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ae5279f9-35cb-488f-b84e-481783b26d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:24.044185 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:24.070252 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6130357-8dcd-44b2-9c2a-2cf6c579b884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:24.070958 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6130357-8dcd-44b2-9c2a-2cf6c579b884 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:24.071249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6130357-8dcd-44b2-9c2a-2cf6c579b884 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:24.071532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6130357-8dcd-44b2-9c2a-2cf6c579b884 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:24.072270 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6130357-8dcd-44b2-9c2a-2cf6c579b884 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:24.072583 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6130357-8dcd-44b2-9c2a-2cf6c579b884 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:24.075988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6130357-8dcd-44b2-9c2a-2cf6c579b884 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:24.098820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 269/548] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:24.104330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6130357-8dcd-44b2-9c2a-2cf6c579b884 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:24.123048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 280/549] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:40:24.150156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5279f9-35cb-488f-b84e-481783b26d59 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:24.203957 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:24.283841 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5279f9-35cb-488f-b84e-481783b26d59 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:24.320344 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6130357-8dcd-44b2-9c2a-2cf6c579b884 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:24.324693 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924eb767-3ffa-404d-8d46-57a72e95508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:24.325505 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eb767-3ffa-404d-8d46-57a72e95508a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:24.325793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eb767-3ffa-404d-8d46-57a72e95508a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:24.326072 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924eb767-3ffa-404d-8d46-57a72e95508a None admin] PATH_INFO: `/v3/roles/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:24.340499 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924eb767-3ffa-404d-8d46-57a72e95508a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-924eb767-3ffa-404d-8d46-57a72e95508a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:24.348846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:24.349734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:24.350570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:24.350570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:24.350570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:24.350570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:24.350570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:24.350570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:24.350570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:24.350570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:24.350570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:24.350570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:24.350570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:24.350570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:24.350570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 281/550] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:24.357826 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924eb767-3ffa-404d-8d46-57a72e95508a None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:24.395326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383ebb6-0b08-4dd5-a749-e5ed88503b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:24.396139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383ebb6-0b08-4dd5-a749-e5ed88503b4a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:24.396426 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383ebb6-0b08-4dd5-a749-e5ed88503b4a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:24.396708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383ebb6-0b08-4dd5-a749-e5ed88503b4a None admin] PATH_INFO: `/v3/users/swift` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:24.411430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383ebb6-0b08-4dd5-a749-e5ed88503b4a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:24.412900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383ebb6-0b08-4dd5-a749-e5ed88503b4a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-1383ebb6-0b08-4dd5-a749-e5ed88503b4a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:24.459376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:24.461515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:24.463704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:24.463704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:24.463704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:24.463704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:24.463704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:24.463704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:24.463704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:24.463704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:24.463704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 19:40:24.463704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:24.463704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 270/551] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:40:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:24.470505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383ebb6-0b08-4dd5-a749-e5ed88503b4a None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:24.552708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:24.553358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:24.596553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924eb767-3ffa-404d-8d46-57a72e95508a None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:24.633585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383ebb6-0b08-4dd5-a749-e5ed88503b4a None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:24.671084 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190df9c-758c-4c23-9201-5f80bc8915bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:24.671775 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190df9c-758c-4c23-9201-5f80bc8915bd None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:24.672133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190df9c-758c-4c23-9201-5f80bc8915bd None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:24.672420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190df9c-758c-4c23-9201-5f80bc8915bd None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:24.673248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190df9c-758c-4c23-9201-5f80bc8915bd None admin] RBAC: Adding query filter params (name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:24.673567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190df9c-758c-4c23-9201-5f80bc8915bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:24.675326 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190df9c-758c-4c23-9201-5f80bc8915bd None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:24.695495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 282/552] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:24.701725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190df9c-758c-4c23-9201-5f80bc8915bd None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:24.712252 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaef40-79c6-4ccb-b1ce-b6ad98fd11d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:24.713295 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaef40-79c6-4ccb-b1ce-b6ad98fd11d6 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:24.713589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaef40-79c6-4ccb-b1ce-b6ad98fd11d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:24.713948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abaef40-79c6-4ccb-b1ce-b6ad98fd11d6 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:24.719366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaef40-79c6-4ccb-b1ce-b6ad98fd11d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:24.719735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaef40-79c6-4ccb-b1ce-b6ad98fd11d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:24.721413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abaef40-79c6-4ccb-b1ce-b6ad98fd11d6 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:24.748392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 271/553] 10.222.0.15 () {56 vars in 1135 bytes} [Fri May 27 19:40:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:24.753905 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaef40-79c6-4ccb-b1ce-b6ad98fd11d6 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:24.889451 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abaef40-79c6-4ccb-b1ce-b6ad98fd11d6 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:24.919137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:24.950375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee9cc4-5c16-46bc-bbc1-a397f984788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:24.950375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee9cc4-5c16-46bc-bbc1-a397f984788a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:24.950375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee9cc4-5c16-46bc-bbc1-a397f984788a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:24.950375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee9cc4-5c16-46bc-bbc1-a397f984788a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:25.016197 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190df9c-758c-4c23-9201-5f80bc8915bd None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:25.104306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee9cc4-5c16-46bc-bbc1-a397f984788a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:25.107814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087a69a-28ee-4985-bd15-96381804cb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:25.108709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087a69a-28ee-4985-bd15-96381804cb6f None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:25.109087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087a69a-28ee-4985-bd15-96381804cb6f None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:25.109371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087a69a-28ee-4985-bd15-96381804cb6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:25.111796 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee9cc4-5c16-46bc-bbc1-a397f984788a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:25.132109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087a69a-28ee-4985-bd15-96381804cb6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:25.133651 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087a69a-28ee-4985-bd15-96381804cb6f None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:25.165313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-6087a69a-28ee-4985-bd15-96381804cb6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:25.165313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:25.165313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:25.165313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:25.165313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:25.165313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:25.165313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:25.165313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:25.165313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:25.165313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:25.165313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:25.165313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:25.165313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:25.165313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:25.165313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:25.166214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:25.167856 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:25.167856 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:25.167856 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:25.167856 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:25.176370 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 283/554] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 475 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:25.177840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61ee6d-3df7-439d-af90-62e10f8c868f None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:25.178136 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61ee6d-3df7-439d-af90-62e10f8c868f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:25.178445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61ee6d-3df7-439d-af90-62e10f8c868f None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:25.189546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 284/555] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:25 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:25.189546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61ee6d-3df7-439d-af90-62e10f8c868f None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:25.201590 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:25.335925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:25.349424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 272/556] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 19:40:25.354673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea2b3f-49f3-45b1-b7b1-b8492edc78b8 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:25.354979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea2b3f-49f3-45b1-b7b1-b8492edc78b8 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:25.355267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea2b3f-49f3-45b1-b7b1-b8492edc78b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:25.367282 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61ee6d-3df7-439d-af90-62e10f8c868f None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:25.391798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-fcea2b3f-49f3-45b1-b7b1-b8492edc78b8 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:25.393008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-fcea2b3f-49f3-45b1-b7b1-b8492edc78b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:25.415102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a0c25-72dd-4fe3-a818-10bef4ec116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:25.417202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a0c25-72dd-4fe3-a818-10bef4ec116a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:25.417202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a0c25-72dd-4fe3-a818-10bef4ec116a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:25.417202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a0c25-72dd-4fe3-a818-10bef4ec116a None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:25.417202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a0c25-72dd-4fe3-a818-10bef4ec116a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:25.418244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a0c25-72dd-4fe3-a818-10bef4ec116a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:25.419918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a0c25-72dd-4fe3-a818-10bef4ec116a None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:25.432348 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 285/557] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:25.437571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a0c25-72dd-4fe3-a818-10bef4ec116a None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:25.478246 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 273/558] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:25.484389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9e9a6-ea07-43c6-ac4b-26acf0903fcf None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:25.485348 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9e9a6-ea07-43c6-ac4b-26acf0903fcf None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:25.485856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9e9a6-ea07-43c6-ac4b-26acf0903fcf None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:25.488360 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 274/559] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:25.489258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9e9a6-ea07-43c6-ac4b-26acf0903fcf None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:25.513591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:25.552345 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a0c25-72dd-4fe3-a818-10bef4ec116a None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:25.589764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ec621-8de4-4dd8-9267-8216c2d39b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:25.590588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ec621-8de4-4dd8-9267-8216c2d39b0a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:25.590874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ec621-8de4-4dd8-9267-8216c2d39b0a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:25.591362 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ec621-8de4-4dd8-9267-8216c2d39b0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:25.601026 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ec621-8de4-4dd8-9267-8216c2d39b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:25.602559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ec621-8de4-4dd8-9267-8216c2d39b0a None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:25.608229 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9e9a6-ea07-43c6-ac4b-26acf0903fcf None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:25.620878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-1f6ec621-8de4-4dd8-9267-8216c2d39b0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:25.620878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:25.620878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:25.620878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:25.620878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:25.620878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:25.620878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:25.620878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:25.620878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:25.620878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:25.620878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:25.620878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:25.620878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:25.620878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:25.620878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:25.621977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:25.623065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:25.623065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:25.623065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:25.623065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:25.623065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 286/560] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:25.623679 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715285-6581-4578-9300-53de8798761d None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:25.623962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715285-6581-4578-9300-53de8798761d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:25.624256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5715285-6581-4578-9300-53de8798761d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:25.644374 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a5715285-6581-4578-9300-53de8798761d None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:25.645499 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:25.645612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a5715285-6581-4578-9300-53de8798761d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:25.651752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5133ff7-6081-4e4d-a290-1c1408aa1baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:25.652642 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5133ff7-6081-4e4d-a290-1c1408aa1baf None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:25.653192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5133ff7-6081-4e4d-a290-1c1408aa1baf None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:25.653318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5133ff7-6081-4e4d-a290-1c1408aa1baf None admin] PATH_INFO: `/v3/users/nova` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:25.661191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5133ff7-6081-4e4d-a290-1c1408aa1baf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:25.662651 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5133ff7-6081-4e4d-a290-1c1408aa1baf None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-f5133ff7-6081-4e4d-a290-1c1408aa1baf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:25.678097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:25.679161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:25.680089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:25.680089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:25.680089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:25.680089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:25.680089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:25.680089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:25.680089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:25.680089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:25.680089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 19:40:25.680089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:25.680089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 275/561] 10.222.0.15 () {56 vars in 1093 bytes} [Fri May 27 19:40:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:25.680089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5133ff7-6081-4e4d-a290-1c1408aa1baf None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:25.726429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 287/562] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:25.726429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5715285-6581-4578-9300-53de8798761d None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:25.784351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:25.793380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5133ff7-6081-4e4d-a290-1c1408aa1baf None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:25.829865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e40bc-f5c5-42c2-bb37-a27aa946d014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:25.830712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e40bc-f5c5-42c2-bb37-a27aa946d014 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:25.831003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e40bc-f5c5-42c2-bb37-a27aa946d014 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:25.831284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e40bc-f5c5-42c2-bb37-a27aa946d014 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:25.842568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e40bc-f5c5-42c2-bb37-a27aa946d014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:25.842715 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5715285-6581-4578-9300-53de8798761d None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-fa6e40bc-f5c5-42c2-bb37-a27aa946d014 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:25.850228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:25.851389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:25.852216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:25.852216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:25.852216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:25.852216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:25.852216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:25.852216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:25.852216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:25.852216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:25.852216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:25.852216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:25.852216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:25.852216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:25.852216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 276/563] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:25.852216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e40bc-f5c5-42c2-bb37-a27aa946d014 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:25.884368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59aab9f-b063-4858-8aea-9e42f69bc50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:25.885292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59aab9f-b063-4858-8aea-9e42f69bc50e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:25.885728 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59aab9f-b063-4858-8aea-9e42f69bc50e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:25.886751 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59aab9f-b063-4858-8aea-9e42f69bc50e None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:25.887486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59aab9f-b063-4858-8aea-9e42f69bc50e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:25.887900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59aab9f-b063-4858-8aea-9e42f69bc50e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:25.889284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59aab9f-b063-4858-8aea-9e42f69bc50e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:25.903812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 288/564] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:25.903812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59aab9f-b063-4858-8aea-9e42f69bc50e None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:25.911639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:25.965674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e40bc-f5c5-42c2-bb37-a27aa946d014 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:26.003599 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaffcc6-4e59-4757-a6e0-0ad0f6d26c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:26.004278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaffcc6-4e59-4757-a6e0-0ad0f6d26c5a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:26.004564 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaffcc6-4e59-4757-a6e0-0ad0f6d26c5a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:26.004875 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaffcc6-4e59-4757-a6e0-0ad0f6d26c5a None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:26.005692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaffcc6-4e59-4757-a6e0-0ad0f6d26c5a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:26.006000 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaffcc6-4e59-4757-a6e0-0ad0f6d26c5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:26.007471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaffcc6-4e59-4757-a6e0-0ad0f6d26c5a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:26.020190 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59aab9f-b063-4858-8aea-9e42f69bc50e None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:26.027638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 277/565] 10.222.0.15 () {56 vars in 1133 bytes} [Fri May 27 19:40:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:26.028280 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaffcc6-4e59-4757-a6e0-0ad0f6d26c5a None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:26.029833 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:26.063817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea2f19-77f8-49f7-a3fd-431d394fb209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:26.064712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea2f19-77f8-49f7-a3fd-431d394fb209 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:26.065007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea2f19-77f8-49f7-a3fd-431d394fb209 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:26.065292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea2f19-77f8-49f7-a3fd-431d394fb209 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:26.078013 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea2f19-77f8-49f7-a3fd-431d394fb209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-09ea2f19-77f8-49f7-a3fd-431d394fb209 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:26.086599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:26.087569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:26.088392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:26.088392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:26.088392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:26.088392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:26.088392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:26.088392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:26.088392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:26.088392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:26.088392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:26.088392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:26.088392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:26.088392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:26.088392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 289/566] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:26.089647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea2f19-77f8-49f7-a3fd-431d394fb209 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:26.143141 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaffcc6-4e59-4757-a6e0-0ad0f6d26c5a None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:26.153764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:26.179467 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d898be3-5b64-4471-8c63-b166397295d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:26.180159 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d898be3-5b64-4471-8c63-b166397295d9 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:26.180510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d898be3-5b64-4471-8c63-b166397295d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:26.180801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d898be3-5b64-4471-8c63-b166397295d9 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:26.181607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d898be3-5b64-4471-8c63-b166397295d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:26.181927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d898be3-5b64-4471-8c63-b166397295d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:26.183956 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d898be3-5b64-4471-8c63-b166397295d9 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:26.195676 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 278/567] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:26.196504 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d898be3-5b64-4471-8c63-b166397295d9 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:26.206461 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea2f19-77f8-49f7-a3fd-431d394fb209 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:26.245952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19531778-caff-49e3-9663-2567bfa2a024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:26.246711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19531778-caff-49e3-9663-2567bfa2a024 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:26.247054 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19531778-caff-49e3-9663-2567bfa2a024 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:26.247347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19531778-caff-49e3-9663-2567bfa2a024 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:26.254702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19531778-caff-49e3-9663-2567bfa2a024 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:26.256173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19531778-caff-49e3-9663-2567bfa2a024 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:26.271323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-19531778-caff-49e3-9663-2567bfa2a024 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:26.271323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:26.271323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:26.271323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:26.271323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:26.271323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:26.271323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:26.271323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:26.271323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:26.271323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:26.271323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:26.271323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:26.271323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:26.271323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:26.271323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:26.272376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:26.273396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:26.273396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:26.273396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:26.273396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:26.273396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:26.273396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:26.273396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:26.273396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:26.273396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 290/568] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:26.273396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19531778-caff-49e3-9663-2567bfa2a024 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:26.305739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:26.311573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d898be3-5b64-4471-8c63-b166397295d9 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:26.348938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f68c9-efe0-447f-8ab1-b486a175e027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:26.349745 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f68c9-efe0-447f-8ab1-b486a175e027 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:26.350039 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f68c9-efe0-447f-8ab1-b486a175e027 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:26.350325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f68c9-efe0-447f-8ab1-b486a175e027 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:26.363671 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f68c9-efe0-447f-8ab1-b486a175e027 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:26.365135 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f68c9-efe0-447f-8ab1-b486a175e027 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:26.382776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-364f68c9-efe0-447f-8ab1-b486a175e027 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:26.382776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:26.382776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:26.382776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:26.382776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:26.382776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:26.382776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:26.382776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:26.382776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:26.382776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:26.382776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:26.382776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:26.382776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:26.382776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:26.382776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:26.383697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:26.384562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:26.384562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:26.384562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:26.384562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:26.389093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 279/569] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:26.389906 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19531778-caff-49e3-9663-2567bfa2a024 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:26.390334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f68c9-efe0-447f-8ab1-b486a175e027 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:26.415233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:26.428112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3f730-4944-4b4a-8f33-e2ea69f500c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:26.428789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3f730-4944-4b4a-8f33-e2ea69f500c8 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:26.429075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3f730-4944-4b4a-8f33-e2ea69f500c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:26.429557 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3f730-4944-4b4a-8f33-e2ea69f500c8 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:26.430374 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3f730-4944-4b4a-8f33-e2ea69f500c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:26.430672 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3f730-4944-4b4a-8f33-e2ea69f500c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:26.432219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3f730-4944-4b4a-8f33-e2ea69f500c8 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:26.441761 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 291/570] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:26.442451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3f730-4944-4b4a-8f33-e2ea69f500c8 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:26.504425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f68c9-efe0-447f-8ab1-b486a175e027 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:26.541679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ae4eb-fe8b-4752-8d7d-8ad693fcaf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:26.542554 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ae4eb-fe8b-4752-8d7d-8ad693fcaf57 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:26.542845 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ae4eb-fe8b-4752-8d7d-8ad693fcaf57 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:26.543126 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ae4eb-fe8b-4752-8d7d-8ad693fcaf57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:26.545912 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:26.556050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ae4eb-fe8b-4752-8d7d-8ad693fcaf57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:26.557669 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ae4eb-fe8b-4752-8d7d-8ad693fcaf57 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:26.559698 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3f730-4944-4b4a-8f33-e2ea69f500c8 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:26.579120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-e56ae4eb-fe8b-4752-8d7d-8ad693fcaf57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:26.579120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:26.579120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:26.579120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:26.579120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:26.579120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:26.579120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:26.579120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:26.579120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:26.579120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:26.579120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:26.579120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:26.579120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:26.579120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:26.579120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:26.580331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:26.581400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:26.581400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:26.581400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:26.581400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:26.582050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 280/571] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:26.582727 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ae4eb-fe8b-4752-8d7d-8ad693fcaf57 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:26.604831 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdf85a-7842-49d1-8e2d-06b8300b7654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:26.605807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdf85a-7842-49d1-8e2d-06b8300b7654 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:26.606097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdf85a-7842-49d1-8e2d-06b8300b7654 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:26.606395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdf85a-7842-49d1-8e2d-06b8300b7654 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:26.607199 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdf85a-7842-49d1-8e2d-06b8300b7654 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:26.607513 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdf85a-7842-49d1-8e2d-06b8300b7654 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:26.608954 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdf85a-7842-49d1-8e2d-06b8300b7654 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:26.621219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 292/572] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:26.621838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdf85a-7842-49d1-8e2d-06b8300b7654 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:26.675616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:26.702112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ae4eb-fe8b-4752-8d7d-8ad693fcaf57 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:26.730877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdf85a-7842-49d1-8e2d-06b8300b7654 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:26.743474 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1403466-b626-4d17-a8fa-59b9057cbf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:26.744152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1403466-b626-4d17-a8fa-59b9057cbf10 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:26.744438 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1403466-b626-4d17-a8fa-59b9057cbf10 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:26.744717 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1403466-b626-4d17-a8fa-59b9057cbf10 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:26.745568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1403466-b626-4d17-a8fa-59b9057cbf10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:26.745887 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1403466-b626-4d17-a8fa-59b9057cbf10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:26.747316 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1403466-b626-4d17-a8fa-59b9057cbf10 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:26.764307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 281/573] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:26.764307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1403466-b626-4d17-a8fa-59b9057cbf10 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:26.775237 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ffca1-a371-45fb-a2ef-64005963ea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:26.776311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ffca1-a371-45fb-a2ef-64005963ea26 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:26.777347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ffca1-a371-45fb-a2ef-64005963ea26 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:26.777802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ffca1-a371-45fb-a2ef-64005963ea26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:26.789187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ffca1-a371-45fb-a2ef-64005963ea26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:26.790938 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ffca1-a371-45fb-a2ef-64005963ea26 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:26.801252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:26.813341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-0f7ffca1-a371-45fb-a2ef-64005963ea26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:26.813341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:26.813341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:26.813341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:26.813341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:26.813341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:26.813341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:26.813341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:26.813341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:26.813341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:26.813341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:26.813341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:26.813341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:26.813341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:26.813341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:26.820908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:26.821835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:26.821835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:26.821835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:26.821835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:26.821835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 293/574] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:26.821835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ffca1-a371-45fb-a2ef-64005963ea26 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:26.878355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1403466-b626-4d17-a8fa-59b9057cbf10 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:26.912781 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a010843-dfe9-4b40-974b-8a8faa470257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:26.913471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a010843-dfe9-4b40-974b-8a8faa470257 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:26.913765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a010843-dfe9-4b40-974b-8a8faa470257 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:26.914054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a010843-dfe9-4b40-974b-8a8faa470257 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:26.914840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a010843-dfe9-4b40-974b-8a8faa470257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:26.915157 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a010843-dfe9-4b40-974b-8a8faa470257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:26.916547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a010843-dfe9-4b40-974b-8a8faa470257 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:26.918780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:26.931942 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 282/575] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:26.932670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ffca1-a371-45fb-a2ef-64005963ea26 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:26.933161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a010843-dfe9-4b40-974b-8a8faa470257 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:26.969881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b4af5-73a5-400a-a303-cbc7d0d6c6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:26.970632 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b4af5-73a5-400a-a303-cbc7d0d6c6f3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:26.970924 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b4af5-73a5-400a-a303-cbc7d0d6c6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:26.971207 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b4af5-73a5-400a-a303-cbc7d0d6c6f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:26.972051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b4af5-73a5-400a-a303-cbc7d0d6c6f3 None admin] RBAC: Adding query filter params (role.id=30112fca4d6549a790f2eadf20635343, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=799058a415e44194a50697841b410062) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:26.972371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b4af5-73a5-400a-a303-cbc7d0d6c6f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:26.973831 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b4af5-73a5-400a-a303-cbc7d0d6c6f3 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:26.979752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 294/576] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:40:26 2022] GET /identity/v3/role_assignments?user.id=799058a415e44194a50697841b410062&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=30112fca4d6549a790f2eadf20635343 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:26.981101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b4af5-73a5-400a-a303-cbc7d0d6c6f3 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:27.064198 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:27.072356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a010843-dfe9-4b40-974b-8a8faa470257 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:27.113644 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fcfe5-ed67-4168-b127-5f40846826b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:27.114529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fcfe5-ed67-4168-b127-5f40846826b9 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:27.114927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fcfe5-ed67-4168-b127-5f40846826b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:27.115104 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fcfe5-ed67-4168-b127-5f40846826b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:27.119808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b4af5-73a5-400a-a303-cbc7d0d6c6f3 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:27.123565 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fcfe5-ed67-4168-b127-5f40846826b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:27.125059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fcfe5-ed67-4168-b127-5f40846826b9 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:27.140783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-f89fcfe5-ed67-4168-b127-5f40846826b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:27.140783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:27.140783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:27.140783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:27.140783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:27.140783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:27.140783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:27.140783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:27.140783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:27.140783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:27.140783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:27.140783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:27.140783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:27.140783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:27.140783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:27.141788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:27.143124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:27.143124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:27.143124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:27.143124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:27.143124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:27.143124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:27.143124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:27.143124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:27.143124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 283/577] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:27.143621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ecbd3-018d-4e95-9b47-ead36e86d165 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:27.143911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ecbd3-018d-4e95-9b47-ead36e86d165 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:27.144071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ecbd3-018d-4e95-9b47-ead36e86d165 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:27.145636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 284/578] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:27.150572 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ecbd3-018d-4e95-9b47-ead36e86d165 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:27.172570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e3c2b-e41d-4b7d-b2f6-f1801bd6861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:27.173252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e3c2b-e41d-4b7d-b2f6-f1801bd6861b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:27.173543 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e3c2b-e41d-4b7d-b2f6-f1801bd6861b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:27.173813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e3c2b-e41d-4b7d-b2f6-f1801bd6861b None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:27.174594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e3c2b-e41d-4b7d-b2f6-f1801bd6861b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:27.175170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e3c2b-e41d-4b7d-b2f6-f1801bd6861b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:27.176575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e3c2b-e41d-4b7d-b2f6-f1801bd6861b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:27.191080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 295/579] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:27.191921 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e3c2b-e41d-4b7d-b2f6-f1801bd6861b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:27.235456 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:27.291933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ecbd3-018d-4e95-9b47-ead36e86d165 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:27.314941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e3c2b-e41d-4b7d-b2f6-f1801bd6861b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:27.336532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccec09a-9144-4481-87d8-3a02b9519077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:27.337751 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccec09a-9144-4481-87d8-3a02b9519077 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:27.338092 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccec09a-9144-4481-87d8-3a02b9519077 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:27.338407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccec09a-9144-4481-87d8-3a02b9519077 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:27.340877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:27.349214 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccec09a-9144-4481-87d8-3a02b9519077 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:27.351496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccec09a-9144-4481-87d8-3a02b9519077 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:27.352431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cabba-3ee5-4e94-8b12-b4afa795ade1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:27.353110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cabba-3ee5-4e94-8b12-b4afa795ade1 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:27.353601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cabba-3ee5-4e94-8b12-b4afa795ade1 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:27.353890 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cabba-3ee5-4e94-8b12-b4afa795ade1 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:27.355801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cabba-3ee5-4e94-8b12-b4afa795ade1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:27.356127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cabba-3ee5-4e94-8b12-b4afa795ade1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:27.357593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cabba-3ee5-4e94-8b12-b4afa795ade1 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-7ccec09a-9144-4481-87d8-3a02b9519077 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:27.367352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:27.368500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:27.369601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:27.369601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:27.369601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:27.369601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:27.369601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:27.369601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:27.369601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:27.369601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:27.369601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 19:40:27.369601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:27.369601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 285/580] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:27.375504 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f91f86-3b8c-4e37-90e1-f8de868f6aa6 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:27.375504 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f91f86-3b8c-4e37-90e1-f8de868f6aa6 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:27.375504 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f91f86-3b8c-4e37-90e1-f8de868f6aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:27.382505 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 296/581] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:27.383831 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cabba-3ee5-4e94-8b12-b4afa795ade1 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:27.391650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-48f91f86-3b8c-4e37-90e1-f8de868f6aa6 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:27.393113 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-48f91f86-3b8c-4e37-90e1-f8de868f6aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:27.490375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 286/582] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:27.490375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f91f86-3b8c-4e37-90e1-f8de868f6aa6 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:27.518733 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cabba-3ee5-4e94-8b12-b4afa795ade1 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:27.545854 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:27.558559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd524ad-76f1-439d-b593-f67842de69fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:27.572488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd524ad-76f1-439d-b593-f67842de69fb None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:27.572488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd524ad-76f1-439d-b593-f67842de69fb None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:27.572488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd524ad-76f1-439d-b593-f67842de69fb None admin] PATH_INFO: `/v3/users/glance` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:27.572488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd524ad-76f1-439d-b593-f67842de69fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:27.572488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd524ad-76f1-439d-b593-f67842de69fb None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-cfd524ad-76f1-439d-b593-f67842de69fb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:27.588416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:27.589918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:27.591154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:27.591154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:27.591154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:27.591154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:27.591154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:27.591154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:27.591154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:27.591154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:27.591154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 19:40:27.591154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:27.593247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 297/583] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:27.594232 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd524ad-76f1-439d-b593-f67842de69fb None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:27.621166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f91f86-3b8c-4e37-90e1-f8de868f6aa6 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:27.652556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:27.662161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3505678-f18b-45df-8e77-cb82df354051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:27.662876 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3505678-f18b-45df-8e77-cb82df354051 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:27.663168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3505678-f18b-45df-8e77-cb82df354051 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:27.663451 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3505678-f18b-45df-8e77-cb82df354051 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:27.664300 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3505678-f18b-45df-8e77-cb82df354051 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:27.664616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3505678-f18b-45df-8e77-cb82df354051 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:27.666061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3505678-f18b-45df-8e77-cb82df354051 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:27.685935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 287/584] 10.222.0.15 () {56 vars in 1137 bytes} [Fri May 27 19:40:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:27.686820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3505678-f18b-45df-8e77-cb82df354051 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:27.717143 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd524ad-76f1-439d-b593-f67842de69fb None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:27.758469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f358683-e2c8-4eb6-a302-776eb401f8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:27.759547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f358683-e2c8-4eb6-a302-776eb401f8d4 None admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:27.759914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f358683-e2c8-4eb6-a302-776eb401f8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:27.760255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f358683-e2c8-4eb6-a302-776eb401f8d4 None admin] PATH_INFO: `/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/105353b6b1a941ac81df7ad35567ba7c/roles/30112fca4d6549a790f2eadf20635343` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:27.779019 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f358683-e2c8-4eb6-a302-776eb401f8d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=400421f9ccc6478783fa6bbc822b0687, user_id=105353b6b1a941ac81df7ad35567ba7c, role_id=30112fca4d6549a790f2eadf20635343)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:27.780736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f358683-e2c8-4eb6-a302-776eb401f8d4 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:27.805987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3505678-f18b-45df-8e77-cb82df354051 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:27.808222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:27.845648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599381f-4cbe-42e1-8a63-e49aad18a682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:27.846395 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599381f-4cbe-42e1-8a63-e49aad18a682 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:27.846688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599381f-4cbe-42e1-8a63-e49aad18a682 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:27.846971 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599381f-4cbe-42e1-8a63-e49aad18a682 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:27.859227 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599381f-4cbe-42e1-8a63-e49aad18a682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:27.862201 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 298/585] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:40:27 2022] PUT /identity/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/105353b6b1a941ac81df7ad35567ba7c/roles/30112fca4d6549a790f2eadf20635343 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-2599381f-4cbe-42e1-8a63-e49aad18a682 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:27.868061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:27.874832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:27.876015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:27.876015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:27.876015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:27.876015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:27.876015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:27.876015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:27.876015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:27.876015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:27.876015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:27.876015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:27.876015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:27.876015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:27.876015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 288/586] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:27.876015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599381f-4cbe-42e1-8a63-e49aad18a682 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:27.876962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f358683-e2c8-4eb6-a302-776eb401f8d4 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:28.034546 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599381f-4cbe-42e1-8a63-e49aad18a682 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:28.058445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:28.066373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f358683-e2c8-4eb6-a302-776eb401f8d4 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:28.093385 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7010c-98d8-4546-993e-4850b3369501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:28.094294 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7010c-98d8-4546-993e-4850b3369501 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:28.094671 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7010c-98d8-4546-993e-4850b3369501 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:28.094981 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7010c-98d8-4546-993e-4850b3369501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:28.106413 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059f0c4-ac40-440e-8ca2-66f9d774f5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:28.107246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059f0c4-ac40-440e-8ca2-66f9d774f5e1 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:28.107536 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059f0c4-ac40-440e-8ca2-66f9d774f5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:28.107709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059f0c4-ac40-440e-8ca2-66f9d774f5e1 None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:28.108467 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7010c-98d8-4546-993e-4850b3369501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:28.108588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059f0c4-ac40-440e-8ca2-66f9d774f5e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:28.108873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059f0c4-ac40-440e-8ca2-66f9d774f5e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:28.110197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7010c-98d8-4546-993e-4850b3369501 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:28.110308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059f0c4-ac40-440e-8ca2-66f9d774f5e1 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:28.132080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-59c7010c-98d8-4546-993e-4850b3369501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:28.132080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:28.132080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:28.132080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:28.132080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:28.132080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:28.132080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:28.132080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:28.132080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:28.132080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:28.132080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:28.132080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:28.132080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:28.132080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:28.132080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:28.133061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:28.133951 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:28.133951 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:28.133951 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:28.133951 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:28.133951 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 289/587] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:28.134863 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7010c-98d8-4546-993e-4850b3369501 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:28.146082 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 299/588] 10.222.0.15 () {56 vars in 1137 bytes} [Fri May 27 19:40:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:28.147131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059f0c4-ac40-440e-8ca2-66f9d774f5e1 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:28.158422 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:28.265466 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7010c-98d8-4546-993e-4850b3369501 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:28.282250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059f0c4-ac40-440e-8ca2-66f9d774f5e1 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:28.302286 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e8891-e061-4129-a6b1-34eb8177c37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:28.303012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8891-e061-4129-a6b1-34eb8177c37c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:28.303301 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8891-e061-4129-a6b1-34eb8177c37c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:28.303582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8891-e061-4129-a6b1-34eb8177c37c None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:28.304372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e8891-e061-4129-a6b1-34eb8177c37c None admin] RBAC: Adding query filter params (name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:28.304788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e8891-e061-4129-a6b1-34eb8177c37c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:28.306431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e8891-e061-4129-a6b1-34eb8177c37c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:28.316426 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 290/589] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:28.317547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e8891-e061-4129-a6b1-34eb8177c37c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:28.325585 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d736ea9-200b-42bb-bde1-71ab0db39302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:28.326351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d736ea9-200b-42bb-bde1-71ab0db39302 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:28.326650 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d736ea9-200b-42bb-bde1-71ab0db39302 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:28.326930 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d736ea9-200b-42bb-bde1-71ab0db39302 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:28.327662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d736ea9-200b-42bb-bde1-71ab0db39302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:28.328438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d736ea9-200b-42bb-bde1-71ab0db39302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:28.330316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d736ea9-200b-42bb-bde1-71ab0db39302 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:28.350419 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 300/590] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:28.351368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d736ea9-200b-42bb-bde1-71ab0db39302 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:28.374250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:28.413825 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:28.442361 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e8891-e061-4129-a6b1-34eb8177c37c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:28.488854 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b679074-7792-411e-bde8-d6b350a29db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:28.489664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b679074-7792-411e-bde8-d6b350a29db6 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:28.489953 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b679074-7792-411e-bde8-d6b350a29db6 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:28.490236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b679074-7792-411e-bde8-d6b350a29db6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:28.497991 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d736ea9-200b-42bb-bde1-71ab0db39302 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:28.502850 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b679074-7792-411e-bde8-d6b350a29db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:28.504338 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b679074-7792-411e-bde8-d6b350a29db6 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:28.523241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-6b679074-7792-411e-bde8-d6b350a29db6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:28.523241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:28.523241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:28.523241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:28.523241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:28.523241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:28.523241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:28.523241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:28.523241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:28.523241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:28.523241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:28.523241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:28.523241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:28.523241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:28.523241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:28.524176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:28.525043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:28.525043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:28.525043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:28.525043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:28.525043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 291/591] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:28.525748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b679074-7792-411e-bde8-d6b350a29db6 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:28.548356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00861c99-286d-456c-b20d-6f732f60ebdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:28.549206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00861c99-286d-456c-b20d-6f732f60ebdb None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:28.549500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00861c99-286d-456c-b20d-6f732f60ebdb None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:28.550042 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00861c99-286d-456c-b20d-6f732f60ebdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:28.561954 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00861c99-286d-456c-b20d-6f732f60ebdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:28.563530 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00861c99-286d-456c-b20d-6f732f60ebdb None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:28.587242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-00861c99-286d-456c-b20d-6f732f60ebdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:28.587242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:28.587242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:28.587242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:28.587242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:28.587242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:28.587242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:28.587242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:28.587242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:28.587242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:28.587242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:28.587242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:28.587242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:28.587242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:28.587242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:28.588175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:28.589065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:28.589065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:28.589065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:28.589065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:28.590377 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 301/592] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:28.591465 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00861c99-286d-456c-b20d-6f732f60ebdb None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:28.650528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b679074-7792-411e-bde8-d6b350a29db6 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:28.675907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:28.682017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:28.697494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7a258-9284-433b-a3d4-37806a7f54fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:28.698887 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7a258-9284-433b-a3d4-37806a7f54fe None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:28.699332 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7a258-9284-433b-a3d4-37806a7f54fe None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:28.699628 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7a258-9284-433b-a3d4-37806a7f54fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:28.709489 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7a258-9284-433b-a3d4-37806a7f54fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:28.711392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7a258-9284-433b-a3d4-37806a7f54fe None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:28.722416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00861c99-286d-456c-b20d-6f732f60ebdb None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:28.730052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-2dc7a258-9284-433b-a3d4-37806a7f54fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:28.730052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:28.730052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:28.730052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:28.730052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:28.730052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:28.730052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:28.730052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:28.730052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:28.730052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:28.730052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:28.730052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:28.730052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:28.730052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:28.730052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:28.731003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:28.731888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:28.731888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:28.731888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:28.731888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:28.731888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:28.731888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:28.731888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:28.731888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:28.731888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 292/593] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:28.732858 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7a258-9284-433b-a3d4-37806a7f54fe None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:28.787615 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd96c7-f738-41eb-b0ef-70241a2c6d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:28.788682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd96c7-f738-41eb-b0ef-70241a2c6d26 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:28.789203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd96c7-f738-41eb-b0ef-70241a2c6d26 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:28.789690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd96c7-f738-41eb-b0ef-70241a2c6d26 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:28.790683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd96c7-f738-41eb-b0ef-70241a2c6d26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:28.791203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd96c7-f738-41eb-b0ef-70241a2c6d26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:28.793422 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd96c7-f738-41eb-b0ef-70241a2c6d26 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:28.811087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 302/594] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:28.812389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd96c7-f738-41eb-b0ef-70241a2c6d26 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:28.859323 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7a258-9284-433b-a3d4-37806a7f54fe None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:28.896995 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912a198-05a6-4831-9fb4-5e89c5da4713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:28.897675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912a198-05a6-4831-9fb4-5e89c5da4713 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:28.897964 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912a198-05a6-4831-9fb4-5e89c5da4713 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:28.898249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912a198-05a6-4831-9fb4-5e89c5da4713 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:28.899126 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912a198-05a6-4831-9fb4-5e89c5da4713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:28.899443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912a198-05a6-4831-9fb4-5e89c5da4713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:28.901006 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912a198-05a6-4831-9fb4-5e89c5da4713 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:28.915193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 293/595] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:28.916190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912a198-05a6-4831-9fb4-5e89c5da4713 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:28.921013 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd96c7-f738-41eb-b0ef-70241a2c6d26 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:28.946789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:28.959464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1533db5-bd5b-4d3d-9ae2-c145a93d04d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:28.962315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1533db5-bd5b-4d3d-9ae2-c145a93d04d2 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:28.962315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1533db5-bd5b-4d3d-9ae2-c145a93d04d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:28.962315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1533db5-bd5b-4d3d-9ae2-c145a93d04d2 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:28.962315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1533db5-bd5b-4d3d-9ae2-c145a93d04d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:28.962315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1533db5-bd5b-4d3d-9ae2-c145a93d04d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:28.964584 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1533db5-bd5b-4d3d-9ae2-c145a93d04d2 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:28.972164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:28.977886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 303/596] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:28.979094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1533db5-bd5b-4d3d-9ae2-c145a93d04d2 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:29.033375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912a198-05a6-4831-9fb4-5e89c5da4713 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:29.072371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed8257-1892-4184-8d9e-e05454523821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:29.074037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed8257-1892-4184-8d9e-e05454523821 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:29.074544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed8257-1892-4184-8d9e-e05454523821 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:29.074973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed8257-1892-4184-8d9e-e05454523821 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:29.083705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed8257-1892-4184-8d9e-e05454523821 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:29.085505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed8257-1892-4184-8d9e-e05454523821 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:29.091038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1533db5-bd5b-4d3d-9ae2-c145a93d04d2 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:29.103761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-f2ed8257-1892-4184-8d9e-e05454523821 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:29.103761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:29.103761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:29.103761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:29.103761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:29.103761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:29.103761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:29.103761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:29.103761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:29.103761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:29.103761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:29.103761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:29.103761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:29.103761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:29.103761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:29.105339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:29.106236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:29.106236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:29.106236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:29.106236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:29.106236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:29.106236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:29.106236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:29.106236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:29.109211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 294/597] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:29.110397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed8257-1892-4184-8d9e-e05454523821 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:29.140807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848181ba-f7ce-4a69-b617-d9df37a85c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:29.141829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848181ba-f7ce-4a69-b617-d9df37a85c93 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:29.142461 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848181ba-f7ce-4a69-b617-d9df37a85c93 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:29.142637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848181ba-f7ce-4a69-b617-d9df37a85c93 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:29.153217 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848181ba-f7ce-4a69-b617-d9df37a85c93 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:29.155315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848181ba-f7ce-4a69-b617-d9df37a85c93 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-848181ba-f7ce-4a69-b617-d9df37a85c93 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:29.173449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:29.174484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:29.175767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:29.175767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:29.175767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:29.175767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:29.175767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:29.175767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:29.175767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:29.175767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:29.175767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 19:40:29.175767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:29.175767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 304/598] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:29.176361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848181ba-f7ce-4a69-b617-d9df37a85c93 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:29.232158 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:29.233653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed8257-1892-4184-8d9e-e05454523821 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:29.244416 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:29.273597 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b31d04-cd33-4e56-b798-cddb96764a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:29.274907 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b31d04-cd33-4e56-b798-cddb96764a47 None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:29.275413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b31d04-cd33-4e56-b798-cddb96764a47 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:29.275906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b31d04-cd33-4e56-b798-cddb96764a47 None admin] PATH_INFO: `/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/8a892d3f80464f9e9ced137c5de8bd60/roles/30112fca4d6549a790f2eadf20635343` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:29.294217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b31d04-cd33-4e56-b798-cddb96764a47 None admin] RBAC: Authorizing `identity:create_grant(project_id=400421f9ccc6478783fa6bbc822b0687, user_id=8a892d3f80464f9e9ced137c5de8bd60, role_id=30112fca4d6549a790f2eadf20635343)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:29.296790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b31d04-cd33-4e56-b798-cddb96764a47 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:29.311243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848181ba-f7ce-4a69-b617-d9df37a85c93 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:29.346915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34a43a-a2ce-42a1-a0f4-ce127dec3bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:29.347581 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34a43a-a2ce-42a1-a0f4-ce127dec3bfa None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:29.347865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34a43a-a2ce-42a1-a0f4-ce127dec3bfa None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:29.348240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34a43a-a2ce-42a1-a0f4-ce127dec3bfa None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:29.349048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34a43a-a2ce-42a1-a0f4-ce127dec3bfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:29.349358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34a43a-a2ce-42a1-a0f4-ce127dec3bfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:29.350881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34a43a-a2ce-42a1-a0f4-ce127dec3bfa None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:29.365346 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 305/599] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:29.366144 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34a43a-a2ce-42a1-a0f4-ce127dec3bfa None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:29.371144 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 295/600] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:40:29 2022] PUT /identity/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/8a892d3f80464f9e9ced137c5de8bd60/roles/30112fca4d6549a790f2eadf20635343 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:40:29.372414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979da67-e564-47e8-a66e-5527f3a38beb None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:29.372414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979da67-e564-47e8-a66e-5527f3a38beb None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:29.372594 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979da67-e564-47e8-a66e-5527f3a38beb None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:29.379482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 296/601] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:29.379482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979da67-e564-47e8-a66e-5527f3a38beb None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:29.516071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34a43a-a2ce-42a1-a0f4-ce127dec3bfa None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:29.518708 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:29.531808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979da67-e564-47e8-a66e-5527f3a38beb None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:29.556462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87007c7b-ba91-408f-8aba-f2ac2769db7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:29.557441 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87007c7b-ba91-408f-8aba-f2ac2769db7c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:29.558355 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87007c7b-ba91-408f-8aba-f2ac2769db7c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:29.558652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87007c7b-ba91-408f-8aba-f2ac2769db7c None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:29.559733 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87007c7b-ba91-408f-8aba-f2ac2769db7c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:29.559873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87007c7b-ba91-408f-8aba-f2ac2769db7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:29.561418 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87007c7b-ba91-408f-8aba-f2ac2769db7c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:29.576845 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af38a3-f4f7-4215-8841-ae720a5ff2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:29.578251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af38a3-f4f7-4215-8841-ae720a5ff2d3 None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:29.578896 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af38a3-f4f7-4215-8841-ae720a5ff2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:29.579367 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af38a3-f4f7-4215-8841-ae720a5ff2d3 None admin] PATH_INFO: `/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/cc2b57ae83164912a4e23dda9dc239f4/roles/30112fca4d6549a790f2eadf20635343` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:29.583128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 306/602] 10.222.0.15 () {56 vars in 1139 bytes} [Fri May 27 19:40:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:29.584643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab89f4d-e26b-4509-bec7-7a73eb0337cc None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:29.584863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab89f4d-e26b-4509-bec7-7a73eb0337cc None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:29.585152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab89f4d-e26b-4509-bec7-7a73eb0337cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:29.599522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af38a3-f4f7-4215-8841-ae720a5ff2d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=400421f9ccc6478783fa6bbc822b0687, user_id=cc2b57ae83164912a4e23dda9dc239f4, role_id=30112fca4d6549a790f2eadf20635343)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:29.601340 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af38a3-f4f7-4215-8841-ae720a5ff2d3 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:29.602100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-9ab89f4d-e26b-4509-bec7-7a73eb0337cc None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:29.603441 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9ab89f4d-e26b-4509-bec7-7a73eb0337cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:29.682625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 307/603] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:29.682625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab89f4d-e26b-4509-bec7-7a73eb0337cc None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:29.726715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 297/604] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:40:29 2022] PUT /identity/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/cc2b57ae83164912a4e23dda9dc239f4/roles/30112fca4d6549a790f2eadf20635343 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:40:29.728003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af38a3-f4f7-4215-8841-ae720a5ff2d3 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:29.746206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:29.787918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:29.796731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab89f4d-e26b-4509-bec7-7a73eb0337cc None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:29.838048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72484c-d22e-4728-9987-833602567a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:29.839803 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72484c-d22e-4728-9987-833602567a8c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:29.840346 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72484c-d22e-4728-9987-833602567a8c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:29.840854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72484c-d22e-4728-9987-833602567a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:29.862781 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72484c-d22e-4728-9987-833602567a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:29.867535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72484c-d22e-4728-9987-833602567a8c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:29.909139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-9c72484c-d22e-4728-9987-833602567a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:29.909139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:29.909139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:29.909139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:29.909139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:29.909139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:29.909139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:29.909139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:29.909139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:29.909139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:29.909139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:29.909139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:29.909139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:29.909139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:29.909139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:29.910127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:29.911053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:29.911053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:29.911053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:29.911053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:29.913397 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 308/605] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:29.921006 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72484c-d22e-4728-9987-833602567a8c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:29.953953 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af38a3-f4f7-4215-8841-ae720a5ff2d3 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:30.035899 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11a03e-ad2d-4454-907c-aed8074dd3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:30.036718 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11a03e-ad2d-4454-907c-aed8074dd3e0 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:30.037007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11a03e-ad2d-4454-907c-aed8074dd3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:30.037291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11a03e-ad2d-4454-907c-aed8074dd3e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:30.052313 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11a03e-ad2d-4454-907c-aed8074dd3e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:30.056681 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72484c-d22e-4728-9987-833602567a8c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-ec11a03e-ad2d-4454-907c-aed8074dd3e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:30.060755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:30.061708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:30.062661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:30.062661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:30.062661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:30.062661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:30.062661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:30.062661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:30.062661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:30.062661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:30.062661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:30.062661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:30.062661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:30.062661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:30.066794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 298/606] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:30.068291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11a03e-ad2d-4454-907c-aed8074dd3e0 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:30.110468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ce46b-4c47-4f53-afb5-b1a842b301e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:30.111745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ce46b-4c47-4f53-afb5-b1a842b301e1 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:30.112260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ce46b-4c47-4f53-afb5-b1a842b301e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:30.112897 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ce46b-4c47-4f53-afb5-b1a842b301e1 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:30.113984 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ce46b-4c47-4f53-afb5-b1a842b301e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:30.114567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ce46b-4c47-4f53-afb5-b1a842b301e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:30.116239 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ce46b-4c47-4f53-afb5-b1a842b301e1 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:30.138242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 309/607] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:30.143412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ce46b-4c47-4f53-afb5-b1a842b301e1 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:30.148268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:30.154070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:30.188453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11a03e-ad2d-4454-907c-aed8074dd3e0 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:30.226154 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409aa0a7-72a2-493c-bc0a-8b923f5ca494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:30.227240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aa0a7-72a2-493c-bc0a-8b923f5ca494 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:30.227765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aa0a7-72a2-493c-bc0a-8b923f5ca494 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:30.228282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409aa0a7-72a2-493c-bc0a-8b923f5ca494 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:30.229248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409aa0a7-72a2-493c-bc0a-8b923f5ca494 None admin] RBAC: Adding query filter params (name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:30.230364 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409aa0a7-72a2-493c-bc0a-8b923f5ca494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:30.231927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409aa0a7-72a2-493c-bc0a-8b923f5ca494 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:30.246209 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 299/608] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:30.247759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409aa0a7-72a2-493c-bc0a-8b923f5ca494 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:30.276019 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ce46b-4c47-4f53-afb5-b1a842b301e1 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:30.315170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269164ae-171c-4f10-8312-145d41f48bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:30.316840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269164ae-171c-4f10-8312-145d41f48bb1 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:30.317437 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269164ae-171c-4f10-8312-145d41f48bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:30.318021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269164ae-171c-4f10-8312-145d41f48bb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:30.326804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269164ae-171c-4f10-8312-145d41f48bb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:30.328472 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269164ae-171c-4f10-8312-145d41f48bb1 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:30.345128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-269164ae-171c-4f10-8312-145d41f48bb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:30.345128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:30.345128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:30.345128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:30.345128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:30.345128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:30.345128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:30.345128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:30.345128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:30.345128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:30.345128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:30.345128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:30.345128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:30.345128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:30.345128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:30.346257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:30.347261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:30.347261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:30.347261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:30.347261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:30.347261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:30.347261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:30.347261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:30.347261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:30.347923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 310/609] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:30.349320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7cf1c-1e88-4bc7-989a-ef0db4b34b59 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:30.349602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7cf1c-1e88-4bc7-989a-ef0db4b34b59 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:30.350056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7cf1c-1e88-4bc7-989a-ef0db4b34b59 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:30.351771 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 311/610] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:30.352698 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7cf1c-1e88-4bc7-989a-ef0db4b34b59 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:30.365470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409aa0a7-72a2-493c-bc0a-8b923f5ca494 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:30.396578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:30.403789 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52031f24-be5e-45f4-8eb4-8003f71b80b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:30.408843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52031f24-be5e-45f4-8eb4-8003f71b80b1 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:30.408843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52031f24-be5e-45f4-8eb4-8003f71b80b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:30.408843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52031f24-be5e-45f4-8eb4-8003f71b80b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:30.418015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52031f24-be5e-45f4-8eb4-8003f71b80b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:30.419863 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52031f24-be5e-45f4-8eb4-8003f71b80b1 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:30.435626 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:30.439483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-52031f24-be5e-45f4-8eb4-8003f71b80b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:30.439483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:30.439483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:30.439483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:30.439483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:30.439483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:30.439483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:30.439483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:30.439483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:30.439483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:30.439483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:30.439483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:30.439483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:30.439483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:30.439483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:30.440379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:30.441278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:30.441278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:30.441278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:30.441278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:30.448321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 300/611] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:30.450129 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c7fe5-aa69-4395-a2df-57428c3d5464 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:30.450561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c7fe5-aa69-4395-a2df-57428c3d5464 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:30.450952 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c7fe5-aa69-4395-a2df-57428c3d5464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:30.468277 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7cf1c-1e88-4bc7-989a-ef0db4b34b59 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:30.468940 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-2d3c7fe5-aa69-4395-a2df-57428c3d5464 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:30.474122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2d3c7fe5-aa69-4395-a2df-57428c3d5464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:30.510244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1b761-0759-4565-9c76-e77c9f76b39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:30.510999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1b761-0759-4565-9c76-e77c9f76b39a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:30.511288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1b761-0759-4565-9c76-e77c9f76b39a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:30.511696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1b761-0759-4565-9c76-e77c9f76b39a None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:30.512501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1b761-0759-4565-9c76-e77c9f76b39a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:30.512818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1b761-0759-4565-9c76-e77c9f76b39a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:30.514366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec1b761-0759-4565-9c76-e77c9f76b39a None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:30.528290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 312/612] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:30.529156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1b761-0759-4565-9c76-e77c9f76b39a None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:30.554696 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 301/613] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:30.555693 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c7fe5-aa69-4395-a2df-57428c3d5464 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:30.633761 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1b761-0759-4565-9c76-e77c9f76b39a None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:30.658324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:30.668892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7f2e8-cdd3-47de-8bb5-f1015cff9a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:30.671956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7f2e8-cdd3-47de-8bb5-f1015cff9a54 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:30.671956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7f2e8-cdd3-47de-8bb5-f1015cff9a54 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:30.671956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7f2e8-cdd3-47de-8bb5-f1015cff9a54 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:30.671956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7f2e8-cdd3-47de-8bb5-f1015cff9a54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:30.671956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7f2e8-cdd3-47de-8bb5-f1015cff9a54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:30.672545 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7f2e8-cdd3-47de-8bb5-f1015cff9a54 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:30.685852 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 313/614] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:30.686753 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7f2e8-cdd3-47de-8bb5-f1015cff9a54 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:30.689454 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c7fe5-aa69-4395-a2df-57428c3d5464 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:30.712030 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:30.739840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c9815-8c60-431e-8fd2-de54a7e4a080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:30.741189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c9815-8c60-431e-8fd2-de54a7e4a080 None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:30.741685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c9815-8c60-431e-8fd2-de54a7e4a080 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:30.742259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c9815-8c60-431e-8fd2-de54a7e4a080 None admin] PATH_INFO: `/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/af7e51b89f4c4dcc9963061e6e509eb7/roles/30112fca4d6549a790f2eadf20635343` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:30.761298 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c9815-8c60-431e-8fd2-de54a7e4a080 None admin] RBAC: Authorizing `identity:create_grant(project_id=400421f9ccc6478783fa6bbc822b0687, user_id=af7e51b89f4c4dcc9963061e6e509eb7, role_id=30112fca4d6549a790f2eadf20635343)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:30.763354 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4c9815-8c60-431e-8fd2-de54a7e4a080 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:30.801272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7f2e8-cdd3-47de-8bb5-f1015cff9a54 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:30.840276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfd0c2-9c08-49a2-8117-4f4acd4d79d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:30.841143 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfd0c2-9c08-49a2-8117-4f4acd4d79d6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:30.841539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfd0c2-9c08-49a2-8117-4f4acd4d79d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:30.841689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfd0c2-9c08-49a2-8117-4f4acd4d79d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:30.855152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 302/615] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:40:30 2022] PUT /identity/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/af7e51b89f4c4dcc9963061e6e509eb7/roles/30112fca4d6549a790f2eadf20635343 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:40:30.855152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c9815-8c60-431e-8fd2-de54a7e4a080 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:30.862328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfd0c2-9c08-49a2-8117-4f4acd4d79d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-d2dfd0c2-9c08-49a2-8117-4f4acd4d79d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:30.879347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:30.884297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:30.885304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:30.885304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:30.885304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:30.885304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:30.885304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:30.885304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:30.885304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:30.885304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:30.885304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:30.885304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:30.885304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:30.885304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:30.885304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 314/616] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:30.893331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfd0c2-9c08-49a2-8117-4f4acd4d79d6 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:30.990999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:31.081817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c9815-8c60-431e-8fd2-de54a7e4a080 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:31.110195 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfd0c2-9c08-49a2-8117-4f4acd4d79d6 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:31.148798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a97087-68e8-4a4a-9f1c-fe0d996a4310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:31.149844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a97087-68e8-4a4a-9f1c-fe0d996a4310 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:31.150244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a97087-68e8-4a4a-9f1c-fe0d996a4310 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:31.150868 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a97087-68e8-4a4a-9f1c-fe0d996a4310 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:31.165233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a97087-68e8-4a4a-9f1c-fe0d996a4310 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:31.166467 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a97087-68e8-4a4a-9f1c-fe0d996a4310 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:31.170315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ad4b1-4012-4045-99bd-6835326f8ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:31.171358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad4b1-4012-4045-99bd-6835326f8ca4 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:31.172683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad4b1-4012-4045-99bd-6835326f8ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:31.173544 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ad4b1-4012-4045-99bd-6835326f8ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:31.174985 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ad4b1-4012-4045-99bd-6835326f8ca4 None admin] RBAC: Adding query filter params (name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:31.175581 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ad4b1-4012-4045-99bd-6835326f8ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:31.177390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ad4b1-4012-4045-99bd-6835326f8ca4 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-99a97087-68e8-4a4a-9f1c-fe0d996a4310 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:31.185861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:31.187491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:31.188849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:31.188849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:31.188849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:31.188849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:31.188849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:31.188849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:31.188849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:31.188849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:31.188849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 19:40:31.188849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:31.188849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 303/617] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:40:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:31.193643 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a97087-68e8-4a4a-9f1c-fe0d996a4310 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:31.194620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 315/618] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:31.201902 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ad4b1-4012-4045-99bd-6835326f8ca4 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:31.239366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:31.363662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ad4b1-4012-4045-99bd-6835326f8ca4 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:31.372717 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a97087-68e8-4a4a-9f1c-fe0d996a4310 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:31.376158 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:31.412151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd2c4e-b8c6-4fc2-9248-b354c7b44006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:31.412759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd2c4e-b8c6-4fc2-9248-b354c7b44006 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:31.413047 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd2c4e-b8c6-4fc2-9248-b354c7b44006 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:31.413325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd2c4e-b8c6-4fc2-9248-b354c7b44006 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:31.414181 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd2c4e-b8c6-4fc2-9248-b354c7b44006 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:31.414544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd2c4e-b8c6-4fc2-9248-b354c7b44006 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:31.416028 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd2c4e-b8c6-4fc2-9248-b354c7b44006 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:31.436779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 304/619] 10.222.0.15 () {56 vars in 1135 bytes} [Fri May 27 19:40:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:31.442096 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd2c4e-b8c6-4fc2-9248-b354c7b44006 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:31.443105 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cac8b7-9366-4f35-93f0-448b3d6e46da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:31.445557 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cac8b7-9366-4f35-93f0-448b3d6e46da None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:31.445846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cac8b7-9366-4f35-93f0-448b3d6e46da None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:31.446126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cac8b7-9366-4f35-93f0-448b3d6e46da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:31.487386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cac8b7-9366-4f35-93f0-448b3d6e46da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:31.488882 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cac8b7-9366-4f35-93f0-448b3d6e46da None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:31.514937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-a6cac8b7-9366-4f35-93f0-448b3d6e46da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:31.514937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:31.514937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:31.514937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:31.514937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:31.514937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:31.514937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:31.514937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:31.514937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:31.514937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:31.514937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:31.514937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:31.514937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:31.514937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:31.514937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:31.515922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:31.516791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:31.516791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:31.516791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:31.516791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:31.516791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 316/620] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:31.526492 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cac8b7-9366-4f35-93f0-448b3d6e46da None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:31.642121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cac8b7-9366-4f35-93f0-448b3d6e46da None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:31.643556 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:31.681541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf9908-5158-4f47-8a36-c6735f76c80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:31.682142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf9908-5158-4f47-8a36-c6735f76c80b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:31.682511 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf9908-5158-4f47-8a36-c6735f76c80b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:31.683375 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf9908-5158-4f47-8a36-c6735f76c80b None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:31.684305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf9908-5158-4f47-8a36-c6735f76c80b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:31.684814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf9908-5158-4f47-8a36-c6735f76c80b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:31.686823 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecf9908-5158-4f47-8a36-c6735f76c80b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:31.701095 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 317/621] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:31.701288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd2c4e-b8c6-4fc2-9248-b354c7b44006 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:31.707230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf9908-5158-4f47-8a36-c6735f76c80b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:31.735937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:31.772848 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92cc77-4b5b-4ae7-91b4-7d188b7b95f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:31.773998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92cc77-4b5b-4ae7-91b4-7d188b7b95f0 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:31.776755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92cc77-4b5b-4ae7-91b4-7d188b7b95f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:31.777301 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d92cc77-4b5b-4ae7-91b4-7d188b7b95f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:31.796502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92cc77-4b5b-4ae7-91b4-7d188b7b95f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:31.798485 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d92cc77-4b5b-4ae7-91b4-7d188b7b95f0 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:31.818935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-5d92cc77-4b5b-4ae7-91b4-7d188b7b95f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:31.818935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:31.818935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:31.818935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:31.818935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:31.818935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:31.818935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:31.818935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:31.818935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:31.818935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:31.818935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:31.818935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:31.818935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:31.818935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:31.818935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:31.820082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:31.821178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:31.821178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:31.821178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:31.821178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:31.822849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 305/622] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:31.828715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92cc77-4b5b-4ae7-91b4-7d188b7b95f0 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:31.906433 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf9908-5158-4f47-8a36-c6735f76c80b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:31.989236 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07124b74-e482-426f-9b1d-50bdc2a3ebea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:31.990257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124b74-e482-426f-9b1d-50bdc2a3ebea None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:31.990580 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124b74-e482-426f-9b1d-50bdc2a3ebea None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:31.990863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07124b74-e482-426f-9b1d-50bdc2a3ebea None admin] PATH_INFO: `/v3/users/nova` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:32.001491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07124b74-e482-426f-9b1d-50bdc2a3ebea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:32.004133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07124b74-e482-426f-9b1d-50bdc2a3ebea None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:32.009146 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d92cc77-4b5b-4ae7-91b4-7d188b7b95f0 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-07124b74-e482-426f-9b1d-50bdc2a3ebea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:32.023953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:32.025109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:32.026045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:32.026045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:32.026045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:32.026045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:32.026045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:32.026045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:32.026045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:32.026045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:32.026045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 19:40:32.026045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:32.030403 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 318/623] 10.222.0.15 () {56 vars in 1093 bytes} [Fri May 27 19:40:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:32.032071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8656a4-1a4b-4e08-9bac-903c6f68055a None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:32.032506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8656a4-1a4b-4e08-9bac-903c6f68055a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:32.033206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8656a4-1a4b-4e08-9bac-903c6f68055a None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:32.038386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 319/624] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:32.039172 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8656a4-1a4b-4e08-9bac-903c6f68055a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:32.057191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:32.063669 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee33d9-2ae8-47c4-9d57-cba301f3bcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:32.064511 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee33d9-2ae8-47c4-9d57-cba301f3bcca None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:32.064800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee33d9-2ae8-47c4-9d57-cba301f3bcca None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:32.065080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee33d9-2ae8-47c4-9d57-cba301f3bcca None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:32.065966 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee33d9-2ae8-47c4-9d57-cba301f3bcca None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:32.066682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee33d9-2ae8-47c4-9d57-cba301f3bcca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:32.068450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee33d9-2ae8-47c4-9d57-cba301f3bcca None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:32.083141 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 306/625] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:32.085040 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619850c-9301-4bc6-98ea-25e748c8870f None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:32.085463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619850c-9301-4bc6-98ea-25e748c8870f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:32.085753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619850c-9301-4bc6-98ea-25e748c8870f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:32.108226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-9619850c-9301-4bc6-98ea-25e748c8870f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:32.109758 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9619850c-9301-4bc6-98ea-25e748c8870f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:32.152992 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:32.178516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8656a4-1a4b-4e08-9bac-903c6f68055a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:32.202719 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 307/626] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:32.203790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619850c-9301-4bc6-98ea-25e748c8870f None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:32.224921 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04987f2c-f744-43ff-b146-0146dedfcd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:32.226798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04987f2c-f744-43ff-b146-0146dedfcd2a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:32.227402 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04987f2c-f744-43ff-b146-0146dedfcd2a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:32.228186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04987f2c-f744-43ff-b146-0146dedfcd2a None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:32.231013 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04987f2c-f744-43ff-b146-0146dedfcd2a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:32.231642 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04987f2c-f744-43ff-b146-0146dedfcd2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:32.235297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04987f2c-f744-43ff-b146-0146dedfcd2a None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:32.256594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 320/627] 10.222.0.15 () {56 vars in 1133 bytes} [Fri May 27 19:40:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:32.262124 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04987f2c-f744-43ff-b146-0146dedfcd2a None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:32.341994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619850c-9301-4bc6-98ea-25e748c8870f None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:32.372882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:32.388065 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d58e7-ce94-4b35-9ee6-582f1494f0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:32.392073 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d58e7-ce94-4b35-9ee6-582f1494f0b3 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:32.392073 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d58e7-ce94-4b35-9ee6-582f1494f0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:32.392073 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d58e7-ce94-4b35-9ee6-582f1494f0b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:32.394752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04987f2c-f744-43ff-b146-0146dedfcd2a None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:32.397653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d58e7-ce94-4b35-9ee6-582f1494f0b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:32.400176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1d58e7-ce94-4b35-9ee6-582f1494f0b3 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:32.416250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-1f1d58e7-ce94-4b35-9ee6-582f1494f0b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:32.416250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:32.416250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:32.416250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:32.416250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:32.416250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:32.416250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:32.416250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:32.416250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:32.416250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:32.416250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:32.416250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:32.416250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:32.416250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:32.416250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:32.418234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:32.419488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:32.419488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:32.419488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:32.419488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:32.419488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:32.419488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:32.419488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:32.419488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:32.424860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 308/628] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:32.426211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d58e7-ce94-4b35-9ee6-582f1494f0b3 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:32.457290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0d10c-d0e6-4bcf-ab48-3388eae290b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:32.459058 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0d10c-d0e6-4bcf-ab48-3388eae290b1 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:32.459665 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0d10c-d0e6-4bcf-ab48-3388eae290b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:32.460126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0d10c-d0e6-4bcf-ab48-3388eae290b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:32.464885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:32.484162 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0d10c-d0e6-4bcf-ab48-3388eae290b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-63e0d10c-d0e6-4bcf-ab48-3388eae290b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:32.494290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:32.495330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:32.496170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:32.496170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:32.496170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:32.496170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:32.496170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:32.496170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:32.496170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:32.496170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:32.496170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:32.496170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:32.496170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:32.496170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:32.496808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 321/629] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:32.497622 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0d10c-d0e6-4bcf-ab48-3388eae290b1 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:32.571236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d58e7-ce94-4b35-9ee6-582f1494f0b3 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:32.611563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb73d7e-478e-47de-abb0-4d8c078af4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:32.612225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb73d7e-478e-47de-abb0-4d8c078af4fa None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:32.612520 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb73d7e-478e-47de-abb0-4d8c078af4fa None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:32.612810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb73d7e-478e-47de-abb0-4d8c078af4fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:32.621886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0d10c-d0e6-4bcf-ab48-3388eae290b1 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:32.661114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b032c49-51ac-47de-a9d0-fa3ef167e07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:32.662671 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b032c49-51ac-47de-a9d0-fa3ef167e07c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:32.663141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b032c49-51ac-47de-a9d0-fa3ef167e07c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:32.663627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:32.664359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b032c49-51ac-47de-a9d0-fa3ef167e07c None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:32.665363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b032c49-51ac-47de-a9d0-fa3ef167e07c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:32.665855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b032c49-51ac-47de-a9d0-fa3ef167e07c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:32.668440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b032c49-51ac-47de-a9d0-fa3ef167e07c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:32.681571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 322/630] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:32.683307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b032c49-51ac-47de-a9d0-fa3ef167e07c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:32.688435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb73d7e-478e-47de-abb0-4d8c078af4fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:32.690664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb73d7e-478e-47de-abb0-4d8c078af4fa None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:32.759708 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:32.817210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 309/631] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:40:32.818809 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1b39-b8df-4ef0-a662-63ba0b3f5fb2 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:32.819175 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1b39-b8df-4ef0-a662-63ba0b3f5fb2 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:32.819535 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1b39-b8df-4ef0-a662-63ba0b3f5fb2 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:32.820862 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b032c49-51ac-47de-a9d0-fa3ef167e07c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:32.825024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 310/632] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:32.825024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba1b39-b8df-4ef0-a662-63ba0b3f5fb2 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:32.863959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb03ab9-f1a9-45ee-8cab-ddb4f3c319c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:32.864567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb03ab9-f1a9-45ee-8cab-ddb4f3c319c1 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:32.864911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb03ab9-f1a9-45ee-8cab-ddb4f3c319c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:32.865121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb03ab9-f1a9-45ee-8cab-ddb4f3c319c1 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:32.865875 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb03ab9-f1a9-45ee-8cab-ddb4f3c319c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:32.866198 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb03ab9-f1a9-45ee-8cab-ddb4f3c319c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:32.867625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb03ab9-f1a9-45ee-8cab-ddb4f3c319c1 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:32.882400 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 323/633] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:32.882400 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb03ab9-f1a9-45ee-8cab-ddb4f3c319c1 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:32.932153 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:32.952116 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba1b39-b8df-4ef0-a662-63ba0b3f5fb2 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:32.994761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a995b3-e09d-45c7-b7a1-b440113577a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:32.995848 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a995b3-e09d-45c7-b7a1-b440113577a3 None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:32.996193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a995b3-e09d-45c7-b7a1-b440113577a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:32.996474 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a995b3-e09d-45c7-b7a1-b440113577a3 None admin] PATH_INFO: `/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/799058a415e44194a50697841b410062/roles/30112fca4d6549a790f2eadf20635343` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:33.000206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb03ab9-f1a9-45ee-8cab-ddb4f3c319c1 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:33.016976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a995b3-e09d-45c7-b7a1-b440113577a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=400421f9ccc6478783fa6bbc822b0687, user_id=799058a415e44194a50697841b410062, role_id=30112fca4d6549a790f2eadf20635343)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:33.018811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a995b3-e09d-45c7-b7a1-b440113577a3 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:33.019255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:33.036793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33462e-75c5-4d30-bad2-a4f84f91741c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:33.037602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33462e-75c5-4d30-bad2-a4f84f91741c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:33.037890 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33462e-75c5-4d30-bad2-a4f84f91741c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:33.041855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33462e-75c5-4d30-bad2-a4f84f91741c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:33.049923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33462e-75c5-4d30-bad2-a4f84f91741c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:33.051426 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33462e-75c5-4d30-bad2-a4f84f91741c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:33.069788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-eb33462e-75c5-4d30-bad2-a4f84f91741c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:33.069788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:33.069788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:33.069788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:33.069788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:33.069788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:33.069788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:33.069788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:33.069788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:33.069788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:33.069788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:33.069788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:33.069788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:33.069788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:33.069788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:33.071227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:33.072130 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:33.072130 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:33.072130 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:33.072130 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:33.072130 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 324/634] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:33.072416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdb0fc-da4d-4f01-83cb-a1d797e7d899 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:33.072892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdb0fc-da4d-4f01-83cb-a1d797e7d899 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:33.072892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdb0fc-da4d-4f01-83cb-a1d797e7d899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:33.090285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-30cdb0fc-da4d-4f01-83cb-a1d797e7d899 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:33.091258 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-30cdb0fc-da4d-4f01-83cb-a1d797e7d899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:33.098280 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 311/635] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:40:32 2022] PUT /identity/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/799058a415e44194a50697841b410062/roles/30112fca4d6549a790f2eadf20635343 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:40:33.110819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a995b3-e09d-45c7-b7a1-b440113577a3 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:33.198727 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 325/636] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:33.198727 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdb0fc-da4d-4f01-83cb-a1d797e7d899 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:33.273910 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a995b3-e09d-45c7-b7a1-b440113577a3 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:33.314020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:33.320618 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993eb00-ba59-4b4d-ac99-82ffa34d2759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:33.321427 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993eb00-ba59-4b4d-ac99-82ffa34d2759 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:33.324306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993eb00-ba59-4b4d-ac99-82ffa34d2759 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:33.324306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993eb00-ba59-4b4d-ac99-82ffa34d2759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:33.335074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:33.337458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdb0fc-da4d-4f01-83cb-a1d797e7d899 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:33.337726 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993eb00-ba59-4b4d-ac99-82ffa34d2759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:33.341048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993eb00-ba59-4b4d-ac99-82ffa34d2759 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:33.362607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-6993eb00-ba59-4b4d-ac99-82ffa34d2759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:33.362607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:33.362607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:33.362607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:33.362607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:33.362607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:33.362607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:33.362607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:33.362607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:33.362607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:33.362607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:33.362607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:33.362607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:33.362607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:33.362607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:33.363579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:33.364526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:33.364526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:33.364526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:33.364526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:33.366616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 312/637] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:33.367791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993eb00-ba59-4b4d-ac99-82ffa34d2759 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:33.389645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7a707-2f14-4225-b519-bcc143ba4915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:33.390391 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7a707-2f14-4225-b519-bcc143ba4915 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:33.392415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7a707-2f14-4225-b519-bcc143ba4915 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:33.392415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7a707-2f14-4225-b519-bcc143ba4915 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:33.392415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7a707-2f14-4225-b519-bcc143ba4915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:33.392415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7a707-2f14-4225-b519-bcc143ba4915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:33.393876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7a707-2f14-4225-b519-bcc143ba4915 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:33.411303 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 326/638] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:33.412236 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7a707-2f14-4225-b519-bcc143ba4915 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:33.487633 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993eb00-ba59-4b4d-ac99-82ffa34d2759 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:33.529270 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b685498-c7d8-48be-b64f-6436b92724d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:33.530653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b685498-c7d8-48be-b64f-6436b92724d3 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:33.531200 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b685498-c7d8-48be-b64f-6436b92724d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:33.531691 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b685498-c7d8-48be-b64f-6436b92724d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:33.533119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7a707-2f14-4225-b519-bcc143ba4915 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:33.544783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b685498-c7d8-48be-b64f-6436b92724d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-8b685498-c7d8-48be-b64f-6436b92724d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:33.553325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:33.554398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:33.555277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:33.555277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:33.555277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:33.555277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:33.555277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:33.555277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:33.555277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:33.555277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:33.555277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:33.555277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:33.555277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:33.555277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:33.555277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 313/639] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:33.556006 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b685498-c7d8-48be-b64f-6436b92724d3 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:33.578350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d754fc-caad-4a50-8784-0faa610d28c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:33.579066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d754fc-caad-4a50-8784-0faa610d28c3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:33.579351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d754fc-caad-4a50-8784-0faa610d28c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:33.579627 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d754fc-caad-4a50-8784-0faa610d28c3 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:33.580357 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d754fc-caad-4a50-8784-0faa610d28c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:33.580664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d754fc-caad-4a50-8784-0faa610d28c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:33.582037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d754fc-caad-4a50-8784-0faa610d28c3 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:33.601189 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 327/640] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:33.601189 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71667b-d816-4419-a79a-d943446b1885 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:33.601189 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71667b-d816-4419-a79a-d943446b1885 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:33.601189 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71667b-d816-4419-a79a-d943446b1885 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:33.601189 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 328/641] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:33.601189 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71667b-d816-4419-a79a-d943446b1885 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:33.623755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:33.626951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:33.695749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b685498-c7d8-48be-b64f-6436b92724d3 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:33.718291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71667b-d816-4419-a79a-d943446b1885 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:33.740925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121c848-5f86-4368-a254-9d13c1a99aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:33.742047 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121c848-5f86-4368-a254-9d13c1a99aee None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:33.742484 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121c848-5f86-4368-a254-9d13c1a99aee None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:33.742971 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121c848-5f86-4368-a254-9d13c1a99aee None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:33.752647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121c848-5f86-4368-a254-9d13c1a99aee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:33.754771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121c848-5f86-4368-a254-9d13c1a99aee None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:33.755724 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c91ed5-9eaa-4733-a43a-2cf7d0d64630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:33.756503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c91ed5-9eaa-4733-a43a-2cf7d0d64630 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:33.756851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c91ed5-9eaa-4733-a43a-2cf7d0d64630 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:33.757229 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c91ed5-9eaa-4733-a43a-2cf7d0d64630 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:33.758068 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c91ed5-9eaa-4733-a43a-2cf7d0d64630 None admin] RBAC: Adding query filter params (name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:33.758473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c91ed5-9eaa-4733-a43a-2cf7d0d64630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:33.759905 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c91ed5-9eaa-4733-a43a-2cf7d0d64630 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:33.774392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 329/642] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:33.774392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c91ed5-9eaa-4733-a43a-2cf7d0d64630 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:33.774739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-a121c848-5f86-4368-a254-9d13c1a99aee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:33.774739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:33.774739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:33.774739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:33.774739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:33.774739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:33.774739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:33.774739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:33.774739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:33.774739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:33.774739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:33.774739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:33.774739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:33.774739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:33.774739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:33.776536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:33.777968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:33.777968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:33.777968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:33.777968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:33.777968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:33.777968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:33.777968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:33.777968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:33.781982 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 314/643] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:33.783670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99972592-7646-47ba-b56f-d80d41056c66 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:33.784052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99972592-7646-47ba-b56f-d80d41056c66 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:33.784410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99972592-7646-47ba-b56f-d80d41056c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:33.804013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-99972592-7646-47ba-b56f-d80d41056c66 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:33.805422 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-99972592-7646-47ba-b56f-d80d41056c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:33.873914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:33.886392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 315/644] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:33.886392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99972592-7646-47ba-b56f-d80d41056c66 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:33.910442 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c91ed5-9eaa-4733-a43a-2cf7d0d64630 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:33.944344 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:33.951487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197f74b-a68e-40d9-bb01-ff784a3b6ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:33.952881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197f74b-a68e-40d9-bb01-ff784a3b6ac8 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:33.953472 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197f74b-a68e-40d9-bb01-ff784a3b6ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:33.954124 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197f74b-a68e-40d9-bb01-ff784a3b6ac8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:33.962816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197f74b-a68e-40d9-bb01-ff784a3b6ac8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:33.964842 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197f74b-a68e-40d9-bb01-ff784a3b6ac8 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-c197f74b-a68e-40d9-bb01-ff784a3b6ac8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:33.979886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:33.981285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:33.982933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:33.982933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:33.982933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:33.982933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:33.982933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:33.982933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:33.982933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:33.982933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:33.982933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 19:40:33.982933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:33.982933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 330/645] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:33.982933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197f74b-a68e-40d9-bb01-ff784a3b6ac8 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:34.034930 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99972592-7646-47ba-b56f-d80d41056c66 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:34.074455 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebaa7b6-4549-4a13-88a6-6d5f54f55882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:34.075357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebaa7b6-4549-4a13-88a6-6d5f54f55882 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:34.075648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebaa7b6-4549-4a13-88a6-6d5f54f55882 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:34.075926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebaa7b6-4549-4a13-88a6-6d5f54f55882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:34.087053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebaa7b6-4549-4a13-88a6-6d5f54f55882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:34.089258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebaa7b6-4549-4a13-88a6-6d5f54f55882 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:34.096573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197f74b-a68e-40d9-bb01-ff784a3b6ac8 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:34.109563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-5ebaa7b6-4549-4a13-88a6-6d5f54f55882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:34.109563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:34.109563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:34.109563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:34.109563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:34.109563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:34.109563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:34.109563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:34.109563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:34.109563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:34.109563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:34.109563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:34.109563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:34.109563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:34.109563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:34.111020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:34.113050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:34.113050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:34.113050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:34.113050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:34.113050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 316/646] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:34.116016 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebaa7b6-4549-4a13-88a6-6d5f54f55882 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:34.138931 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f79ef-3c16-45fe-bf43-68ea2e2d05bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:34.139521 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f79ef-3c16-45fe-bf43-68ea2e2d05bd None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:34.139809 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f79ef-3c16-45fe-bf43-68ea2e2d05bd None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:34.140093 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f79ef-3c16-45fe-bf43-68ea2e2d05bd None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:34.140886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f79ef-3c16-45fe-bf43-68ea2e2d05bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:34.141203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f79ef-3c16-45fe-bf43-68ea2e2d05bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:34.142689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f79ef-3c16-45fe-bf43-68ea2e2d05bd None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:34.162710 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 331/647] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:34.162710 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f79ef-3c16-45fe-bf43-68ea2e2d05bd None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:34.165541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:34.214176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:34.233445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebaa7b6-4549-4a13-88a6-6d5f54f55882 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:34.278475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c0ece-4c5b-494c-af08-29eaaa0e1467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:34.279116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f79ef-3c16-45fe-bf43-68ea2e2d05bd None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:34.279522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c0ece-4c5b-494c-af08-29eaaa0e1467 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:34.279884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c0ece-4c5b-494c-af08-29eaaa0e1467 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:34.280305 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080c0ece-4c5b-494c-af08-29eaaa0e1467 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:34.294451 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080c0ece-4c5b-494c-af08-29eaaa0e1467 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-080c0ece-4c5b-494c-af08-29eaaa0e1467 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:34.304282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:34.305450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:34.306503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:34.306503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:34.306503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:34.306503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:34.306503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:34.306503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:34.306503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:34.306503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:34.306503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:34.306503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:34.306503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:34.306503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:34.306503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 317/648] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:34.308650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c0ece-4c5b-494c-af08-29eaaa0e1467 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:34.323663 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a5158-ea03-4a27-8d26-b7d3329d1de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:34.324463 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5158-ea03-4a27-8d26-b7d3329d1de0 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:34.324815 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5158-ea03-4a27-8d26-b7d3329d1de0 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:34.325145 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a5158-ea03-4a27-8d26-b7d3329d1de0 None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:34.326300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a5158-ea03-4a27-8d26-b7d3329d1de0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:34.326656 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a5158-ea03-4a27-8d26-b7d3329d1de0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:34.328415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a5158-ea03-4a27-8d26-b7d3329d1de0 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:34.350359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 332/649] 10.222.0.15 () {56 vars in 1137 bytes} [Fri May 27 19:40:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:34.351354 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a5158-ea03-4a27-8d26-b7d3329d1de0 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:34.429504 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:34.441962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080c0ece-4c5b-494c-af08-29eaaa0e1467 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:34.481994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a5158-ea03-4a27-8d26-b7d3329d1de0 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:34.483472 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c93cb7-ee40-416a-a0a8-0c80a7b712dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:34.484343 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c93cb7-ee40-416a-a0a8-0c80a7b712dd None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:34.484653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c93cb7-ee40-416a-a0a8-0c80a7b712dd None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:34.485034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c93cb7-ee40-416a-a0a8-0c80a7b712dd None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:34.486030 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c93cb7-ee40-416a-a0a8-0c80a7b712dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:34.486369 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c93cb7-ee40-416a-a0a8-0c80a7b712dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:34.487854 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c93cb7-ee40-416a-a0a8-0c80a7b712dd None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:34.505495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 318/650] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:34.505495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c93cb7-ee40-416a-a0a8-0c80a7b712dd None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:34.515530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:34.525132 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0a428-e33f-4e95-b4a3-372eb2d456d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:34.525801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a428-e33f-4e95-b4a3-372eb2d456d4 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:34.527504 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a428-e33f-4e95-b4a3-372eb2d456d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:34.527504 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a428-e33f-4e95-b4a3-372eb2d456d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:34.527816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0a428-e33f-4e95-b4a3-372eb2d456d4 None admin] RBAC: Adding query filter params (role.id=30112fca4d6549a790f2eadf20635343, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=105353b6b1a941ac81df7ad35567ba7c) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:34.528141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0a428-e33f-4e95-b4a3-372eb2d456d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:34.529589 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0a428-e33f-4e95-b4a3-372eb2d456d4 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:34.535660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 333/651] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:40:34 2022] GET /identity/v3/role_assignments?user.id=105353b6b1a941ac81df7ad35567ba7c&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=30112fca4d6549a790f2eadf20635343 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:34.536455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0a428-e33f-4e95-b4a3-372eb2d456d4 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:34.638094 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c93cb7-ee40-416a-a0a8-0c80a7b712dd None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:34.683771 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0a428-e33f-4e95-b4a3-372eb2d456d4 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:34.685919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d5cf5-3569-42b7-8415-6accedfaf61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:34.687977 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d5cf5-3569-42b7-8415-6accedfaf61c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:34.688530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d5cf5-3569-42b7-8415-6accedfaf61c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:34.689017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d5cf5-3569-42b7-8415-6accedfaf61c None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:34.689990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d5cf5-3569-42b7-8415-6accedfaf61c None admin] RBAC: Adding query filter params (name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:34.690570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d5cf5-3569-42b7-8415-6accedfaf61c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:34.692929 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d5cf5-3569-42b7-8415-6accedfaf61c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:34.705934 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 319/652] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:34.707671 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d5cf5-3569-42b7-8415-6accedfaf61c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:34.717254 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:34.731773 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19fa8a-bf60-4601-bf61-fcc90642634d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:34.732586 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19fa8a-bf60-4601-bf61-fcc90642634d None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:34.732866 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19fa8a-bf60-4601-bf61-fcc90642634d None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:34.733145 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19fa8a-bf60-4601-bf61-fcc90642634d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:34.801164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:34.835533 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19fa8a-bf60-4601-bf61-fcc90642634d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:34.837730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f19fa8a-bf60-4601-bf61-fcc90642634d None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:34.849215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d5cf5-3569-42b7-8415-6accedfaf61c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:34.897323 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aed9e9-ae7f-40ff-9f2d-417f8a73943b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:34.898126 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aed9e9-ae7f-40ff-9f2d-417f8a73943b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:34.898437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aed9e9-ae7f-40ff-9f2d-417f8a73943b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:34.898713 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aed9e9-ae7f-40ff-9f2d-417f8a73943b None admin] PATH_INFO: `/v3/users/glance` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:34.908052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aed9e9-ae7f-40ff-9f2d-417f8a73943b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:34.909877 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aed9e9-ae7f-40ff-9f2d-417f8a73943b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-62aed9e9-ae7f-40ff-9f2d-417f8a73943b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:34.926820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:34.928844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:34.931205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:34.931205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:34.931205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:34.931205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:34.931205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:34.931205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:34.931205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:34.931205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:34.931205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 19:40:34.931205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:34.931205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 320/653] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:34.932668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aed9e9-ae7f-40ff-9f2d-417f8a73943b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:35.008047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 334/654] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:40:35.009843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19fa8a-bf60-4601-bf61-fcc90642634d None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:35.043596 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:35.068177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aed9e9-ae7f-40ff-9f2d-417f8a73943b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:35.100149 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:35.109169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cec00-5292-4fc7-9790-a63591ce69a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:35.110293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cec00-5292-4fc7-9790-a63591ce69a2 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:35.111908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cec00-5292-4fc7-9790-a63591ce69a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:35.111908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065cec00-5292-4fc7-9790-a63591ce69a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:35.125570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cec00-5292-4fc7-9790-a63591ce69a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:35.127459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065cec00-5292-4fc7-9790-a63591ce69a2 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:35.144324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19fa8a-bf60-4601-bf61-fcc90642634d None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:35.147330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-065cec00-5292-4fc7-9790-a63591ce69a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:35.147330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:35.147330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:35.147330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:35.147330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:35.147330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:35.147330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:35.147330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:35.147330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:35.147330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:35.147330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:35.147330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:35.147330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:35.147330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:35.147330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:35.148397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:35.149454 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:35.149454 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:35.149454 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:35.149454 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:35.156153 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 321/655] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:35.157347 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cec00-5292-4fc7-9790-a63591ce69a2 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:35.190940 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3f12f-4d49-4305-96cd-d23270fc0f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:35.192053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3f12f-4d49-4305-96cd-d23270fc0f99 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:35.192347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3f12f-4d49-4305-96cd-d23270fc0f99 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:35.192633 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3f12f-4d49-4305-96cd-d23270fc0f99 None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:35.193767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3f12f-4d49-4305-96cd-d23270fc0f99 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:35.194086 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3f12f-4d49-4305-96cd-d23270fc0f99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:35.196211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3f12f-4d49-4305-96cd-d23270fc0f99 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:35.287711 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065cec00-5292-4fc7-9790-a63591ce69a2 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:35.328947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03ffdb-e4ed-4a1d-bd3c-79fc6fef3b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:35.329824 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03ffdb-e4ed-4a1d-bd3c-79fc6fef3b31 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:35.330117 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03ffdb-e4ed-4a1d-bd3c-79fc6fef3b31 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:35.330432 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03ffdb-e4ed-4a1d-bd3c-79fc6fef3b31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:35.343027 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03ffdb-e4ed-4a1d-bd3c-79fc6fef3b31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:35.344507 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03ffdb-e4ed-4a1d-bd3c-79fc6fef3b31 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:35.354493 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 335/656] 10.222.0.15 () {56 vars in 1137 bytes} [Fri May 27 19:40:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:35.354493 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3f12f-4d49-4305-96cd-d23270fc0f99 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:35.371386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-8d03ffdb-e4ed-4a1d-bd3c-79fc6fef3b31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:35.371386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:35.371386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:35.371386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:35.371386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:35.371386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:35.371386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:35.371386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:35.371386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:35.371386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:35.371386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:35.371386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:35.371386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:35.371386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:35.371386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:35.372656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:35.373834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:35.373834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:35.373834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:35.373834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:35.377407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 322/657] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:35.378358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03ffdb-e4ed-4a1d-bd3c-79fc6fef3b31 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:35.413478 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:35.461745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:35.483992 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3f12f-4d49-4305-96cd-d23270fc0f99 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:35.502800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03ffdb-e4ed-4a1d-bd3c-79fc6fef3b31 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:35.520923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900266a3-134a-43e7-9141-dd038ab432cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:35.521600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900266a3-134a-43e7-9141-dd038ab432cf None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:35.521884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900266a3-134a-43e7-9141-dd038ab432cf None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:35.522161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900266a3-134a-43e7-9141-dd038ab432cf None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:35.522986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900266a3-134a-43e7-9141-dd038ab432cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:35.523237 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900266a3-134a-43e7-9141-dd038ab432cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:35.524718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900266a3-134a-43e7-9141-dd038ab432cf None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:35.541108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45652d8-0273-4b39-b61f-5da1095c6194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:35.541333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 336/658] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:35.542493 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900266a3-134a-43e7-9141-dd038ab432cf None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:35.542709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45652d8-0273-4b39-b61f-5da1095c6194 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:35.543005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45652d8-0273-4b39-b61f-5da1095c6194 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:35.543322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45652d8-0273-4b39-b61f-5da1095c6194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:35.626992 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45652d8-0273-4b39-b61f-5da1095c6194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:35.628590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45652d8-0273-4b39-b61f-5da1095c6194 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:35.652688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900266a3-134a-43e7-9141-dd038ab432cf None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:35.661061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:35.690097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3889f0c-2d10-48f6-a66e-e33cf374241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:35.690786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3889f0c-2d10-48f6-a66e-e33cf374241c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:35.691070 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3889f0c-2d10-48f6-a66e-e33cf374241c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:35.691572 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3889f0c-2d10-48f6-a66e-e33cf374241c None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:35.692059 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3889f0c-2d10-48f6-a66e-e33cf374241c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:35.692363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3889f0c-2d10-48f6-a66e-e33cf374241c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:35.693801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3889f0c-2d10-48f6-a66e-e33cf374241c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:35.711075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 337/659] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:35.711075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414c48b-38b8-4173-9c3a-02af23784236 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:35.711075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414c48b-38b8-4173-9c3a-02af23784236 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:35.711075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1414c48b-38b8-4173-9c3a-02af23784236 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:35.711075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 338/660] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:35.711075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414c48b-38b8-4173-9c3a-02af23784236 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:35.719659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:35.748124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 323/661] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:40:35.748124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45652d8-0273-4b39-b61f-5da1095c6194 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:35.821794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1414c48b-38b8-4173-9c3a-02af23784236 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:35.863313 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45652d8-0273-4b39-b61f-5da1095c6194 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:35.863750 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7167e6-30e4-41cd-8f7d-a4e7bad11b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:35.864568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7167e6-30e4-41cd-8f7d-a4e7bad11b5e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:35.864973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7167e6-30e4-41cd-8f7d-a4e7bad11b5e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:35.865268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7167e6-30e4-41cd-8f7d-a4e7bad11b5e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:35.872834 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7167e6-30e4-41cd-8f7d-a4e7bad11b5e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:35.874347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7167e6-30e4-41cd-8f7d-a4e7bad11b5e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-4a7167e6-30e4-41cd-8f7d-a4e7bad11b5e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:35.889272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:35.890302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:35.891316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:35.891316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:35.891316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:35.891316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:35.891316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:35.891316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:35.891316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:35.891316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:35.891316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 19:40:35.891316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:35.891316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 339/662] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:35.891923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0956b94-a165-4467-ad05-73d70b6ae772 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:35.892001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0956b94-a165-4467-ad05-73d70b6ae772 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:35.892629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0956b94-a165-4467-ad05-73d70b6ae772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:35.902156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:35.907733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8b51-908c-4e6d-828f-aa229394b47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:35.908558 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8b51-908c-4e6d-828f-aa229394b47a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:35.908850 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8b51-908c-4e6d-828f-aa229394b47a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:35.909134 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8b51-908c-4e6d-828f-aa229394b47a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:35.912393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-b0956b94-a165-4467-ad05-73d70b6ae772 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:35.913599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b0956b94-a165-4467-ad05-73d70b6ae772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:35.917584 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8b51-908c-4e6d-828f-aa229394b47a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:35.923943 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8b51-908c-4e6d-828f-aa229394b47a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:35.934052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-540a8b51-908c-4e6d-828f-aa229394b47a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:35.934052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:35.934052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:35.934052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:35.934052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:35.934052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:35.934052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:35.934052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:35.934052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:35.934052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:35.934052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:35.934052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:35.934052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:35.934052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:35.934052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:35.940488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:35.941458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:35.941458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:35.941458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:35.941458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:35.941458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:35.941458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:35.941458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:35.941458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:35.941458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 324/663] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:35.941458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8b51-908c-4e6d-828f-aa229394b47a None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:35.983978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:35.995682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 340/664] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:35.996823 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0956b94-a165-4467-ad05-73d70b6ae772 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:36.066658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8b51-908c-4e6d-828f-aa229394b47a None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:36.101766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997d29b-f67c-48d9-885b-faf2c2675ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:36.102511 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997d29b-f67c-48d9-885b-faf2c2675ffe None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:36.102810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997d29b-f67c-48d9-885b-faf2c2675ffe None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:36.103090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997d29b-f67c-48d9-885b-faf2c2675ffe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:36.107565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0956b94-a165-4467-ad05-73d70b6ae772 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:36.115753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997d29b-f67c-48d9-885b-faf2c2675ffe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:36.118463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997d29b-f67c-48d9-885b-faf2c2675ffe None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:36.142277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-c997d29b-f67c-48d9-885b-faf2c2675ffe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:36.142277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:36.142277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:36.142277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:36.142277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:36.142277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:36.142277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:36.142277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:36.142277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:36.142277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:36.142277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:36.142277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:36.142277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:36.142277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:36.142277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:36.143260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:36.144680 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:36.144680 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:36.144680 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:36.144680 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:36.144680 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 325/665] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:36.145210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997d29b-f67c-48d9-885b-faf2c2675ffe None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:36.150249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f65f49-5410-482f-b517-2115418ab718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:36.151585 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f65f49-5410-482f-b517-2115418ab718 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:36.151880 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f65f49-5410-482f-b517-2115418ab718 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:36.152984 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f65f49-5410-482f-b517-2115418ab718 None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:36.153107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f65f49-5410-482f-b517-2115418ab718 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:36.153420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f65f49-5410-482f-b517-2115418ab718 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:36.154905 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f65f49-5410-482f-b517-2115418ab718 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:36.176320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 341/666] 10.222.0.15 () {56 vars in 1139 bytes} [Fri May 27 19:40:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:36.177211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f65f49-5410-482f-b517-2115418ab718 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:36.207484 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:36.231934 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:36.274074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997d29b-f67c-48d9-885b-faf2c2675ffe None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:36.293272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f65f49-5410-482f-b517-2115418ab718 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:36.314684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8393b-972e-449e-a8d9-18d21e3dda07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:36.315370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8393b-972e-449e-a8d9-18d21e3dda07 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:36.316095 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8393b-972e-449e-a8d9-18d21e3dda07 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:36.316388 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8393b-972e-449e-a8d9-18d21e3dda07 None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:36.317324 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8393b-972e-449e-a8d9-18d21e3dda07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:36.317650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8393b-972e-449e-a8d9-18d21e3dda07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:36.319125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8393b-972e-449e-a8d9-18d21e3dda07 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:36.331791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529003c2-db9d-42b1-90ef-c679158a4bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:36.331981 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 326/667] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:36.332678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8393b-972e-449e-a8d9-18d21e3dda07 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:36.333097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529003c2-db9d-42b1-90ef-c679158a4bfa None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:36.333390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529003c2-db9d-42b1-90ef-c679158a4bfa None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:36.333673 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529003c2-db9d-42b1-90ef-c679158a4bfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:36.356680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529003c2-db9d-42b1-90ef-c679158a4bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-529003c2-db9d-42b1-90ef-c679158a4bfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:36.366832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:36.368003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:36.368952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:36.368952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:36.368952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:36.368952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:36.368952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:36.368952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:36.368952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:36.368952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:36.368952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:36.368952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:36.368952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:36.368952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:36.368952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 342/668] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:36.370031 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529003c2-db9d-42b1-90ef-c679158a4bfa None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:36.456665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8393b-972e-449e-a8d9-18d21e3dda07 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:36.459598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:36.488164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529003c2-db9d-42b1-90ef-c679158a4bfa None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:36.492604 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2014e58-9ca9-461e-8f06-dd7876146b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:36.493283 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2014e58-9ca9-461e-8f06-dd7876146b9c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:36.493575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2014e58-9ca9-461e-8f06-dd7876146b9c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:36.493862 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2014e58-9ca9-461e-8f06-dd7876146b9c None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:36.495318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2014e58-9ca9-461e-8f06-dd7876146b9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:36.495635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2014e58-9ca9-461e-8f06-dd7876146b9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:36.497017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2014e58-9ca9-461e-8f06-dd7876146b9c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:36.500059 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:36.510514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 327/669] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:36.511380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2014e58-9ca9-461e-8f06-dd7876146b9c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:36.530587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb7eae-d0b0-4ed6-8f87-9fdb90a7cd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:36.531256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb7eae-d0b0-4ed6-8f87-9fdb90a7cd93 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:36.531547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb7eae-d0b0-4ed6-8f87-9fdb90a7cd93 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:36.531838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb7eae-d0b0-4ed6-8f87-9fdb90a7cd93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:36.609599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb7eae-d0b0-4ed6-8f87-9fdb90a7cd93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:36.611131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb7eae-d0b0-4ed6-8f87-9fdb90a7cd93 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:36.629552 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2014e58-9ca9-461e-8f06-dd7876146b9c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:36.669808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf434e16-64b9-44d5-8414-1918721766e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:36.670780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf434e16-64b9-44d5-8414-1918721766e7 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:36.671205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf434e16-64b9-44d5-8414-1918721766e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:36.671570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf434e16-64b9-44d5-8414-1918721766e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:36.672621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf434e16-64b9-44d5-8414-1918721766e7 None admin] RBAC: Adding query filter params (role.id=30112fca4d6549a790f2eadf20635343, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=8a892d3f80464f9e9ced137c5de8bd60) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:36.673161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf434e16-64b9-44d5-8414-1918721766e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:36.675495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf434e16-64b9-44d5-8414-1918721766e7 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:36.690365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 328/670] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:40:36 2022] GET /identity/v3/role_assignments?user.id=8a892d3f80464f9e9ced137c5de8bd60&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=30112fca4d6549a790f2eadf20635343 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:36.690365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf434e16-64b9-44d5-8414-1918721766e7 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:36.723218 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:36.735471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 343/671] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:40:36.736481 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb7eae-d0b0-4ed6-8f87-9fdb90a7cd93 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:36.749797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:36.824665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf434e16-64b9-44d5-8414-1918721766e7 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:36.853128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb7eae-d0b0-4ed6-8f87-9fdb90a7cd93 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:36.873698 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6321f41-3120-453e-a502-8ebbd66cdfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:36.874729 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6321f41-3120-453e-a502-8ebbd66cdfc5 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:36.875091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6321f41-3120-453e-a502-8ebbd66cdfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:36.875464 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6321f41-3120-453e-a502-8ebbd66cdfc5 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:36.876392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6321f41-3120-453e-a502-8ebbd66cdfc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:36.876791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6321f41-3120-453e-a502-8ebbd66cdfc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:36.878845 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6321f41-3120-453e-a502-8ebbd66cdfc5 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:36.892308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 329/672] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:36.893195 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3df840-5c05-491f-8768-ce82600f6ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:36.893628 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6321f41-3120-453e-a502-8ebbd66cdfc5 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:36.894231 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3df840-5c05-491f-8768-ce82600f6ceb None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:36.894649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3df840-5c05-491f-8768-ce82600f6ceb None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:36.895028 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3df840-5c05-491f-8768-ce82600f6ceb None admin] PATH_INFO: `/v3/projects/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:36.903164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3df840-5c05-491f-8768-ce82600f6ceb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:36.904884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3df840-5c05-491f-8768-ce82600f6ceb None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:36.920988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-0a3df840-5c05-491f-8768-ce82600f6ceb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:36.920988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:36.920988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:36.920988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:36.920988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:36.920988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:36.920988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:36.920988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:36.920988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:36.920988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:36.920988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:36.920988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:36.920988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:36.920988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:36.920988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:36.922164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:36.923368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:36.923368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:36.923368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:36.923368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:36.923368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:36.923368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:36.923368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:36.923368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:36.929597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 344/673] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:36.930795 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3df840-5c05-491f-8768-ce82600f6ceb None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:37.022725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:37.034837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:37.052522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6321f41-3120-453e-a502-8ebbd66cdfc5 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:37.067850 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3df840-5c05-491f-8768-ce82600f6ceb None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:37.093120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bf118-984a-4811-9fc0-332f1a43bacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:37.093947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bf118-984a-4811-9fc0-332f1a43bacf None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:37.094240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bf118-984a-4811-9fc0-332f1a43bacf None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:37.094557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bf118-984a-4811-9fc0-332f1a43bacf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:37.105893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bf118-984a-4811-9fc0-332f1a43bacf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:37.107540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bf118-984a-4811-9fc0-332f1a43bacf None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:37.114151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cec859-4c2e-482f-899e-03ee5878e6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:37.115815 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec859-4c2e-482f-899e-03ee5878e6af None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:37.116261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec859-4c2e-482f-899e-03ee5878e6af None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:37.116690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec859-4c2e-482f-899e-03ee5878e6af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:37.127430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-c95bf118-984a-4811-9fc0-332f1a43bacf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:37.127430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:37.127430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:37.127430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:37.127430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:37.127430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:37.127430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:37.127430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:37.127430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:37.127430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:37.127430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:37.127430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:37.127430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:37.127430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:37.127430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:37.128403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:37.129541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:37.129541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:37.129541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:37.129541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:37.129541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 330/674] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:37.130178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bf118-984a-4811-9fc0-332f1a43bacf None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:37.132342 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cec859-4c2e-482f-899e-03ee5878e6af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:37.135099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cec859-4c2e-482f-899e-03ee5878e6af None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:37.154464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-25cec859-4c2e-482f-899e-03ee5878e6af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:37.154464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:37.154464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:37.154464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:37.154464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:37.154464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:37.154464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:37.154464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:37.154464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:37.154464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:37.154464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:37.154464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:37.154464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:37.154464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:37.154464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:37.155451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:37.156360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:37.156360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:37.156360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:37.156360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:37.156360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 345/675] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:37.157319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b68f4-4faf-4e70-a451-5e1ca8b30ada None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:37.157319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b68f4-4faf-4e70-a451-5e1ca8b30ada None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:37.157481 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b68f4-4faf-4e70-a451-5e1ca8b30ada None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:37.162551 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 346/676] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:37.162551 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b68f4-4faf-4e70-a451-5e1ca8b30ada None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:37.247997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bf118-984a-4811-9fc0-332f1a43bacf None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:37.276402 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b68f4-4faf-4e70-a451-5e1ca8b30ada None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:37.286359 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35be75-7f37-439e-af11-b81b55ac4107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:37.287115 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35be75-7f37-439e-af11-b81b55ac4107 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:37.287560 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35be75-7f37-439e-af11-b81b55ac4107 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:37.287905 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35be75-7f37-439e-af11-b81b55ac4107 None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:37.288764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35be75-7f37-439e-af11-b81b55ac4107 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:37.289150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35be75-7f37-439e-af11-b81b55ac4107 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:37.290932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35be75-7f37-439e-af11-b81b55ac4107 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:37.301069 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:37.305487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 331/677] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:37.306361 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35be75-7f37-439e-af11-b81b55ac4107 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:37.309734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:37.318942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff94cf-522c-4166-ae9a-e389d98d426b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:37.319627 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff94cf-522c-4166-ae9a-e389d98d426b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:37.319918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff94cf-522c-4166-ae9a-e389d98d426b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:37.320203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff94cf-522c-4166-ae9a-e389d98d426b None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:37.320951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff94cf-522c-4166-ae9a-e389d98d426b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:37.321256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff94cf-522c-4166-ae9a-e389d98d426b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:37.323342 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff94cf-522c-4166-ae9a-e389d98d426b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:37.337748 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 347/678] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:37.339358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707b1de-a3be-4158-96de-5f74a8878497 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:37.339688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707b1de-a3be-4158-96de-5f74a8878497 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:37.340001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707b1de-a3be-4158-96de-5f74a8878497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:37.358017 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-1707b1de-a3be-4158-96de-5f74a8878497 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:37.359254 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-1707b1de-a3be-4158-96de-5f74a8878497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:37.432545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35be75-7f37-439e-af11-b81b55ac4107 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:37.447155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 348/679] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:37.448891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707b1de-a3be-4158-96de-5f74a8878497 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:37.482048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064bf872-9ed0-4e22-bf79-f115728af81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:37.483020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bf872-9ed0-4e22-bf79-f115728af81a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:37.483317 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bf872-9ed0-4e22-bf79-f115728af81a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:37.483602 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bf872-9ed0-4e22-bf79-f115728af81a None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:37.484591 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064bf872-9ed0-4e22-bf79-f115728af81a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:37.484909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064bf872-9ed0-4e22-bf79-f115728af81a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:37.487012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064bf872-9ed0-4e22-bf79-f115728af81a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:37.502192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 332/680] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:37.503307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064bf872-9ed0-4e22-bf79-f115728af81a None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:37.570841 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707b1de-a3be-4158-96de-5f74a8878497 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:37.571069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:37.585090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:37.607860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ca739-ab7a-403b-b3c2-57c2ddffa1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:37.608661 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ca739-ab7a-403b-b3c2-57c2ddffa1d3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:37.608878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ca739-ab7a-403b-b3c2-57c2ddffa1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:37.609163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ca739-ab7a-403b-b3c2-57c2ddffa1d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:37.609998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ca739-ab7a-403b-b3c2-57c2ddffa1d3 None admin] RBAC: Adding query filter params (role.id=30112fca4d6549a790f2eadf20635343, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=cc2b57ae83164912a4e23dda9dc239f4) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:37.610320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ca739-ab7a-403b-b3c2-57c2ddffa1d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:37.611890 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ca739-ab7a-403b-b3c2-57c2ddffa1d3 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:37.615398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064bf872-9ed0-4e22-bf79-f115728af81a None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:37.622381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 349/681] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:40:37 2022] GET /identity/v3/role_assignments?user.id=cc2b57ae83164912a4e23dda9dc239f4&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=30112fca4d6549a790f2eadf20635343 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:37.622381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ca739-ab7a-403b-b3c2-57c2ddffa1d3 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:37.667575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c128b-18dd-4735-9271-fc2a63619d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:37.668974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c128b-18dd-4735-9271-fc2a63619d8d None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:37.669573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c128b-18dd-4735-9271-fc2a63619d8d None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:37.670173 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c128b-18dd-4735-9271-fc2a63619d8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:37.678693 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c128b-18dd-4735-9271-fc2a63619d8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:37.680392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c128b-18dd-4735-9271-fc2a63619d8d None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:37.696561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-782c128b-18dd-4735-9271-fc2a63619d8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:37.696561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:37.696561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:37.696561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:37.696561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:37.696561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:37.696561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:37.696561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:37.696561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:37.696561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:37.696561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:37.696561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:37.696561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:37.696561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:37.696561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:37.697568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:37.698787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:37.698787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:37.698787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:37.698787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:37.698787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:37.698787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:37.698787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:37.698787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:37.698787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 333/682] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:37.702298 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c128b-18dd-4735-9271-fc2a63619d8d None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:37.759207 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ca739-ab7a-403b-b3c2-57c2ddffa1d3 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:37.800341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d2fae-b65c-43be-86b6-39cac3964de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:37.801169 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d2fae-b65c-43be-86b6-39cac3964de7 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:37.801459 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d2fae-b65c-43be-86b6-39cac3964de7 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:37.801830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d2fae-b65c-43be-86b6-39cac3964de7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:37.815100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d2fae-b65c-43be-86b6-39cac3964de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:37.815723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c128b-18dd-4735-9271-fc2a63619d8d None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-e45d2fae-b65c-43be-86b6-39cac3964de7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:37.823853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:37.824883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:37.826146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:37.826146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:37.826146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:37.826146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:37.826146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:37.826146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:37.826146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:37.826146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:37.826146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:37.826146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:37.826146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:37.826146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:37.826146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 350/683] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:40:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:37.827216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d2fae-b65c-43be-86b6-39cac3964de7 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:37.850986 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:37.869764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df17961-b219-457a-a27d-3b5bab4834fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:37.870609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df17961-b219-457a-a27d-3b5bab4834fe None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:37.870957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df17961-b219-457a-a27d-3b5bab4834fe None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:37.871246 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df17961-b219-457a-a27d-3b5bab4834fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:37.879133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:37.881205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df17961-b219-457a-a27d-3b5bab4834fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:37.882701 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df17961-b219-457a-a27d-3b5bab4834fe None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-4df17961-b219-457a-a27d-3b5bab4834fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:37.904206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:37.905232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:37.906245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:37.906245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:37.906245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:37.906245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:37.906245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:37.906245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:37.906245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:37.906245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:37.906245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 19:40:37.906245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:37.906245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 334/684] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:40:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:37.906948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df17961-b219-457a-a27d-3b5bab4834fe None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:37.962732 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d2fae-b65c-43be-86b6-39cac3964de7 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:38.009708 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a2f6e-8b66-4c0e-9736-8bd0e53a15e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:38.010943 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a2f6e-8b66-4c0e-9736-8bd0e53a15e0 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:38.011230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a2f6e-8b66-4c0e-9736-8bd0e53a15e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:38.011510 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a2f6e-8b66-4c0e-9736-8bd0e53a15e0 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:38.012312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a2f6e-8b66-4c0e-9736-8bd0e53a15e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:38.012625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a2f6e-8b66-4c0e-9736-8bd0e53a15e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:38.014695 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a2f6e-8b66-4c0e-9736-8bd0e53a15e0 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:38.032343 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 351/685] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:38.033524 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a2f6e-8b66-4c0e-9736-8bd0e53a15e0 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:38.056904 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df17961-b219-457a-a27d-3b5bab4834fe None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:38.105572 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69f6d9-6dce-4b58-bf4c-bfd83cc74251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:38.106592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69f6d9-6dce-4b58-bf4c-bfd83cc74251 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:38.106889 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69f6d9-6dce-4b58-bf4c-bfd83cc74251 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:38.107175 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69f6d9-6dce-4b58-bf4c-bfd83cc74251 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:38.107964 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69f6d9-6dce-4b58-bf4c-bfd83cc74251 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:38.108289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69f6d9-6dce-4b58-bf4c-bfd83cc74251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:38.110138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69f6d9-6dce-4b58-bf4c-bfd83cc74251 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:38.121565 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 335/686] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:38.122819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69f6d9-6dce-4b58-bf4c-bfd83cc74251 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:38.163406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:38.171503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a2f6e-8b66-4c0e-9736-8bd0e53a15e0 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:38.183182 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:38.215357 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a2637-b503-464f-8964-ccf076ee5f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:38.216216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a2637-b503-464f-8964-ccf076ee5f76 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:38.216581 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a2637-b503-464f-8964-ccf076ee5f76 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:38.217072 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a2637-b503-464f-8964-ccf076ee5f76 None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:38.218301 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a2637-b503-464f-8964-ccf076ee5f76 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:38.218770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a2637-b503-464f-8964-ccf076ee5f76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:38.220984 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a2637-b503-464f-8964-ccf076ee5f76 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:38.250849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69f6d9-6dce-4b58-bf4c-bfd83cc74251 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:38.252259 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 352/687] 10.222.0.15 () {56 vars in 1135 bytes} [Fri May 27 19:40:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:38.253501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a2637-b503-464f-8964-ccf076ee5f76 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:38.303246 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19102ddd-29d6-4c6e-9742-e9df487c6f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:38.303994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19102ddd-29d6-4c6e-9742-e9df487c6f04 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:38.304360 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19102ddd-29d6-4c6e-9742-e9df487c6f04 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:38.304653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19102ddd-29d6-4c6e-9742-e9df487c6f04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:38.305636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19102ddd-29d6-4c6e-9742-e9df487c6f04 None admin] RBAC: Adding query filter params (role.id=30112fca4d6549a790f2eadf20635343, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=af7e51b89f4c4dcc9963061e6e509eb7) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:38.306582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19102ddd-29d6-4c6e-9742-e9df487c6f04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:38.309285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19102ddd-29d6-4c6e-9742-e9df487c6f04 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:38.320014 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 336/688] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:40:38 2022] GET /identity/v3/role_assignments?user.id=af7e51b89f4c4dcc9963061e6e509eb7&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=30112fca4d6549a790f2eadf20635343 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:38.321710 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19102ddd-29d6-4c6e-9742-e9df487c6f04 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:38.408756 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a2637-b503-464f-8964-ccf076ee5f76 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:38.493830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b8dd3-8ce9-435a-b5ec-acce72f2179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:38.495365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b8dd3-8ce9-435a-b5ec-acce72f2179d None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:38.495839 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b8dd3-8ce9-435a-b5ec-acce72f2179d None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:38.496118 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b8dd3-8ce9-435a-b5ec-acce72f2179d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:38.513092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b8dd3-8ce9-435a-b5ec-acce72f2179d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:38.514771 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b8dd3-8ce9-435a-b5ec-acce72f2179d None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:38.546634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19102ddd-29d6-4c6e-9742-e9df487c6f04 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:38.564120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-3f6b8dd3-8ce9-435a-b5ec-acce72f2179d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:38.564120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:38.564120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:38.564120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:38.564120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:38.564120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:38.564120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:38.564120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:38.564120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:38.564120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:38.564120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:38.564120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:38.564120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:38.564120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:38.564120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:38.565103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:38.565988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:38.565988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:38.565988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:38.565988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:38.566870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 353/689] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:38.570175 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:38.571967 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b8dd3-8ce9-435a-b5ec-acce72f2179d None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:38.584034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:38.604394 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2a79d-f872-41fb-8752-c14167c5079b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:38.605672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2a79d-f872-41fb-8752-c14167c5079b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:38.605672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2a79d-f872-41fb-8752-c14167c5079b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:38.606140 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2a79d-f872-41fb-8752-c14167c5079b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:38.692077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b8dd3-8ce9-435a-b5ec-acce72f2179d None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:38.704156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2a79d-f872-41fb-8752-c14167c5079b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:38.705967 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2a79d-f872-41fb-8752-c14167c5079b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:38.742014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0b893-8fc9-464d-9a18-0be5f0f9e991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:38.742014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0b893-8fc9-464d-9a18-0be5f0f9e991 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:38.742014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0b893-8fc9-464d-9a18-0be5f0f9e991 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:38.742014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0b893-8fc9-464d-9a18-0be5f0f9e991 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:38.742431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0b893-8fc9-464d-9a18-0be5f0f9e991 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:38.742431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0b893-8fc9-464d-9a18-0be5f0f9e991 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:38.742431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0b893-8fc9-464d-9a18-0be5f0f9e991 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:38.755950 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 354/690] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:38.764684 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0b893-8fc9-464d-9a18-0be5f0f9e991 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:38.825409 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 337/691] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:40:38.832232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2a79d-f872-41fb-8752-c14167c5079b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:38.846371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:38.866112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:38.907670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0b893-8fc9-464d-9a18-0be5f0f9e991 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:38.955168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c425da2-2b90-4d80-9990-a16b9bfeaae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:38.956114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c425da2-2b90-4d80-9990-a16b9bfeaae6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:38.956464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c425da2-2b90-4d80-9990-a16b9bfeaae6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:38.956746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c425da2-2b90-4d80-9990-a16b9bfeaae6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:38.974445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2a79d-f872-41fb-8752-c14167c5079b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:38.981507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c425da2-2b90-4d80-9990-a16b9bfeaae6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:38.983387 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c425da2-2b90-4d80-9990-a16b9bfeaae6 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-3c425da2-2b90-4d80-9990-a16b9bfeaae6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:39.021314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:39.022328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:39.024853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:39.024853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:39.024853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:39.024853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:39.024853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:39.024853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:39.024853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:39.024853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:39.024853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 19:40:39.024853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:39.024853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 355/692] 10.222.0.15 () {56 vars in 1093 bytes} [Fri May 27 19:40:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:39.036260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c425da2-2b90-4d80-9990-a16b9bfeaae6 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:39.050118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e18d6f-0d99-442e-96f2-748ebe996151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:39.051370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e18d6f-0d99-442e-96f2-748ebe996151 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:39.051881 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e18d6f-0d99-442e-96f2-748ebe996151 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:39.052406 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e18d6f-0d99-442e-96f2-748ebe996151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:39.065285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e18d6f-0d99-442e-96f2-748ebe996151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:39.067228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e18d6f-0d99-442e-96f2-748ebe996151 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:39.089779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-11e18d6f-0d99-442e-96f2-748ebe996151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:39.089779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:39.089779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:39.089779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:39.089779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:39.089779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:39.089779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:39.089779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:39.089779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:39.089779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:39.089779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:39.089779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:39.089779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:39.089779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:39.089779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:39.090773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:39.091664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:39.091664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:39.091664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:39.091664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:39.094197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 338/693] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:39.100360 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e18d6f-0d99-442e-96f2-748ebe996151 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:39.226966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c425da2-2b90-4d80-9990-a16b9bfeaae6 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:39.239382 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:39.258471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:39.272905 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a11866-90cb-441d-94c4-de1465584e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:39.274121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a11866-90cb-441d-94c4-de1465584e0a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:39.274637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a11866-90cb-441d-94c4-de1465584e0a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:39.276412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a11866-90cb-441d-94c4-de1465584e0a None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:39.277461 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a11866-90cb-441d-94c4-de1465584e0a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:39.277776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a11866-90cb-441d-94c4-de1465584e0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:39.279261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a11866-90cb-441d-94c4-de1465584e0a None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:39.299713 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 356/694] 10.222.0.15 () {56 vars in 1133 bytes} [Fri May 27 19:40:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:39.304914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a11866-90cb-441d-94c4-de1465584e0a None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:39.327365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e18d6f-0d99-442e-96f2-748ebe996151 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:39.386875 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4995154-9e4f-4248-aa39-4754891935cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:39.387766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4995154-9e4f-4248-aa39-4754891935cd None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:39.388140 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4995154-9e4f-4248-aa39-4754891935cd None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:39.388525 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4995154-9e4f-4248-aa39-4754891935cd None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:39.389269 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4995154-9e4f-4248-aa39-4754891935cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:39.389580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4995154-9e4f-4248-aa39-4754891935cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:39.391052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4995154-9e4f-4248-aa39-4754891935cd None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:39.404972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 339/695] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:39.406320 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c10c8b-aaa0-4be8-b089-03461842d900 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:39.406714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c10c8b-aaa0-4be8-b089-03461842d900 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:39.406994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c10c8b-aaa0-4be8-b089-03461842d900 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:39.413277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 340/696] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:39.414865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15b2d0-30c6-49fb-883c-efa9fd712bd8 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:39.415162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15b2d0-30c6-49fb-883c-efa9fd712bd8 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:39.415545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15b2d0-30c6-49fb-883c-efa9fd712bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:39.434912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-bc15b2d0-30c6-49fb-883c-efa9fd712bd8 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:39.436133 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-bc15b2d0-30c6-49fb-883c-efa9fd712bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:39.450197 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a11866-90cb-441d-94c4-de1465584e0a None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:39.489140 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f91953-a119-4d76-bf6a-3923314e287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:39.489925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f91953-a119-4d76-bf6a-3923314e287f None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:39.490385 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f91953-a119-4d76-bf6a-3923314e287f None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:39.490717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f91953-a119-4d76-bf6a-3923314e287f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:39.535098 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 341/697] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:39.535963 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15b2d0-30c6-49fb-883c-efa9fd712bd8 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:39.554739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:39.570824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f91953-a119-4d76-bf6a-3923314e287f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:39.573356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f91953-a119-4d76-bf6a-3923314e287f None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:39.606875 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:39.669341 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15b2d0-30c6-49fb-883c-efa9fd712bd8 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:39.687465 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 357/698] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:40:39.688722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f91953-a119-4d76-bf6a-3923314e287f None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:39.715950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f514954-14e8-4501-a9a6-3874ed67133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:39.716924 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f514954-14e8-4501-a9a6-3874ed67133f None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:39.717219 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f514954-14e8-4501-a9a6-3874ed67133f None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:39.717498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f514954-14e8-4501-a9a6-3874ed67133f None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:39.726686 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f514954-14e8-4501-a9a6-3874ed67133f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:39.728311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f514954-14e8-4501-a9a6-3874ed67133f None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:39.745005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-4f514954-14e8-4501-a9a6-3874ed67133f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:39.745005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:39.745005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:39.745005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:39.745005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:39.745005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:39.745005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:39.745005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:39.745005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:39.745005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:39.745005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:39.745005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:39.745005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:39.745005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:39.745005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:39.745996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:39.746923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:39.746923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:39.746923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:39.746923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:39.746923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:39.746923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:39.746923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:39.746923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:39.746923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 342/699] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:39.748009 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f514954-14e8-4501-a9a6-3874ed67133f None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:39.789172 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:39.807539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f91953-a119-4d76-bf6a-3923314e287f None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:39.847994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d035d0-7a78-4e17-9d2f-0bf7f8c2670b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:39.849331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d035d0-7a78-4e17-9d2f-0bf7f8c2670b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:39.849854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d035d0-7a78-4e17-9d2f-0bf7f8c2670b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:39.850461 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d035d0-7a78-4e17-9d2f-0bf7f8c2670b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:39.851343 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d035d0-7a78-4e17-9d2f-0bf7f8c2670b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:39.853009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d035d0-7a78-4e17-9d2f-0bf7f8c2670b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:39.868377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f514954-14e8-4501-a9a6-3874ed67133f None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-08d035d0-7a78-4e17-9d2f-0bf7f8c2670b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:39.869576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:39.870556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:39.871404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:39.871404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:39.871404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:39.871404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:39.871404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:39.871404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:39.871404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:39.871404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:39.871404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:39.871404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:39.871404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:39.871404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:40:39.871404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:39.871404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 19:40:39.871404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:39.874428 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 358/700] 10.222.0.15 () {56 vars in 1129 bytes} [Fri May 27 19:40:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:39.875478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d035d0-7a78-4e17-9d2f-0bf7f8c2670b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:39.886402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:39.914652 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11c8ce-c154-470a-a4ce-2526174ff599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:39.915480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11c8ce-c154-470a-a4ce-2526174ff599 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:39.915765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11c8ce-c154-470a-a4ce-2526174ff599 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:39.916042 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11c8ce-c154-470a-a4ce-2526174ff599 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:39.930020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11c8ce-c154-470a-a4ce-2526174ff599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:39.931635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11c8ce-c154-470a-a4ce-2526174ff599 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:39.953258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-dc11c8ce-c154-470a-a4ce-2526174ff599 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:39.953258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:39.953258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:39.953258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:39.953258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:39.953258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:39.953258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:39.953258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:39.953258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:39.953258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:39.953258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:39.953258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:39.953258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:39.953258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:39.953258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:39.954457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:39.955400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:39.955400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:39.955400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:39.955400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:39.955400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 343/701] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:39.955708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11c8ce-c154-470a-a4ce-2526174ff599 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:39.994707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d035d0-7a78-4e17-9d2f-0bf7f8c2670b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:40.032949 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0bd51-3089-4683-9e8f-5d4b0c55f9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:40.033976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0bd51-3089-4683-9e8f-5d4b0c55f9bd None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:40.034591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0bd51-3089-4683-9e8f-5d4b0c55f9bd None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:40.035080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc0bd51-3089-4683-9e8f-5d4b0c55f9bd None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:40.036176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0bd51-3089-4683-9e8f-5d4b0c55f9bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:40.036695 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0bd51-3089-4683-9e8f-5d4b0c55f9bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:40.038391 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc0bd51-3089-4683-9e8f-5d4b0c55f9bd None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:40.054060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 359/702] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:40.055286 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0bd51-3089-4683-9e8f-5d4b0c55f9bd None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:40.068076 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:40.072045 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11c8ce-c154-470a-a4ce-2526174ff599 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:40.108647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3ee3a-ffd0-4b6d-95ae-fb1aaf1859ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:40.109343 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3ee3a-ffd0-4b6d-95ae-fb1aaf1859ec None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:40.109638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3ee3a-ffd0-4b6d-95ae-fb1aaf1859ec None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:40.110008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3ee3a-ffd0-4b6d-95ae-fb1aaf1859ec None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:40.110734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3ee3a-ffd0-4b6d-95ae-fb1aaf1859ec None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:40.111047 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3ee3a-ffd0-4b6d-95ae-fb1aaf1859ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:40.112468 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3ee3a-ffd0-4b6d-95ae-fb1aaf1859ec None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:40.127859 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 344/703] 10.222.0.15 () {56 vars in 1124 bytes} [Fri May 27 19:40:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:40.128958 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3ee3a-ffd0-4b6d-95ae-fb1aaf1859ec None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:40.159226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:40.180264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc0bd51-3089-4683-9e8f-5d4b0c55f9bd None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:40.221187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0c933-ee2a-4ccf-9df7-a56b2e7bd99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:40.222290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0c933-ee2a-4ccf-9df7-a56b2e7bd99c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:40.222955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0c933-ee2a-4ccf-9df7-a56b2e7bd99c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:40.223440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0c933-ee2a-4ccf-9df7-a56b2e7bd99c None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:40.224381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0c933-ee2a-4ccf-9df7-a56b2e7bd99c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:40.224898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0c933-ee2a-4ccf-9df7-a56b2e7bd99c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:40.226844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0c933-ee2a-4ccf-9df7-a56b2e7bd99c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:40.240648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 360/704] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:40.241921 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0c933-ee2a-4ccf-9df7-a56b2e7bd99c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:40.248532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3ee3a-ffd0-4b6d-95ae-fb1aaf1859ec None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:40.287899 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae35d77-1b05-4b58-bdca-4d701965573a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:40.288534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae35d77-1b05-4b58-bdca-4d701965573a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:40.288923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae35d77-1b05-4b58-bdca-4d701965573a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:40.289351 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae35d77-1b05-4b58-bdca-4d701965573a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:40.290376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae35d77-1b05-4b58-bdca-4d701965573a None admin] RBAC: Adding query filter params (role.id=30112fca4d6549a790f2eadf20635343, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=799058a415e44194a50697841b410062) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:40.290699 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae35d77-1b05-4b58-bdca-4d701965573a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:40.292317 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae35d77-1b05-4b58-bdca-4d701965573a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:40.302133 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 345/705] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:40:40 2022] GET /identity/v3/role_assignments?user.id=799058a415e44194a50697841b410062&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=30112fca4d6549a790f2eadf20635343 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:40.303276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae35d77-1b05-4b58-bdca-4d701965573a None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:40.331142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:40.367059 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0c933-ee2a-4ccf-9df7-a56b2e7bd99c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:40.408851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891c4d0-0b81-488c-9aa4-2f51a6327cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:40.410040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891c4d0-0b81-488c-9aa4-2f51a6327cdb None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:40.410680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891c4d0-0b81-488c-9aa4-2f51a6327cdb None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:40.411181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891c4d0-0b81-488c-9aa4-2f51a6327cdb None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:40.411903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:40.413435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891c4d0-0b81-488c-9aa4-2f51a6327cdb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:40.414047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891c4d0-0b81-488c-9aa4-2f51a6327cdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:40.415814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891c4d0-0b81-488c-9aa4-2f51a6327cdb None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:40.422450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae35d77-1b05-4b58-bdca-4d701965573a None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:40.423542 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 361/706] 10.222.0.15 () {56 vars in 1124 bytes} [Fri May 27 19:40:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:40.425378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612651b-5c33-48e5-b26b-5d15b0160063 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:40.425896 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612651b-5c33-48e5-b26b-5d15b0160063 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:40.426453 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612651b-5c33-48e5-b26b-5d15b0160063 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:40.428415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 362/707] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:40.434688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465b4a3-e40e-4e21-b5e2-0f1e2257f0bc None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:40.436146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465b4a3-e40e-4e21-b5e2-0f1e2257f0bc None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:40.441001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465b4a3-e40e-4e21-b5e2-0f1e2257f0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:40.471422 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-5465b4a3-e40e-4e21-b5e2-0f1e2257f0bc None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:40.477013 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5465b4a3-e40e-4e21-b5e2-0f1e2257f0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:40.515114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f1026-bdd6-4dac-93b2-6176de51765e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:40.515949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f1026-bdd6-4dac-93b2-6176de51765e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:40.516242 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f1026-bdd6-4dac-93b2-6176de51765e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:40.516529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f1026-bdd6-4dac-93b2-6176de51765e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:40.529826 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f1026-bdd6-4dac-93b2-6176de51765e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:40.534538 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f1026-bdd6-4dac-93b2-6176de51765e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:40.570955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-cc8f1026-bdd6-4dac-93b2-6176de51765e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:40.570955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:40.570955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:40.570955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:40.570955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:40.570955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:40.570955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:40.570955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:40.570955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:40.570955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:40.570955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:40.570955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:40.570955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:40.570955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:40.570955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:40.571920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:40.573403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:40.573403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:40.573403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:40.573403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:40.573403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:40.573403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:40.573403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:40.573403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:40.575222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 346/708] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:40.580247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f1026-bdd6-4dac-93b2-6176de51765e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:40.606475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 363/709] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:40.642680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465b4a3-e40e-4e21-b5e2-0f1e2257f0bc None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:40.739850 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:40.752864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f1026-bdd6-4dac-93b2-6176de51765e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:40.793638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465b4a3-e40e-4e21-b5e2-0f1e2257f0bc None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:40.802107 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3725d69-f213-465b-b9df-5af251620cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:40.804549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3725d69-f213-465b-b9df-5af251620cf9 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:40.804843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3725d69-f213-465b-b9df-5af251620cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:40.805125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3725d69-f213-465b-b9df-5af251620cf9 None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:40.805939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3725d69-f213-465b-b9df-5af251620cf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:40.806250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3725d69-f213-465b-b9df-5af251620cf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:40.807800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3725d69-f213-465b-b9df-5af251620cf9 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:40.833220 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 347/710] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:40.840253 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3725d69-f213-465b-b9df-5af251620cf9 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:40.861911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:40.872797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17fd10-64c4-4553-90c2-d56631046a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:40.873610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17fd10-64c4-4553-90c2-d56631046a23 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:40.875282 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17fd10-64c4-4553-90c2-d56631046a23 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:40.875282 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17fd10-64c4-4553-90c2-d56631046a23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:40.894783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17fd10-64c4-4553-90c2-d56631046a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:40.897013 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17fd10-64c4-4553-90c2-d56631046a23 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:40.937376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-5f17fd10-64c4-4553-90c2-d56631046a23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:40.937376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:40.937376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:40.937376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:40.937376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:40.937376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:40.937376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:40.937376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:40.937376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:40.937376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:40.937376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:40.937376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:40.937376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:40.937376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:40.937376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:40.938366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:40.939283 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:40.939283 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:40.939283 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:40.939283 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:40.942386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 364/711] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:40.951194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17fd10-64c4-4553-90c2-d56631046a23 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:41.041213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3725d69-f213-465b-b9df-5af251620cf9 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:41.092883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17fd10-64c4-4553-90c2-d56631046a23 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:41.112001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:41.112817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5691339-d745-4fb4-9294-9d7fcbe2b7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:41.113488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5691339-d745-4fb4-9294-9d7fcbe2b7d0 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:41.113776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5691339-d745-4fb4-9294-9d7fcbe2b7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:41.114059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5691339-d745-4fb4-9294-9d7fcbe2b7d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:41.118309 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5691339-d745-4fb4-9294-9d7fcbe2b7d0 None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=105353b6b1a941ac81df7ad35567ba7c) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:41.118309 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5691339-d745-4fb4-9294-9d7fcbe2b7d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:41.118309 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5691339-d745-4fb4-9294-9d7fcbe2b7d0 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:41.124416 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 348/712] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:40:40 2022] GET /identity/v3/role_assignments?user.id=105353b6b1a941ac81df7ad35567ba7c&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:41.168884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff2328-b024-4455-81b5-58edf540da1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:41.169855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff2328-b024-4455-81b5-58edf540da1c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:41.170293 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff2328-b024-4455-81b5-58edf540da1c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:41.170786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff2328-b024-4455-81b5-58edf540da1c None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:41.171732 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff2328-b024-4455-81b5-58edf540da1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:41.172219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff2328-b024-4455-81b5-58edf540da1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:41.174113 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff2328-b024-4455-81b5-58edf540da1c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:41.188588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 365/713] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:41.194435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5691339-d745-4fb4-9294-9d7fcbe2b7d0 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:41.283465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:41.312287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5691339-d745-4fb4-9294-9d7fcbe2b7d0 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:41.350030 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8104853-96b3-45c9-a379-fd611c51bda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:41.350824 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8104853-96b3-45c9-a379-fd611c51bda6 None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:41.351121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8104853-96b3-45c9-a379-fd611c51bda6 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:41.351405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8104853-96b3-45c9-a379-fd611c51bda6 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:41.353213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8104853-96b3-45c9-a379-fd611c51bda6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:41.354249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8104853-96b3-45c9-a379-fd611c51bda6 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:41.425840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d437-9de8-4b98-8efe-095c490ad51c None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:41.426065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d437-9de8-4b98-8efe-095c490ad51c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:41.426362 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7d437-9de8-4b98-8efe-095c490ad51c None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:41.427991 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 366/714] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:41.433376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5d541-da84-43ac-929b-3dc2d58549a7 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:41.433667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5d541-da84-43ac-929b-3dc2d58549a7 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:41.433951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5d541-da84-43ac-929b-3dc2d58549a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:41.455123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 349/715] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:40:41 2022] POST /identity/v3/users => generated 254 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:40:41.456165 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-31f5d541-da84-43ac-929b-3dc2d58549a7 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:41.457436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-31f5d541-da84-43ac-929b-3dc2d58549a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:41.555535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 367/716] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:41.578564 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8104853-96b3-45c9-a379-fd611c51bda6 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:41.710408 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8104853-96b3-45c9-a379-fd611c51bda6 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:41.753304 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:41.760077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb330c-1b6c-49d3-8244-db38eaececa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:41.760919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb330c-1b6c-49d3-8244-db38eaececa6 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:41.761209 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb330c-1b6c-49d3-8244-db38eaececa6 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:41.761490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb330c-1b6c-49d3-8244-db38eaececa6 None admin] PATH_INFO: `/v3/services/network` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:41.762236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb330c-1b6c-49d3-8244-db38eaececa6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:41.763837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bb330c-1b6c-49d3-8244-db38eaececa6 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-05bb330c-1b6c-49d3-8244-db38eaececa6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:41.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:41.785840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:41.787405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:41.787405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:41.787405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:41.787405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:41.787405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:41.787405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:41.787405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:41.787405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:41.787405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:41.787405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:41.787405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:40:41.787405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:41.787405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 19:40:41.787405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:41.787405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 350/717] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:41 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:41.793133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5d541-da84-43ac-929b-3dc2d58549a7 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:41.908538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5d541-da84-43ac-929b-3dc2d58549a7 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:41.911020 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:41.950712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccea2d3-e145-40f6-b70f-ed9962d9dc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:41.951401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccea2d3-e145-40f6-b70f-ed9962d9dc4f None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:41.951699 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccea2d3-e145-40f6-b70f-ed9962d9dc4f None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:41.951981 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccea2d3-e145-40f6-b70f-ed9962d9dc4f None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:41.952707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccea2d3-e145-40f6-b70f-ed9962d9dc4f None admin] RBAC: Adding query filter params (name=network) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:41.953025 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccea2d3-e145-40f6-b70f-ed9962d9dc4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:41.954452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccea2d3-e145-40f6-b70f-ed9962d9dc4f None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:41.959656 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 368/718] 10.222.0.15 () {56 vars in 1112 bytes} [Fri May 27 19:40:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:41.965705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb330c-1b6c-49d3-8244-db38eaececa6 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:42.140043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb330c-1b6c-49d3-8244-db38eaececa6 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:42.188073 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4bbfc-f185-4e0f-ad12-be964fe11c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:42.188760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4bbfc-f185-4e0f-ad12-be964fe11c50 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:42.189049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4bbfc-f185-4e0f-ad12-be964fe11c50 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:42.189328 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4bbfc-f185-4e0f-ad12-be964fe11c50 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:42.190040 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4bbfc-f185-4e0f-ad12-be964fe11c50 None admin] RBAC: Adding query filter params (type=network) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:42.190364 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4bbfc-f185-4e0f-ad12-be964fe11c50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:42.191813 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4bbfc-f185-4e0f-ad12-be964fe11c50 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:42.204107 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 351/719] 10.222.0.15 () {56 vars in 1112 bytes} [Fri May 27 19:40:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:43.136991 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1791898-76dc-4ff3-acf7-d732c33d0d09 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:43.137516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1791898-76dc-4ff3-acf7-d732c33d0d09 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:43.137596 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1791898-76dc-4ff3-acf7-d732c33d0d09 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:43.139247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 369/720] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:43.144755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d05a5c-f1e0-4e0f-b5ab-7df4347462a2 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:43.145199 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d05a5c-f1e0-4e0f-b5ab-7df4347462a2 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:43.145373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d05a5c-f1e0-4e0f-b5ab-7df4347462a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:43.163272 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-38d05a5c-f1e0-4e0f-b5ab-7df4347462a2 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:43.164468 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-38d05a5c-f1e0-4e0f-b5ab-7df4347462a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:43.225223 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:43.241217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 352/721] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:40:43.248525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c41db6-eb04-4d2b-8bd0-f303b327c289 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:43.248890 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c41db6-eb04-4d2b-8bd0-f303b327c289 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:43.249248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c41db6-eb04-4d2b-8bd0-f303b327c289 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:43.251100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 370/722] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:43.257163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127b9e2-71d4-40ac-9b62-e9503059e1bf None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:43.257460 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127b9e2-71d4-40ac-9b62-e9503059e1bf None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:43.257741 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127b9e2-71d4-40ac-9b62-e9503059e1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:43.272054 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c41db6-eb04-4d2b-8bd0-f303b327c289 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:43.280762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-5127b9e2-71d4-40ac-9b62-e9503059e1bf None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:43.281957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-5127b9e2-71d4-40ac-9b62-e9503059e1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:43.359837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 353/723] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:43.400866 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127b9e2-71d4-40ac-9b62-e9503059e1bf None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:43.443066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c41db6-eb04-4d2b-8bd0-f303b327c289 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:43.511067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f41d20-8501-4093-9522-aa4c0f6c7155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:43.511749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f41d20-8501-4093-9522-aa4c0f6c7155 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:43.512037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f41d20-8501-4093-9522-aa4c0f6c7155 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:43.512321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f41d20-8501-4093-9522-aa4c0f6c7155 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:43.513363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f41d20-8501-4093-9522-aa4c0f6c7155 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:43.514780 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f41d20-8501-4093-9522-aa4c0f6c7155 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:43.586180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127b9e2-71d4-40ac-9b62-e9503059e1bf None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:43.606575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:43.617296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 371/724] 10.222.0.15 () {60 vars in 1141 bytes} [Fri May 27 19:40:43 2022] POST /identity/v3/services => generated 251 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 19:40:43.653166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb13df2-f7b3-451f-9a2a-148e8affd137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:43.653993 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb13df2-f7b3-451f-9a2a-148e8affd137 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:43.654355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb13df2-f7b3-451f-9a2a-148e8affd137 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:43.654704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb13df2-f7b3-451f-9a2a-148e8affd137 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:43.678950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb13df2-f7b3-451f-9a2a-148e8affd137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-3bb13df2-f7b3-451f-9a2a-148e8affd137 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:43.688662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:43.689672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:43.690536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:43.690536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:43.690536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:43.690536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:43.690536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:43.690536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:43.690536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:43.690536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:43.690536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:43.690536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:43.690536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:43.690536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:43.690536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 354/725] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:43.696437 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f41d20-8501-4093-9522-aa4c0f6c7155 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:43.742444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:43.858781 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f41d20-8501-4093-9522-aa4c0f6c7155 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:43.907534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47d418-19ef-4847-badc-ce05a5a67747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:43.908148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47d418-19ef-4847-badc-ce05a5a67747 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:43.908433 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47d418-19ef-4847-badc-ce05a5a67747 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:43.908714 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47d418-19ef-4847-badc-ce05a5a67747 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:43.909474 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47d418-19ef-4847-badc-ce05a5a67747 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:43.909785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47d418-19ef-4847-badc-ce05a5a67747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:43.911192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47d418-19ef-4847-badc-ce05a5a67747 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:43.925018 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 372/726] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:43.930757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb13df2-f7b3-451f-9a2a-148e8affd137 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:44.037835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78681dea-422b-4c50-adb5-9c56027f58ee None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:44.038520 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78681dea-422b-4c50-adb5-9c56027f58ee None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:44.039002 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78681dea-422b-4c50-adb5-9c56027f58ee None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:44.040997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 373/727] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:44.047105 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fff87-4541-46c9-b486-b55f364363c8 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:44.047688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fff87-4541-46c9-b486-b55f364363c8 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:44.048169 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fff87-4541-46c9-b486-b55f364363c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:44.072249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb13df2-f7b3-451f-9a2a-148e8affd137 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:44.083082 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a34fff87-4541-46c9-b486-b55f364363c8 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:44.084294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a34fff87-4541-46c9-b486-b55f364363c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:44.144097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e6e53-c8c9-48de-b6af-c003898844a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:44.146170 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e6e53-c8c9-48de-b6af-c003898844a5 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:44.147292 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e6e53-c8c9-48de-b6af-c003898844a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:44.147757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e6e53-c8c9-48de-b6af-c003898844a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:44.175397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e6e53-c8c9-48de-b6af-c003898844a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:44.177381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e6e53-c8c9-48de-b6af-c003898844a5 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:44.215169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-845e6e53-c8c9-48de-b6af-c003898844a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:44.215169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:44.215169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:44.215169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:44.215169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:44.215169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:44.215169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:44.215169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:44.215169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:44.215169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:44.215169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:44.215169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:44.215169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:44.215169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:44.215169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:44.216259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:44.217327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:44.217327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:44.217327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:44.217327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:44.217327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 355/728] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:44.222542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e6e53-c8c9-48de-b6af-c003898844a5 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:44.232227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 374/729] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 19:40:44.260937 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:44.273781 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fff87-4541-46c9-b486-b55f364363c8 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:44.314873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:44.369607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e6e53-c8c9-48de-b6af-c003898844a5 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:44.417683 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0aae-40ce-47f0-99a9-fb5b3da86d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:44.418743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0aae-40ce-47f0-99a9-fb5b3da86d3f None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:44.419072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0aae-40ce-47f0-99a9-fb5b3da86d3f None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:44.419409 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d0aae-40ce-47f0-99a9-fb5b3da86d3f None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:44.420237 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d0aae-40ce-47f0-99a9-fb5b3da86d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:44.420563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d0aae-40ce-47f0-99a9-fb5b3da86d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:44.422183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d0aae-40ce-47f0-99a9-fb5b3da86d3f None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:44.439519 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 356/730] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:44.451575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0aae-40ce-47f0-99a9-fb5b3da86d3f None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:44.479342 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fff87-4541-46c9-b486-b55f364363c8 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:44.519909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f722e-0211-42bc-8fca-b55dddf48596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:44.520786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f722e-0211-42bc-8fca-b55dddf48596 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:44.521272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f722e-0211-42bc-8fca-b55dddf48596 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:44.521815 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f722e-0211-42bc-8fca-b55dddf48596 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:44.534581 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f722e-0211-42bc-8fca-b55dddf48596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-b05f722e-0211-42bc-8fca-b55dddf48596 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:44.544091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:44.545416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:44.546599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:44.546599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:44.546599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:44.546599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:44.546599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:44.546599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:44.546599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:44.546599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:44.546599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:44.546599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:44.546599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:44.546599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:44.549563 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 375/731] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:44.555838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f722e-0211-42bc-8fca-b55dddf48596 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:44.656214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:44.678551 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f722e-0211-42bc-8fca-b55dddf48596 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:44.718647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:44.723055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e1ac6-1ed3-42c7-9151-1746fd073b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:44.723740 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e1ac6-1ed3-42c7-9151-1746fd073b57 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:44.724026 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e1ac6-1ed3-42c7-9151-1746fd073b57 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:44.724305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e1ac6-1ed3-42c7-9151-1746fd073b57 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:44.725179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e1ac6-1ed3-42c7-9151-1746fd073b57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:44.725495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e1ac6-1ed3-42c7-9151-1746fd073b57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:44.726931 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e1ac6-1ed3-42c7-9151-1746fd073b57 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:44.737112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d0aae-40ce-47f0-99a9-fb5b3da86d3f None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:44.740605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 376/732] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:44.742658 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274728cf-ac85-4b03-b085-fa5713aafd62 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:44.743089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274728cf-ac85-4b03-b085-fa5713aafd62 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:44.743529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274728cf-ac85-4b03-b085-fa5713aafd62 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:44.745655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 377/733] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:44.746444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274728cf-ac85-4b03-b085-fa5713aafd62 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:44.782702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d1517-4966-4831-b696-acd12d2dcc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:44.784120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d1517-4966-4831-b696-acd12d2dcc0f None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:44.784870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d1517-4966-4831-b696-acd12d2dcc0f None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:44.785336 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d1517-4966-4831-b696-acd12d2dcc0f None admin] PATH_INFO: `/v3/users/swift` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:44.796136 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d1517-4966-4831-b696-acd12d2dcc0f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:44.798718 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d1517-4966-4831-b696-acd12d2dcc0f None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-8c9d1517-4966-4831-b696-acd12d2dcc0f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:44.819619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:44.820598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:44.821545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:44.821545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:44.821545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:44.821545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:44.821545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:44.821545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:44.821545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:44.821545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:44.821545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 19:40:44.821545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:44.824790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 357/734] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:40:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:44.826295 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d46a8-49ec-4544-bc65-b1da38e8cdb0 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:44.826753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d46a8-49ec-4544-bc65-b1da38e8cdb0 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:44.827164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d46a8-49ec-4544-bc65-b1da38e8cdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:44.850855 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-9e8d46a8-49ec-4544-bc65-b1da38e8cdb0 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:44.853182 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9e8d46a8-49ec-4544-bc65-b1da38e8cdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:44.883602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274728cf-ac85-4b03-b085-fa5713aafd62 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:44.934749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb35b6-991d-4bde-9fb2-d741ad10e598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:44.936097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb35b6-991d-4bde-9fb2-d741ad10e598 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:44.936579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb35b6-991d-4bde-9fb2-d741ad10e598 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:44.937123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb35b6-991d-4bde-9fb2-d741ad10e598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:44.941402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 358/735] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:44.942820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d46a8-49ec-4544-bc65-b1da38e8cdb0 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:44.963768 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb35b6-991d-4bde-9fb2-d741ad10e598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:44.965475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb35b6-991d-4bde-9fb2-d741ad10e598 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:44.972764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:44.997129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-d1cb35b6-991d-4bde-9fb2-d741ad10e598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:44.997129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:44.997129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:44.997129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:44.997129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:44.997129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:44.997129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:44.997129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:44.997129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:44.997129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:44.997129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:44.997129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:44.997129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:44.997129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:44.997129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:44.998264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:44.999396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:44.999396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:44.999396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:44.999396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:45.000772 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 378/736] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:45.005966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb35b6-991d-4bde-9fb2-d741ad10e598 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:45.059304 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:45.095607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d46a8-49ec-4544-bc65-b1da38e8cdb0 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:45.128128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb35b6-991d-4bde-9fb2-d741ad10e598 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:45.142898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9d2f7-7061-477f-9c1b-63d0f6d5229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:45.143580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d2f7-7061-477f-9c1b-63d0f6d5229d None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:45.143863 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d2f7-7061-477f-9c1b-63d0f6d5229d None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:45.144139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d2f7-7061-477f-9c1b-63d0f6d5229d None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:45.145063 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9d2f7-7061-477f-9c1b-63d0f6d5229d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:45.145289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9d2f7-7061-477f-9c1b-63d0f6d5229d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:45.146762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9d2f7-7061-477f-9c1b-63d0f6d5229d None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:45.169386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 359/737] 10.222.0.15 () {56 vars in 1135 bytes} [Fri May 27 19:40:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:45.170366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9d2f7-7061-477f-9c1b-63d0f6d5229d None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:45.177555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28094726-1949-4788-b5bb-406728c84744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:45.178406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28094726-1949-4788-b5bb-406728c84744 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:45.178697 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28094726-1949-4788-b5bb-406728c84744 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:45.178977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28094726-1949-4788-b5bb-406728c84744 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:45.192238 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28094726-1949-4788-b5bb-406728c84744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-28094726-1949-4788-b5bb-406728c84744 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:45.200575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:45.201738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:45.202722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:45.202722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:45.202722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:45.202722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:45.202722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:45.202722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:45.202722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:45.202722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:45.202722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:45.202722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:45.202722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:45.202722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:45.202722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 379/738] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:45.203501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b8dcc-ce35-43ee-9b3e-cf4c39792349 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:45.204108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b8dcc-ce35-43ee-9b3e-cf4c39792349 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:45.204404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b8dcc-ce35-43ee-9b3e-cf4c39792349 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:45.210460 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 380/739] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:45.210460 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b8dcc-ce35-43ee-9b3e-cf4c39792349 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:45.276880 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:45.293139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9d2f7-7061-477f-9c1b-63d0f6d5229d None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:45.329053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b8dcc-ce35-43ee-9b3e-cf4c39792349 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:45.334495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc837ee6-4d99-43bf-ad1d-29c36eaa3959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:45.335169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc837ee6-4d99-43bf-ad1d-29c36eaa3959 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:45.335455 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc837ee6-4d99-43bf-ad1d-29c36eaa3959 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:45.335734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc837ee6-4d99-43bf-ad1d-29c36eaa3959 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:45.336524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc837ee6-4d99-43bf-ad1d-29c36eaa3959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:45.336837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc837ee6-4d99-43bf-ad1d-29c36eaa3959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:45.338827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc837ee6-4d99-43bf-ad1d-29c36eaa3959 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:45.340683 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:45.354675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 360/740] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:45.355465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc837ee6-4d99-43bf-ad1d-29c36eaa3959 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:45.374305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1b01d-d9b0-48b1-b1c0-9ccc68092fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:45.375057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1b01d-d9b0-48b1-b1c0-9ccc68092fb9 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:45.375367 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1b01d-d9b0-48b1-b1c0-9ccc68092fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:45.375649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1b01d-d9b0-48b1-b1c0-9ccc68092fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:45.457969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1b01d-d9b0-48b1-b1c0-9ccc68092fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:45.460788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1b01d-d9b0-48b1-b1c0-9ccc68092fb9 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:45.469481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc837ee6-4d99-43bf-ad1d-29c36eaa3959 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:45.510964 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e5152-61d6-4b1f-a3bf-86bbc7e2a5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:45.511646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e5152-61d6-4b1f-a3bf-86bbc7e2a5db None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:45.511930 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e5152-61d6-4b1f-a3bf-86bbc7e2a5db None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:45.512220 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e5152-61d6-4b1f-a3bf-86bbc7e2a5db None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:45.512953 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e5152-61d6-4b1f-a3bf-86bbc7e2a5db None admin] RBAC: Adding query filter params (name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:45.513263 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e5152-61d6-4b1f-a3bf-86bbc7e2a5db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:45.514753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e5152-61d6-4b1f-a3bf-86bbc7e2a5db None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:45.525669 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 361/741] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:45.527239 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526e6ba-8e0b-4fd4-a98f-4d7767399fce None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:45.527482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526e6ba-8e0b-4fd4-a98f-4d7767399fce None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:45.527831 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526e6ba-8e0b-4fd4-a98f-4d7767399fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:45.536617 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:45.546058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b526e6ba-8e0b-4fd4-a98f-4d7767399fce None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:45.548182 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b526e6ba-8e0b-4fd4-a98f-4d7767399fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:45.586784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 381/742] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:45 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 19:40:45.587674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1b01d-d9b0-48b1-b1c0-9ccc68092fb9 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:45.611268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:45.631102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 362/743] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 19:40:45.632225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526e6ba-8e0b-4fd4-a98f-4d7767399fce None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:45.704156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1b01d-d9b0-48b1-b1c0-9ccc68092fb9 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:45.745917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d2757-43bb-4ccb-9bbd-b55adb581796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:45.746759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d2757-43bb-4ccb-9bbd-b55adb581796 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:45.747047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d2757-43bb-4ccb-9bbd-b55adb581796 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:45.747323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d2757-43bb-4ccb-9bbd-b55adb581796 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:45.752674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526e6ba-8e0b-4fd4-a98f-4d7767399fce None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:45.755621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d2757-43bb-4ccb-9bbd-b55adb581796 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:45.757085 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d2757-43bb-4ccb-9bbd-b55adb581796 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-e20d2757-43bb-4ccb-9bbd-b55adb581796 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:45.772639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:45.773680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:45.774652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:45.774652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:45.774652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:45.774652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:45.774652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:45.774652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:45.774652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:45.774652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:45.774652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 19:40:45.774652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:45.774652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 382/744] 10.222.0.15 () {56 vars in 1093 bytes} [Fri May 27 19:40:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:45.774652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d2757-43bb-4ccb-9bbd-b55adb581796 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:45.794945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:45.800610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e644a-cf3a-451b-8b9c-1f93595b3669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:45.801486 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e644a-cf3a-451b-8b9c-1f93595b3669 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:45.801713 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e644a-cf3a-451b-8b9c-1f93595b3669 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:45.801994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e644a-cf3a-451b-8b9c-1f93595b3669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:45.813218 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e644a-cf3a-451b-8b9c-1f93595b3669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:45.814721 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e644a-cf3a-451b-8b9c-1f93595b3669 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:45.899543 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d2757-43bb-4ccb-9bbd-b55adb581796 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:45.939968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e9e8e-21e0-420e-b75f-306a094096e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:45.940783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e9e8e-21e0-420e-b75f-306a094096e0 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:45.941071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e9e8e-21e0-420e-b75f-306a094096e0 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:45.941359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e9e8e-21e0-420e-b75f-306a094096e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:45.953307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e9e8e-21e0-420e-b75f-306a094096e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:45.954811 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e9e8e-21e0-420e-b75f-306a094096e0 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:45.959131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-b85e644a-cf3a-451b-8b9c-1f93595b3669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:45.959131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:45.959131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:45.959131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:45.959131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:45.959131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:45.959131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:45.959131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:45.959131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:45.959131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:45.959131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:45.959131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:45.959131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:45.959131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:45.959131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:45.960112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:45.961128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:45.961128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:45.961128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:45.961128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:45.961128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 363/745] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:45.961936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e644a-cf3a-451b-8b9c-1f93595b3669 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:45.978055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-b19e9e8e-21e0-420e-b75f-306a094096e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:45.978055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:45.978055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:45.978055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:45.978055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:45.978055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:45.978055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:45.978055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:45.978055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:45.978055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:45.978055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:45.978055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:45.978055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:45.978055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:45.978055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:45.979206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:45.980299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:45.980299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:45.980299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:45.980299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:45.980299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 383/746] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:45.980299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e9e8e-21e0-420e-b75f-306a094096e0 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:46.016509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:46.062329 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:46.091183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e644a-cf3a-451b-8b9c-1f93595b3669 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:46.098271 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e9e8e-21e0-420e-b75f-306a094096e0 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:46.133755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084cd63-9f51-4d3f-98c0-df9b1c25c1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:46.134486 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084cd63-9f51-4d3f-98c0-df9b1c25c1bb None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:46.134773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084cd63-9f51-4d3f-98c0-df9b1c25c1bb None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:46.135050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084cd63-9f51-4d3f-98c0-df9b1c25c1bb None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:46.135775 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084cd63-9f51-4d3f-98c0-df9b1c25c1bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:46.136324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800afdc1-c709-41a5-9765-4caa1e3d2e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:46.137167 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4084cd63-9f51-4d3f-98c0-df9b1c25c1bb None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:46.137275 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800afdc1-c709-41a5-9765-4caa1e3d2e86 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:46.137667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800afdc1-c709-41a5-9765-4caa1e3d2e86 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:46.138117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800afdc1-c709-41a5-9765-4caa1e3d2e86 None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:46.139762 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800afdc1-c709-41a5-9765-4caa1e3d2e86 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:46.140092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800afdc1-c709-41a5-9765-4caa1e3d2e86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:46.142455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800afdc1-c709-41a5-9765-4caa1e3d2e86 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:46.161850 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 384/747] 10.222.0.15 () {56 vars in 1133 bytes} [Fri May 27 19:40:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:46.163180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800afdc1-c709-41a5-9765-4caa1e3d2e86 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:46.255588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 364/748] 10.222.0.15 () {60 vars in 1141 bytes} [Fri May 27 19:40:45 2022] POST /identity/v3/services => generated 240 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:40:46.256713 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084cd63-9f51-4d3f-98c0-df9b1c25c1bb None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:46.268887 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800afdc1-c709-41a5-9765-4caa1e3d2e86 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:46.304078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:46.326833 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4066c16-f4d7-4c38-a0b9-79f27f44b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:46.327541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4066c16-f4d7-4c38-a0b9-79f27f44b0d3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:46.327836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4066c16-f4d7-4c38-a0b9-79f27f44b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:46.328137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4066c16-f4d7-4c38-a0b9-79f27f44b0d3 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:46.328935 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4066c16-f4d7-4c38-a0b9-79f27f44b0d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:46.329256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4066c16-f4d7-4c38-a0b9-79f27f44b0d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:46.330700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4066c16-f4d7-4c38-a0b9-79f27f44b0d3 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:46.349955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 385/749] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:46.349955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4066c16-f4d7-4c38-a0b9-79f27f44b0d3 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:46.386364 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:46.394224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4084cd63-9f51-4d3f-98c0-df9b1c25c1bb None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:46.447707 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee88f6-342d-4fe3-afe7-eea7acc8626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:46.447707 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee88f6-342d-4fe3-afe7-eea7acc8626f None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:46.447998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee88f6-342d-4fe3-afe7-eea7acc8626f None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:46.448100 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee88f6-342d-4fe3-afe7-eea7acc8626f None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:46.448815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee88f6-342d-4fe3-afe7-eea7acc8626f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:46.449152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee88f6-342d-4fe3-afe7-eea7acc8626f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:46.450551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee88f6-342d-4fe3-afe7-eea7acc8626f None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:46.463046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 365/750] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:46.464390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421a0b1-a39e-4fcc-8df5-6883aa59cc6d None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:46.464759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421a0b1-a39e-4fcc-8df5-6883aa59cc6d None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:46.464972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421a0b1-a39e-4fcc-8df5-6883aa59cc6d None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:46.466225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 366/751] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:46.467023 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421a0b1-a39e-4fcc-8df5-6883aa59cc6d None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:46.492121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4066c16-f4d7-4c38-a0b9-79f27f44b0d3 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:46.533225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60aaa9-dcf5-4442-becd-d71a819a8a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:46.534037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60aaa9-dcf5-4442-becd-d71a819a8a58 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:46.534320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60aaa9-dcf5-4442-becd-d71a819a8a58 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:46.534632 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60aaa9-dcf5-4442-becd-d71a819a8a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:46.545470 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60aaa9-dcf5-4442-becd-d71a819a8a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:46.546986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60aaa9-dcf5-4442-becd-d71a819a8a58 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:46.565802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-7c60aaa9-dcf5-4442-becd-d71a819a8a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:46.565802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:46.565802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:46.565802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:46.565802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:46.565802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:46.565802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:46.565802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:46.565802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:46.565802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:46.565802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:46.565802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:46.565802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:46.565802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:46.565802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:46.567181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:46.568237 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:46.568237 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:46.568237 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:46.568237 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:46.568237 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 386/752] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:46.568237 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60aaa9-dcf5-4442-becd-d71a819a8a58 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:46.599022 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421a0b1-a39e-4fcc-8df5-6883aa59cc6d None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:46.602671 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:46.635173 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c163e-a4df-4227-a531-4bb3381b1529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:46.635999 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c163e-a4df-4227-a531-4bb3381b1529 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:46.636293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c163e-a4df-4227-a531-4bb3381b1529 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:46.636574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c163e-a4df-4227-a531-4bb3381b1529 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:46.644453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c163e-a4df-4227-a531-4bb3381b1529 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:46.645920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c163e-a4df-4227-a531-4bb3381b1529 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-598c163e-a4df-4227-a531-4bb3381b1529 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:46.661482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:46.662540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:46.663516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:46.663516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:46.663516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:46.663516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:46.663516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:46.663516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:46.663516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:46.663516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:46.663516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 19:40:46.663516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:46.663516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 367/753] 10.222.0.15 () {56 vars in 1117 bytes} [Fri May 27 19:40:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:46.664637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8bb7c-7198-490e-ab6b-b42ce5faf0a4 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:46.664637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8bb7c-7198-490e-ab6b-b42ce5faf0a4 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:46.664637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8bb7c-7198-490e-ab6b-b42ce5faf0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:46.683775 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60aaa9-dcf5-4442-becd-d71a819a8a58 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:46.688507 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b2c8bb7c-7198-490e-ab6b-b42ce5faf0a4 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:46.689734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b2c8bb7c-7198-490e-ab6b-b42ce5faf0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:46.704647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:46.721330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409c120-0962-48c0-bc79-67a61ac78def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:46.722149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409c120-0962-48c0-bc79-67a61ac78def None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:46.722505 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409c120-0962-48c0-bc79-67a61ac78def None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:46.722799 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409c120-0962-48c0-bc79-67a61ac78def None admin] PATH_INFO: `/v3/projects/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:46.730753 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409c120-0962-48c0-bc79-67a61ac78def None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:46.732231 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409c120-0962-48c0-bc79-67a61ac78def None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:46.747408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-0409c120-0962-48c0-bc79-67a61ac78def None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:46.747408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:46.747408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:46.747408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:46.747408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:46.747408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:46.747408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:46.747408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:46.747408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:46.747408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:46.747408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:46.747408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:46.747408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:46.747408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:46.747408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:46.748525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:46.749443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:46.749443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:46.749443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:46.749443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:46.749443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:46.749443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:46.749443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:46.749443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:46.749443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 387/754] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:46.749443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409c120-0962-48c0-bc79-67a61ac78def None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:46.770160 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 368/755] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:40:46.771287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8bb7c-7198-490e-ab6b-b42ce5faf0a4 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:46.863393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:46.873136 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409c120-0962-48c0-bc79-67a61ac78def None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:46.881354 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8bb7c-7198-490e-ab6b-b42ce5faf0a4 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:46.913721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd910e31-f8c1-42e4-ba39-9966d68562a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:46.914575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd910e31-f8c1-42e4-ba39-9966d68562a0 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:46.914874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd910e31-f8c1-42e4-ba39-9966d68562a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:46.915158 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd910e31-f8c1-42e4-ba39-9966d68562a0 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:46.916756 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd910e31-f8c1-42e4-ba39-9966d68562a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:46.917342 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd910e31-f8c1-42e4-ba39-9966d68562a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:46.918979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd910e31-f8c1-42e4-ba39-9966d68562a0 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:46.921255 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9685bc-790c-4c40-b4a6-ec40e87f28e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:46.921925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9685bc-790c-4c40-b4a6-ec40e87f28e2 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:46.922210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9685bc-790c-4c40-b4a6-ec40e87f28e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:46.922517 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9685bc-790c-4c40-b4a6-ec40e87f28e2 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:46.923600 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9685bc-790c-4c40-b4a6-ec40e87f28e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:46.923912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9685bc-790c-4c40-b4a6-ec40e87f28e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:46.925327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9685bc-790c-4c40-b4a6-ec40e87f28e2 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:46.938412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 388/756] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:46.938412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd910e31-f8c1-42e4-ba39-9966d68562a0 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:46.944960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 369/757] 10.222.0.15 () {56 vars in 1149 bytes} [Fri May 27 19:40:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:46.949959 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9685bc-790c-4c40-b4a6-ec40e87f28e2 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:46.958715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:47.057609 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd910e31-f8c1-42e4-ba39-9966d68562a0 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:47.058005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9685bc-790c-4c40-b4a6-ec40e87f28e2 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:47.095760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d93d78-d115-4b24-870e-e0407c152eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:47.096569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d93d78-d115-4b24-870e-e0407c152eba None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:47.096856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d93d78-d115-4b24-870e-e0407c152eba None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:47.097057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06c10e-ab19-482d-acc6-2ccdff1b1711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:47.097203 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d93d78-d115-4b24-870e-e0407c152eba None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:47.097723 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06c10e-ab19-482d-acc6-2ccdff1b1711 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:47.097828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d93d78-d115-4b24-870e-e0407c152eba None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:47.098010 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06c10e-ab19-482d-acc6-2ccdff1b1711 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:47.098294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06c10e-ab19-482d-acc6-2ccdff1b1711 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:47.099124 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06c10e-ab19-482d-acc6-2ccdff1b1711 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:47.099285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d93d78-d115-4b24-870e-e0407c152eba None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:47.099450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06c10e-ab19-482d-acc6-2ccdff1b1711 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:47.101239 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06c10e-ab19-482d-acc6-2ccdff1b1711 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-a1d93d78-d115-4b24-870e-e0407c152eba None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:47.113373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:47.114776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:47.115961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:47.115961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:47.115961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:47.115961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:47.115961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:47.115961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:47.115961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:47.115961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:47.115961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:47.115961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:47.115961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:47.115961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:40:47.115961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:47.115961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 19:40:47.115961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:47.120305 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 370/758] 10.222.0.15 () {56 vars in 1129 bytes} [Fri May 27 19:40:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:47.120951 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d93d78-d115-4b24-870e-e0407c152eba None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:47.122708 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 389/759] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:47.124103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06c10e-ab19-482d-acc6-2ccdff1b1711 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:47.141971 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:47.196446 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:47.233055 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d93d78-d115-4b24-870e-e0407c152eba None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:47.237567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06c10e-ab19-482d-acc6-2ccdff1b1711 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:47.271000 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff33a2e-7053-4af1-a728-4f54aa072d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:47.271909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff33a2e-7053-4af1-a728-4f54aa072d56 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:47.272072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff33a2e-7053-4af1-a728-4f54aa072d56 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:47.272351 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff33a2e-7053-4af1-a728-4f54aa072d56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:47.277295 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafe50b-5dbf-4775-aa73-464ad0776b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:47.278034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafe50b-5dbf-4775-aa73-464ad0776b69 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:47.278330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafe50b-5dbf-4775-aa73-464ad0776b69 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:47.278688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafe50b-5dbf-4775-aa73-464ad0776b69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:47.279968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff33a2e-7053-4af1-a728-4f54aa072d56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:47.281423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff33a2e-7053-4af1-a728-4f54aa072d56 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:47.297222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-cff33a2e-7053-4af1-a728-4f54aa072d56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:47.297222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:47.297222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:47.297222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:47.297222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:47.297222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:47.297222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:47.297222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:47.297222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:47.297222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:47.297222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:47.297222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:47.297222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:47.297222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:47.297222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:47.298213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:47.299491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:47.299491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:47.299491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:47.299491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:47.299491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:47.299491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:47.299491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:47.299491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:47.299491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 371/760] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:47.299491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff33a2e-7053-4af1-a728-4f54aa072d56 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:47.359858 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafe50b-5dbf-4775-aa73-464ad0776b69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:47.361339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eafe50b-5dbf-4775-aa73-464ad0776b69 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:47.376156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:47.412673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff33a2e-7053-4af1-a728-4f54aa072d56 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:47.455780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:47.462155 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f9af6-3daa-43cb-bc4f-392291ec8192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:47.462888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f9af6-3daa-43cb-bc4f-392291ec8192 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:47.463169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f9af6-3daa-43cb-bc4f-392291ec8192 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:47.463448 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f9af6-3daa-43cb-bc4f-392291ec8192 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:47.464156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f9af6-3daa-43cb-bc4f-392291ec8192 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:47.464464 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f9af6-3daa-43cb-bc4f-392291ec8192 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:47.465883 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f9af6-3daa-43cb-bc4f-392291ec8192 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:47.477077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 372/761] 10.222.0.15 () {56 vars in 1124 bytes} [Fri May 27 19:40:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:47.478036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f9af6-3daa-43cb-bc4f-392291ec8192 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:47.485187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 390/762] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:40:47.489611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafe50b-5dbf-4775-aa73-464ad0776b69 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:47.603808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f9af6-3daa-43cb-bc4f-392291ec8192 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:47.609149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eafe50b-5dbf-4775-aa73-464ad0776b69 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:47.623902 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:47.645694 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f39db6-409c-4117-9d88-a0851d2bbcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:47.646359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39db6-409c-4117-9d88-a0851d2bbcb7 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:47.646580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9bc7e-0e15-4cfe-b4eb-f4d6ce599ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:47.646719 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39db6-409c-4117-9d88-a0851d2bbcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:47.646911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39db6-409c-4117-9d88-a0851d2bbcb7 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:47.647708 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f39db6-409c-4117-9d88-a0851d2bbcb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:47.648020 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f39db6-409c-4117-9d88-a0851d2bbcb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:47.648145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9bc7e-0e15-4cfe-b4eb-f4d6ce599ce5 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:47.648610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9bc7e-0e15-4cfe-b4eb-f4d6ce599ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:47.649064 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9bc7e-0e15-4cfe-b4eb-f4d6ce599ce5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:47.649455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f39db6-409c-4117-9d88-a0851d2bbcb7 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:47.650400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9bc7e-0e15-4cfe-b4eb-f4d6ce599ce5 None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=799058a415e44194a50697841b410062) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:47.650889 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9bc7e-0e15-4cfe-b4eb-f4d6ce599ce5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:47.652733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9bc7e-0e15-4cfe-b4eb-f4d6ce599ce5 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:47.667856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 373/763] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:40:47 2022] GET /identity/v3/role_assignments?user.id=799058a415e44194a50697841b410062&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:47.668193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9bc7e-0e15-4cfe-b4eb-f4d6ce599ce5 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:47.668309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 391/764] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:47.674386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f39db6-409c-4117-9d88-a0851d2bbcb7 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:47.760674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:47.797593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f39db6-409c-4117-9d88-a0851d2bbcb7 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:47.825107 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9bc7e-0e15-4cfe-b4eb-f4d6ce599ce5 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:47.848068 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1d2f2-88aa-438c-899d-4d415036789c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:47.848889 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1d2f2-88aa-438c-899d-4d415036789c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:47.849169 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1d2f2-88aa-438c-899d-4d415036789c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:47.849443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1d2f2-88aa-438c-899d-4d415036789c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:47.863383 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1d2f2-88aa-438c-899d-4d415036789c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:47.863738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1d2f2-88aa-438c-899d-4d415036789c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:47.874923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388f467-ef5f-41bd-8649-369fc4206d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:47.875596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388f467-ef5f-41bd-8649-369fc4206d03 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:47.875879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388f467-ef5f-41bd-8649-369fc4206d03 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:47.877636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388f467-ef5f-41bd-8649-369fc4206d03 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:47.877636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388f467-ef5f-41bd-8649-369fc4206d03 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:47.877909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388f467-ef5f-41bd-8649-369fc4206d03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:47.879995 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388f467-ef5f-41bd-8649-369fc4206d03 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:47.886173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-60e1d2f2-88aa-438c-899d-4d415036789c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:47.886173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:47.886173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:47.886173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:47.886173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:47.886173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:47.886173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:47.886173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:47.886173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:47.886173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:47.886173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:47.886173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:47.886173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:47.886173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:47.886173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:47.887137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:47.888032 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:47.888032 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:47.888032 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:47.888032 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:47.892049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 374/766] 10.222.0.15 () {56 vars in 1124 bytes} [Fri May 27 19:40:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:47.892190 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 392/766] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:47.892945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1d2f2-88aa-438c-899d-4d415036789c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:47.893564 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388f467-ef5f-41bd-8649-369fc4206d03 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:47.950872 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:48.002664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1d2f2-88aa-438c-899d-4d415036789c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:48.012254 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388f467-ef5f-41bd-8649-369fc4206d03 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:48.039716 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:48.041915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d7447-972e-4949-a004-8ead9bb3c3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:48.043111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d7447-972e-4949-a004-8ead9bb3c3a1 None admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:48.043675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d7447-972e-4949-a004-8ead9bb3c3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:48.044156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d7447-972e-4949-a004-8ead9bb3c3a1 None admin] PATH_INFO: `/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/105353b6b1a941ac81df7ad35567ba7c/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:48.046737 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d7447-972e-4949-a004-8ead9bb3c3a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=400421f9ccc6478783fa6bbc822b0687, user_id=105353b6b1a941ac81df7ad35567ba7c, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:48.048895 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d7447-972e-4949-a004-8ead9bb3c3a1 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:48.054231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd04088-4400-4056-86c8-6f0613ee0b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:48.055000 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd04088-4400-4056-86c8-6f0613ee0b88 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:48.055339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd04088-4400-4056-86c8-6f0613ee0b88 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:48.055620 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd04088-4400-4056-86c8-6f0613ee0b88 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:48.056490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd04088-4400-4056-86c8-6f0613ee0b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:48.056811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd04088-4400-4056-86c8-6f0613ee0b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:48.058525 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd04088-4400-4056-86c8-6f0613ee0b88 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:48.076744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 375/767] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:48.076744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd04088-4400-4056-86c8-6f0613ee0b88 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:48.135860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 393/768] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:40:47 2022] PUT /identity/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/105353b6b1a941ac81df7ad35567ba7c/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:40:48.137026 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d7447-972e-4949-a004-8ead9bb3c3a1 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:48.251004 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd04088-4400-4056-86c8-6f0613ee0b88 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:48.282736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:48.302915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d7447-972e-4949-a004-8ead9bb3c3a1 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:48.331142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ab8ea-6099-470a-8303-f6f31908dd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:48.331976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ab8ea-6099-470a-8303-f6f31908dd1e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:48.332302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ab8ea-6099-470a-8303-f6f31908dd1e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:48.332588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ab8ea-6099-470a-8303-f6f31908dd1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:48.333573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ab8ea-6099-470a-8303-f6f31908dd1e None admin] RBAC: Adding query filter params (interface=public, service_id=35da778728ac4de9999517362b58b462, region_id=RegionOne) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:48.333952 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ab8ea-6099-470a-8303-f6f31908dd1e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:48.335545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ab8ea-6099-470a-8303-f6f31908dd1e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:48.352741 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 376/769] 10.222.0.15 () {56 vars in 1251 bytes} [Fri May 27 19:40:48 2022] GET /identity/v3/endpoints?service_id=35da778728ac4de9999517362b58b462&interface=public®ion_id=RegionOne => generated 194 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:48.358937 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ab8ea-6099-470a-8303-f6f31908dd1e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:48.391406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc9dc0-ab8a-4332-99a0-2fe89511c8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:48.392306 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc9dc0-ab8a-4332-99a0-2fe89511c8ed None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:48.392591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc9dc0-ab8a-4332-99a0-2fe89511c8ed None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:48.392870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc9dc0-ab8a-4332-99a0-2fe89511c8ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:48.409019 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc9dc0-ab8a-4332-99a0-2fe89511c8ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:48.411271 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc9dc0-ab8a-4332-99a0-2fe89511c8ed None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:48.430376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-e1dc9dc0-ab8a-4332-99a0-2fe89511c8ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:48.430376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:48.430376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:48.430376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:48.430376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:48.430376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:48.430376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:48.430376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:48.430376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:48.430376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:48.430376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:48.430376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:48.430376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:48.430376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:48.430376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:48.432080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:48.432968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:48.432968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:48.432968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:48.432968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:48.432968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:48.432968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:48.432968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:48.432968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:48.435559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 394/770] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:48.441389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc9dc0-ab8a-4332-99a0-2fe89511c8ed None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:48.446039 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:48.523805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ab8ea-6099-470a-8303-f6f31908dd1e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:48.562978 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c2e61-6450-4af5-b4d2-21b3e91d4fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:48.563773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2e61-6450-4af5-b4d2-21b3e91d4fd5 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:48.564064 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2e61-6450-4af5-b4d2-21b3e91d4fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:48.564346 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2e61-6450-4af5-b4d2-21b3e91d4fd5 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:48.565144 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c2e61-6450-4af5-b4d2-21b3e91d4fd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:48.566668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c2e61-6450-4af5-b4d2-21b3e91d4fd5 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:48.573565 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 377/771] 10.222.0.15 () {56 vars in 1087 bytes} [Fri May 27 19:40:48 2022] GET /identity/v3/services => generated 772 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:48.574948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b16654-993f-44fe-a04f-c8cade5ea40a None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:48.575244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b16654-993f-44fe-a04f-c8cade5ea40a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:48.575526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b16654-993f-44fe-a04f-c8cade5ea40a None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:48.577101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc9dc0-ab8a-4332-99a0-2fe89511c8ed None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:48.577303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 378/772] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:48.584091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e768c7-d951-4d05-a712-3c640cf2f992 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:48.584415 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e768c7-d951-4d05-a712-3c640cf2f992 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:48.584647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e768c7-d951-4d05-a712-3c640cf2f992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:48.603252 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-07e768c7-d951-4d05-a712-3c640cf2f992 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:48.604640 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-07e768c7-d951-4d05-a712-3c640cf2f992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:48.616007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab0b8b-d4ae-4e49-9f84-50e5b48aa0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:48.617117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab0b8b-d4ae-4e49-9f84-50e5b48aa0a5 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:48.617537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab0b8b-d4ae-4e49-9f84-50e5b48aa0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:48.617867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab0b8b-d4ae-4e49-9f84-50e5b48aa0a5 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:48.619311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab0b8b-d4ae-4e49-9f84-50e5b48aa0a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:48.619623 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab0b8b-d4ae-4e49-9f84-50e5b48aa0a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:48.621578 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab0b8b-d4ae-4e49-9f84-50e5b48aa0a5 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:48.637814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 395/773] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:48.643931 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab0b8b-d4ae-4e49-9f84-50e5b48aa0a5 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:48.648034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:48.690515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 379/774] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:40:48.709515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e768c7-d951-4d05-a712-3c640cf2f992 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:48.773993 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab0b8b-d4ae-4e49-9f84-50e5b48aa0a5 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:48.810956 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:48.846293 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636fda5-40c6-430e-aa7d-ac74c9229bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:48.848036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636fda5-40c6-430e-aa7d-ac74c9229bff None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:48.848322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636fda5-40c6-430e-aa7d-ac74c9229bff None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:48.848600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636fda5-40c6-430e-aa7d-ac74c9229bff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:48.849556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636fda5-40c6-430e-aa7d-ac74c9229bff None admin] RBAC: Adding query filter params (role.id=30112fca4d6549a790f2eadf20635343, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=bffc7facb4ce4ab9967b0c8d88d0433b) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:48.849975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636fda5-40c6-430e-aa7d-ac74c9229bff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:48.851473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636fda5-40c6-430e-aa7d-ac74c9229bff None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:48.858914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 396/775] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:40:48 2022] GET /identity/v3/role_assignments?user.id=bffc7facb4ce4ab9967b0c8d88d0433b&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=30112fca4d6549a790f2eadf20635343 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:48.900636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e768c7-d951-4d05-a712-3c640cf2f992 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:48.941492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7f5f4-e112-4f46-8855-fe6c37bdda6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:48.942408 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7f5f4-e112-4f46-8855-fe6c37bdda6c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:48.942704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7f5f4-e112-4f46-8855-fe6c37bdda6c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:48.942994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7f5f4-e112-4f46-8855-fe6c37bdda6c None admin] PATH_INFO: `/v3/services/network` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:48.943670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7f5f4-e112-4f46-8855-fe6c37bdda6c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:48.945083 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7f5f4-e112-4f46-8855-fe6c37bdda6c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-6fc7f5f4-e112-4f46-8855-fe6c37bdda6c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:48.958957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:48.960111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:48.961024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:48.961024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:48.961024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:48.961024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:48.961024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:48.961024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:48.961024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:48.961024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:48.961024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:48.961024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:48.961024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:40:48.961024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:48.961024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 19:40:48.961024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:48.964869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 380/776] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:48 2022] GET /identity/v3/services/network => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:48.971263 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636fda5-40c6-430e-aa7d-ac74c9229bff None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:49.058074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:49.098769 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636fda5-40c6-430e-aa7d-ac74c9229bff None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:49.135858 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34249987-ff4d-46ee-9b17-9d9aa86c9f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:49.136538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34249987-ff4d-46ee-9b17-9d9aa86c9f20 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:49.136823 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34249987-ff4d-46ee-9b17-9d9aa86c9f20 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:49.137096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34249987-ff4d-46ee-9b17-9d9aa86c9f20 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:49.137814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34249987-ff4d-46ee-9b17-9d9aa86c9f20 None admin] RBAC: Adding query filter params (name=network) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:49.138121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34249987-ff4d-46ee-9b17-9d9aa86c9f20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:49.139534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34249987-ff4d-46ee-9b17-9d9aa86c9f20 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:49.144920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 397/777] 10.222.0.15 () {56 vars in 1112 bytes} [Fri May 27 19:40:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:49.151190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7f5f4-e112-4f46-8855-fe6c37bdda6c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:49.303884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7f5f4-e112-4f46-8855-fe6c37bdda6c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:49.307470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:49.342167 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8fe7e-4691-42d0-95f4-55fbe4e8117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:49.343653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8fe7e-4691-42d0-95f4-55fbe4e8117a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:49.344142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8fe7e-4691-42d0-95f4-55fbe4e8117a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:49.344643 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8fe7e-4691-42d0-95f4-55fbe4e8117a None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:49.345581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8fe7e-4691-42d0-95f4-55fbe4e8117a None admin] RBAC: Adding query filter params (type=network) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:49.346089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8fe7e-4691-42d0-95f4-55fbe4e8117a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:49.347674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8fe7e-4691-42d0-95f4-55fbe4e8117a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:49.357853 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 381/778] 10.222.0.15 () {56 vars in 1112 bytes} [Fri May 27 19:40:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:49.359621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34249987-ff4d-46ee-9b17-9d9aa86c9f20 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:49.530129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34249987-ff4d-46ee-9b17-9d9aa86c9f20 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:49.561619 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:49.566616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd126857-9b17-4dd5-9b36-04efe01190ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:49.567283 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd126857-9b17-4dd5-9b36-04efe01190ee None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:49.567569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd126857-9b17-4dd5-9b36-04efe01190ee None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:49.567851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd126857-9b17-4dd5-9b36-04efe01190ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:49.568649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd126857-9b17-4dd5-9b36-04efe01190ee None admin] RBAC: Adding query filter params (interface=public, service_id=6f13d12a6af64276b4a213d5b36d358f, region_id=RegionOne) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:49.568961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd126857-9b17-4dd5-9b36-04efe01190ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:49.570331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd126857-9b17-4dd5-9b36-04efe01190ee None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:49.579386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 398/779] 10.222.0.15 () {56 vars in 1251 bytes} [Fri May 27 19:40:49 2022] GET /identity/v3/endpoints?service_id=6f13d12a6af64276b4a213d5b36d358f&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:49.584926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8fe7e-4691-42d0-95f4-55fbe4e8117a None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:49.758909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8fe7e-4691-42d0-95f4-55fbe4e8117a None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:49.810438 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be246e9-a3d3-472e-beb4-ee54a4414502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:49.811122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be246e9-a3d3-472e-beb4-ee54a4414502 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:49.811409 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be246e9-a3d3-472e-beb4-ee54a4414502 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:49.811690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be246e9-a3d3-472e-beb4-ee54a4414502 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:49.812381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be246e9-a3d3-472e-beb4-ee54a4414502 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:49.813747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be246e9-a3d3-472e-beb4-ee54a4414502 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:49.823781 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 382/780] 10.222.0.15 () {56 vars in 1087 bytes} [Fri May 27 19:40:49 2022] GET /identity/v3/services => generated 772 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:50.411803 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8794d-bcf7-4db5-911d-126d507fa2fb None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:50.412184 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8794d-bcf7-4db5-911d-126d507fa2fb None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:50.412388 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8794d-bcf7-4db5-911d-126d507fa2fb None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:50.414093 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 399/781] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:50.433106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282f6d4-a778-44ce-93e4-ff9788d4cef4 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:50.433654 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282f6d4-a778-44ce-93e4-ff9788d4cef4 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:50.433654 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282f6d4-a778-44ce-93e4-ff9788d4cef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:50.455451 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-c282f6d4-a778-44ce-93e4-ff9788d4cef4 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:50.456688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c282f6d4-a778-44ce-93e4-ff9788d4cef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:50.492163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:50.557423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 383/782] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:40:50.608078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8794d-bcf7-4db5-911d-126d507fa2fb None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:50.736431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8794d-bcf7-4db5-911d-126d507fa2fb None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:50.786050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff0195-3a4e-43cd-8c44-e5f5d487fe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:50.786882 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff0195-3a4e-43cd-8c44-e5f5d487fe09 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:50.787172 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff0195-3a4e-43cd-8c44-e5f5d487fe09 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:50.787451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff0195-3a4e-43cd-8c44-e5f5d487fe09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:50.804153 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff0195-3a4e-43cd-8c44-e5f5d487fe09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-71ff0195-3a4e-43cd-8c44-e5f5d487fe09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:50.811790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:50.812718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:50.813575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:50.813575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:50.813575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:50.813575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:50.813575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:50.813575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:50.813575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:50.813575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:50.813575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:50.813575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:50.813575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:50.813575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:50.813575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 400/783] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:40:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:50.818821 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282f6d4-a778-44ce-93e4-ff9788d4cef4 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:50.967428 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282f6d4-a778-44ce-93e4-ff9788d4cef4 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:51.005358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985d4d4-c8aa-4e41-b0f0-0d25018eae58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:51.006411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d4d4-c8aa-4e41-b0f0-0d25018eae58 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:51.006910 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d4d4-c8aa-4e41-b0f0-0d25018eae58 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:51.007396 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d4d4-c8aa-4e41-b0f0-0d25018eae58 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:51.008371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985d4d4-c8aa-4e41-b0f0-0d25018eae58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:51.008912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985d4d4-c8aa-4e41-b0f0-0d25018eae58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:51.010565 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985d4d4-c8aa-4e41-b0f0-0d25018eae58 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:51.020300 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 384/784] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:51.026173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff0195-3a4e-43cd-8c44-e5f5d487fe09 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:51.100771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce857aaf-d229-40d0-9e3c-b146e5652322 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:51.101130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce857aaf-d229-40d0-9e3c-b146e5652322 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:51.101352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce857aaf-d229-40d0-9e3c-b146e5652322 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:51.102811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 385/785] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:51.115012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078105a-34a3-46e6-8ddc-18b4b3d645fa None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:51.115309 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078105a-34a3-46e6-8ddc-18b4b3d645fa None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:51.115598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078105a-34a3-46e6-8ddc-18b4b3d645fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:51.130700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:51.142414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-e078105a-34a3-46e6-8ddc-18b4b3d645fa None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:51.143627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e078105a-34a3-46e6-8ddc-18b4b3d645fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:51.183210 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff0195-3a4e-43cd-8c44-e5f5d487fe09 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:51.189275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:51.223503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19e140-4a15-408a-b964-b795836ab1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:51.224316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19e140-4a15-408a-b964-b795836ab1b3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:51.224600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19e140-4a15-408a-b964-b795836ab1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:51.224877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19e140-4a15-408a-b964-b795836ab1b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:51.238294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19e140-4a15-408a-b964-b795836ab1b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:51.240160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19e140-4a15-408a-b964-b795836ab1b3 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:51.260703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-4f19e140-4a15-408a-b964-b795836ab1b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:51.260703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:51.260703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:51.260703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:51.260703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:51.260703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:51.260703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:51.260703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:51.260703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:51.260703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:51.260703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:51.260703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:51.260703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:51.260703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:51.260703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:51.261625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:51.262577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:51.262577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:51.262577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:51.262577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:51.262849 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 401/786] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:51.269372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19e140-4a15-408a-b964-b795836ab1b3 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:51.365084 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 386/787] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:40:51.390511 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19e140-4a15-408a-b964-b795836ab1b3 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:51.401146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:51.408525 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078105a-34a3-46e6-8ddc-18b4b3d645fa None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:51.431517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9b895-a8f2-4cf7-b8d8-9900dbb44cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:51.432319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9b895-a8f2-4cf7-b8d8-9900dbb44cd7 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:51.432624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9b895-a8f2-4cf7-b8d8-9900dbb44cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:51.432916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9b895-a8f2-4cf7-b8d8-9900dbb44cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:51.433929 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9b895-a8f2-4cf7-b8d8-9900dbb44cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:51.434933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9b895-a8f2-4cf7-b8d8-9900dbb44cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:51.437108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9b895-a8f2-4cf7-b8d8-9900dbb44cd7 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:51.454986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 402/788] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:51.462176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9b895-a8f2-4cf7-b8d8-9900dbb44cd7 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:51.610176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9b895-a8f2-4cf7-b8d8-9900dbb44cd7 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:51.655369 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e8cb3-c692-41c0-a109-3777e48adca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:51.656432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e8cb3-c692-41c0-a109-3777e48adca5 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:51.656723 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e8cb3-c692-41c0-a109-3777e48adca5 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:51.657002 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e8cb3-c692-41c0-a109-3777e48adca5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:51.668180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e8cb3-c692-41c0-a109-3777e48adca5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:51.669654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e8cb3-c692-41c0-a109-3777e48adca5 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-228e8cb3-c692-41c0-a109-3777e48adca5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:51.687378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:51.688455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:51.689468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:51.689468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:51.689468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:51.689468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:51.689468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:51.689468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:51.689468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:51.689468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:51.689468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 19:40:51.689468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:51.689468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 403/789] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:40:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:51.695245 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff26976-a10b-48f9-abf9-ff51edd3811d None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:51.695245 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff26976-a10b-48f9-abf9-ff51edd3811d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:51.695245 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff26976-a10b-48f9-abf9-ff51edd3811d None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:51.695245 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 404/790] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:51.697541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff26976-a10b-48f9-abf9-ff51edd3811d None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:51.702226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078105a-34a3-46e6-8ddc-18b4b3d645fa None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:51.726895 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:51.746762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d8c0f-dd44-40fa-8d44-cc195d857732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:51.747948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d8c0f-dd44-40fa-8d44-cc195d857732 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:51.748472 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d8c0f-dd44-40fa-8d44-cc195d857732 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:51.748950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d8c0f-dd44-40fa-8d44-cc195d857732 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:51.763037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d8c0f-dd44-40fa-8d44-cc195d857732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-133d8c0f-dd44-40fa-8d44-cc195d857732 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:51.771629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:51.772677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:51.773928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:51.773928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:51.773928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:51.773928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:51.773928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:51.773928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:51.773928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:51.773928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:51.773928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:51.773928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:51.773928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:51.773928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:51.777952 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 387/791] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:40:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:51.779670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220215f-47a7-4586-9b80-5602916564d3 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:51.780225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220215f-47a7-4586-9b80-5602916564d3 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:51.780750 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220215f-47a7-4586-9b80-5602916564d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:51.800007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-e220215f-47a7-4586-9b80-5602916564d3 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:51.801621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e220215f-47a7-4586-9b80-5602916564d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:51.806721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff26976-a10b-48f9-abf9-ff51edd3811d None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:51.813870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:51.846655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e434d57-4565-45d2-8299-3be9e5b5afbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:51.847337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434d57-4565-45d2-8299-3be9e5b5afbc None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:51.847627 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434d57-4565-45d2-8299-3be9e5b5afbc None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:51.847973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e434d57-4565-45d2-8299-3be9e5b5afbc None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:51.849262 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e434d57-4565-45d2-8299-3be9e5b5afbc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:51.849583 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e434d57-4565-45d2-8299-3be9e5b5afbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:51.851475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e434d57-4565-45d2-8299-3be9e5b5afbc None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:51.872845 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 405/792] 10.222.0.15 () {56 vars in 1135 bytes} [Fri May 27 19:40:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:51.873526 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e434d57-4565-45d2-8299-3be9e5b5afbc None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:51.882166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 388/793] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:40:51.883385 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1694efd-4198-4d27-a1fd-96295390f881 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:51.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1694efd-4198-4d27-a1fd-96295390f881 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:51.883992 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1694efd-4198-4d27-a1fd-96295390f881 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:51.889928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 389/794] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:51.889928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1694efd-4198-4d27-a1fd-96295390f881 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:51.985765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:52.003640 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e434d57-4565-45d2-8299-3be9e5b5afbc None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:52.012249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1694efd-4198-4d27-a1fd-96295390f881 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:52.039310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea4661-e31a-4ec1-b3a8-7569c811f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:52.039980 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea4661-e31a-4ec1-b3a8-7569c811f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:52.040801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea4661-e31a-4ec1-b3a8-7569c811f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:52.041085 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea4661-e31a-4ec1-b3a8-7569c811f6f0 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:52.042211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea4661-e31a-4ec1-b3a8-7569c811f6f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:52.042892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea4661-e31a-4ec1-b3a8-7569c811f6f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:52.045571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea4661-e31a-4ec1-b3a8-7569c811f6f0 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:52.051664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f30d5-4b73-4a90-86a8-7762efdadcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:52.052715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f30d5-4b73-4a90-86a8-7762efdadcc0 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:52.053187 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f30d5-4b73-4a90-86a8-7762efdadcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:52.053616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f30d5-4b73-4a90-86a8-7762efdadcc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:52.055388 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 406/795] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:52.057280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6903c-11ba-4063-8eea-fbb8361a51e1 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:52.057577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6903c-11ba-4063-8eea-fbb8361a51e1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:52.057860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6903c-11ba-4063-8eea-fbb8361a51e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:52.070372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f30d5-4b73-4a90-86a8-7762efdadcc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:52.071927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f30d5-4b73-4a90-86a8-7762efdadcc0 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:52.074449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-4ca6903c-11ba-4063-8eea-fbb8361a51e1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:52.074912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:52.075580 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4ca6903c-11ba-4063-8eea-fbb8361a51e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:52.092413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-e77f30d5-4b73-4a90-86a8-7762efdadcc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:52.092413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:52.092413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:52.092413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:52.092413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:52.092413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:52.092413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:52.092413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:52.092413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:52.092413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:52.092413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:52.092413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:52.092413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:52.092413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:52.092413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:52.100542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:52.101635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:52.101635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:52.101635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:52.101635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:52.101635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 390/796] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:52.101635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f30d5-4b73-4a90-86a8-7762efdadcc0 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:52.162969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 407/797] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:40:52.162969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6903c-11ba-4063-8eea-fbb8361a51e1 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:52.231193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f30d5-4b73-4a90-86a8-7762efdadcc0 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:52.264571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:52.274270 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bea839-bb3e-4998-8236-7ba67c6217b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:52.275759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bea839-bb3e-4998-8236-7ba67c6217b9 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:52.276141 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bea839-bb3e-4998-8236-7ba67c6217b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:52.276492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bea839-bb3e-4998-8236-7ba67c6217b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:52.286781 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6903c-11ba-4063-8eea-fbb8361a51e1 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:52.288276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bea839-bb3e-4998-8236-7ba67c6217b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-43bea839-bb3e-4998-8236-7ba67c6217b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:52.297108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:52.298596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:52.299627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:52.299627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:52.299627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:52.299627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:52.299627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:52.299627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:52.299627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:52.299627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:52.299627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:52.299627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:52.299627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:52.299627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:52.303769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 391/798] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:52.304991 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bea839-bb3e-4998-8236-7ba67c6217b9 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:52.329735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7987f-24f8-4fc7-af09-b0433407eb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:52.330592 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7987f-24f8-4fc7-af09-b0433407eb6e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:52.330942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7987f-24f8-4fc7-af09-b0433407eb6e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:52.331166 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7987f-24f8-4fc7-af09-b0433407eb6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:52.342404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7987f-24f8-4fc7-af09-b0433407eb6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:52.343900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7987f-24f8-4fc7-af09-b0433407eb6e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:52.363112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-56e7987f-24f8-4fc7-af09-b0433407eb6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:52.363112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:52.363112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:52.363112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:52.363112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:52.363112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:52.363112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:52.363112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:52.363112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:52.363112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:52.363112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:52.363112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:52.363112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:52.363112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:52.363112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:52.364274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:52.365185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:52.365185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:52.365185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:52.365185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:52.365185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 408/799] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:52.365185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7987f-24f8-4fc7-af09-b0433407eb6e None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:52.379343 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:52.432028 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bea839-bb3e-4998-8236-7ba67c6217b9 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:52.469489 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ff2b0-4760-40c2-9d3e-1d372b5aa72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:52.476166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ff2b0-4760-40c2-9d3e-1d372b5aa72e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:52.476166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ff2b0-4760-40c2-9d3e-1d372b5aa72e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:52.476166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ff2b0-4760-40c2-9d3e-1d372b5aa72e None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:52.476514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ff2b0-4760-40c2-9d3e-1d372b5aa72e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:52.476760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ff2b0-4760-40c2-9d3e-1d372b5aa72e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:52.478314 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ff2b0-4760-40c2-9d3e-1d372b5aa72e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:52.497869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 392/800] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:52.498059 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7987f-24f8-4fc7-af09-b0433407eb6e None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:52.498168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ff2b0-4760-40c2-9d3e-1d372b5aa72e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:52.531793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:52.538819 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf86ae-365b-461b-9e97-7c82852f4ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:52.539657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf86ae-365b-461b-9e97-7c82852f4ba3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:52.540099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf86ae-365b-461b-9e97-7c82852f4ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:52.540404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf86ae-365b-461b-9e97-7c82852f4ba3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:52.541098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf86ae-365b-461b-9e97-7c82852f4ba3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:52.542685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf86ae-365b-461b-9e97-7c82852f4ba3 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-bcbf86ae-365b-461b-9e97-7c82852f4ba3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:52.556657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:52.557922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:52.558959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 409/801] 10.222.0.15 () {56 vars in 1129 bytes} [Fri May 27 19:40:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:52.559910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf86ae-365b-461b-9e97-7c82852f4ba3 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:52.620025 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ff2b0-4760-40c2-9d3e-1d372b5aa72e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:52.637946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:52.655526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b40b00-7ae8-4b84-b1a9-b02113f54205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:52.656260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b40b00-7ae8-4b84-b1a9-b02113f54205 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:52.656578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b40b00-7ae8-4b84-b1a9-b02113f54205 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:52.656858 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b40b00-7ae8-4b84-b1a9-b02113f54205 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:52.657612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b40b00-7ae8-4b84-b1a9-b02113f54205 None admin] RBAC: Adding query filter params (name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:52.657918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b40b00-7ae8-4b84-b1a9-b02113f54205 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:52.659335 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b40b00-7ae8-4b84-b1a9-b02113f54205 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:52.668313 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 393/802] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:52.669226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b40b00-7ae8-4b84-b1a9-b02113f54205 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:52.675260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf86ae-365b-461b-9e97-7c82852f4ba3 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:52.709984 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d926b9-6e3b-47f1-9779-16e16ecb2d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:52.710610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d926b9-6e3b-47f1-9779-16e16ecb2d4d None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:52.710893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d926b9-6e3b-47f1-9779-16e16ecb2d4d None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:52.711170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d926b9-6e3b-47f1-9779-16e16ecb2d4d None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:52.711891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d926b9-6e3b-47f1-9779-16e16ecb2d4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:52.712290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d926b9-6e3b-47f1-9779-16e16ecb2d4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:52.713665 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d926b9-6e3b-47f1-9779-16e16ecb2d4d None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:52.725433 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 410/803] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:52.726227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d926b9-6e3b-47f1-9779-16e16ecb2d4d None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:52.775483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b40b00-7ae8-4b84-b1a9-b02113f54205 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:52.781553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:52.810294 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1702107-fa24-4a48-9f1f-43a9c071f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:52.811116 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1702107-fa24-4a48-9f1f-43a9c071f2bc None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:52.811407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1702107-fa24-4a48-9f1f-43a9c071f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:52.811684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1702107-fa24-4a48-9f1f-43a9c071f2bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:52.818607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1702107-fa24-4a48-9f1f-43a9c071f2bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:52.820063 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1702107-fa24-4a48-9f1f-43a9c071f2bc None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:52.829588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d926b9-6e3b-47f1-9779-16e16ecb2d4d None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:52.834738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-b1702107-fa24-4a48-9f1f-43a9c071f2bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:52.834738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:52.834738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:52.834738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:52.834738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:52.834738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:52.834738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:52.834738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:52.834738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:52.834738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:52.834738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:52.834738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:52.834738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:52.834738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:52.834738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:52.835778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:52.836802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:52.836802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:52.836802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:52.836802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:52.836802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:52.836802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:52.836802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:52.836802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:52.836802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 394/804] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:52.838314 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f7df8-d08d-4302-a08f-0953d2ad972a None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:52.838314 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f7df8-d08d-4302-a08f-0953d2ad972a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:52.838590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f7df8-d08d-4302-a08f-0953d2ad972a None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:52.840090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 395/805] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:52.840561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f7df8-d08d-4302-a08f-0953d2ad972a None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:52.867038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c309-5542-4ba4-a776-e9fa0122c231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:52.867708 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c309-5542-4ba4-a776-e9fa0122c231 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:52.867989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c309-5542-4ba4-a776-e9fa0122c231 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:52.868322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46c309-5542-4ba4-a776-e9fa0122c231 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:52.869047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46c309-5542-4ba4-a776-e9fa0122c231 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:52.869367 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46c309-5542-4ba4-a776-e9fa0122c231 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:52.870799 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46c309-5542-4ba4-a776-e9fa0122c231 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:52.875319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 411/806] 10.222.0.15 () {56 vars in 1124 bytes} [Fri May 27 19:40:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:52.876092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c309-5542-4ba4-a776-e9fa0122c231 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:52.888102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:52.951933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f7df8-d08d-4302-a08f-0953d2ad972a None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:52.984560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46c309-5542-4ba4-a776-e9fa0122c231 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:52.987288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ed835-ba3e-49a6-b752-87eea9653a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:52.988082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ed835-ba3e-49a6-b752-87eea9653a78 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:52.988373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ed835-ba3e-49a6-b752-87eea9653a78 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:52.988646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ed835-ba3e-49a6-b752-87eea9653a78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:52.999042 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ed835-ba3e-49a6-b752-87eea9653a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:53.000599 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ed835-ba3e-49a6-b752-87eea9653a78 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:53.001904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:53.019287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-474ed835-ba3e-49a6-b752-87eea9653a78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:53.019287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:53.019287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:53.019287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:53.019287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:53.019287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:53.019287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:53.019287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:53.019287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:53.019287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:53.019287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:53.019287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:53.019287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:53.019287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:53.019287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:53.020356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:53.022312 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:53.022312 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:53.022312 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:53.022312 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:53.022774 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64d338-02cf-49d1-93d3-399eebe5ef41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:53.022927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 396/807] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:53.022927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ed835-ba3e-49a6-b752-87eea9653a78 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:53.023179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64d338-02cf-49d1-93d3-399eebe5ef41 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:53.023179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64d338-02cf-49d1-93d3-399eebe5ef41 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:53.023179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64d338-02cf-49d1-93d3-399eebe5ef41 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:53.032037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64d338-02cf-49d1-93d3-399eebe5ef41 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:53.033556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64d338-02cf-49d1-93d3-399eebe5ef41 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-5e64d338-02cf-49d1-93d3-399eebe5ef41 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:53.050103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:53.051318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:53.052624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:53.052624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:53.052624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:53.052624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:53.052624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:53.052624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:53.052624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:53.052624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:53.052624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 19:40:53.052624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:53.052624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 412/808] 10.222.0.15 () {56 vars in 1093 bytes} [Fri May 27 19:40:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:53.052624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6a557-4d40-454f-b3bf-cc019e2104ab None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:53.053312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6a557-4d40-454f-b3bf-cc019e2104ab None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:53.053312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c6a557-4d40-454f-b3bf-cc019e2104ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:53.070754 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-f3c6a557-4d40-454f-b3bf-cc019e2104ab None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:53.072481 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f3c6a557-4d40-454f-b3bf-cc019e2104ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:53.123358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:53.133175 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ed835-ba3e-49a6-b752-87eea9653a78 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:53.141909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 413/809] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:40:53.142794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6a557-4d40-454f-b3bf-cc019e2104ab None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:53.168627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8772f-cf08-4f87-9a7f-3ce0bd4ad703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:53.169299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8772f-cf08-4f87-9a7f-3ce0bd4ad703 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:53.169590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8772f-cf08-4f87-9a7f-3ce0bd4ad703 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:53.169871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8772f-cf08-4f87-9a7f-3ce0bd4ad703 None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:53.170703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8772f-cf08-4f87-9a7f-3ce0bd4ad703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:53.171022 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8772f-cf08-4f87-9a7f-3ce0bd4ad703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:53.172474 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8772f-cf08-4f87-9a7f-3ce0bd4ad703 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:53.185106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 397/810] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:53.186380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8772f-cf08-4f87-9a7f-3ce0bd4ad703 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:53.251755 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c6a557-4d40-454f-b3bf-cc019e2104ab None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:53.261754 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:53.286894 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe0be3-adcc-455a-a460-60daec7a75fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:53.287573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe0be3-adcc-455a-a460-60daec7a75fa None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:53.287865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe0be3-adcc-455a-a460-60daec7a75fa None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:53.288147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe0be3-adcc-455a-a460-60daec7a75fa None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:53.288897 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe0be3-adcc-455a-a460-60daec7a75fa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:53.289212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe0be3-adcc-455a-a460-60daec7a75fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:53.289301 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8772f-cf08-4f87-9a7f-3ce0bd4ad703 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:53.290690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe0be3-adcc-455a-a460-60daec7a75fa None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:53.296059 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 414/811] 10.222.0.15 () {56 vars in 1124 bytes} [Fri May 27 19:40:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:53.296957 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe0be3-adcc-455a-a460-60daec7a75fa None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:53.330053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5750e6-29e1-4c37-b6b1-8b92a66d7b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:53.330752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5750e6-29e1-4c37-b6b1-8b92a66d7b4d None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:53.331033 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5750e6-29e1-4c37-b6b1-8b92a66d7b4d None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:53.331310 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5750e6-29e1-4c37-b6b1-8b92a66d7b4d None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:53.332034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5750e6-29e1-4c37-b6b1-8b92a66d7b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:53.332339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5750e6-29e1-4c37-b6b1-8b92a66d7b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:53.333731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5750e6-29e1-4c37-b6b1-8b92a66d7b4d None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:53.346261 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 398/812] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:53.347121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5750e6-29e1-4c37-b6b1-8b92a66d7b4d None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:53.358900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:53.409015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe0be3-adcc-455a-a460-60daec7a75fa None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:53.448056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83e050-f5e3-4b77-9e94-7c6327de5e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:53.449030 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83e050-f5e3-4b77-9e94-7c6327de5e63 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:53.449316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83e050-f5e3-4b77-9e94-7c6327de5e63 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:53.449597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83e050-f5e3-4b77-9e94-7c6327de5e63 None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:53.450537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83e050-f5e3-4b77-9e94-7c6327de5e63 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:53.450855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83e050-f5e3-4b77-9e94-7c6327de5e63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:53.451673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5750e6-29e1-4c37-b6b1-8b92a66d7b4d None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:53.452303 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83e050-f5e3-4b77-9e94-7c6327de5e63 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:53.469534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 415/813] 10.222.0.15 () {56 vars in 1133 bytes} [Fri May 27 19:40:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:53.470412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83e050-f5e3-4b77-9e94-7c6327de5e63 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:53.495852 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34ed42-b4df-4ebb-898b-e8aed90abc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:53.496751 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34ed42-b4df-4ebb-898b-e8aed90abc41 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:53.497058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34ed42-b4df-4ebb-898b-e8aed90abc41 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:53.497345 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34ed42-b4df-4ebb-898b-e8aed90abc41 None admin] PATH_INFO: `/v3/services/network` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:53.498006 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34ed42-b4df-4ebb-898b-e8aed90abc41 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:53.499437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34ed42-b4df-4ebb-898b-e8aed90abc41 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:53.504801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-cf34ed42-b4df-4ebb-898b-e8aed90abc41 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:53.512244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:53.519936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:53.520939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:53.520939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:53.520939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:53.520939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:53.520939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:53.520939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:53.520939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:53.520939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:53.520939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:53.520939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:53.520939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:40:53.520939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:53.520939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 19:40:53.520939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:53.520939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 399/814] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:53 2022] GET /identity/v3/services/network => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:53.521835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34ed42-b4df-4ebb-898b-e8aed90abc41 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:53.583390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83e050-f5e3-4b77-9e94-7c6327de5e63 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:53.593284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:53.618147 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34ed42-b4df-4ebb-898b-e8aed90abc41 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:53.618550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a811f-b37d-4812-b2bc-e5f7ba50dcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:53.619473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a811f-b37d-4812-b2bc-e5f7ba50dcb8 None admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:53.619770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a811f-b37d-4812-b2bc-e5f7ba50dcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:53.620048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a811f-b37d-4812-b2bc-e5f7ba50dcb8 None admin] PATH_INFO: `/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/799058a415e44194a50697841b410062/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:53.622048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a811f-b37d-4812-b2bc-e5f7ba50dcb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=400421f9ccc6478783fa6bbc822b0687, user_id=799058a415e44194a50697841b410062, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:53.623527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a811f-b37d-4812-b2bc-e5f7ba50dcb8 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:53.652963 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c595fd6-486e-426e-9fb2-60622f60135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:53.653683 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c595fd6-486e-426e-9fb2-60622f60135c None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:53.654278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c595fd6-486e-426e-9fb2-60622f60135c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:53.654752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c595fd6-486e-426e-9fb2-60622f60135c None admin] PATH_INFO: `/v3/endpoints` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:53.655694 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c595fd6-486e-426e-9fb2-60622f60135c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:53.657520 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c595fd6-486e-426e-9fb2-60622f60135c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:53.712660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 416/815] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:40:53 2022] PUT /identity/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/799058a415e44194a50697841b410062/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:40:53.714000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a811f-b37d-4812-b2bc-e5f7ba50dcb8 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:53.745049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 400/816] 10.222.0.15 () {60 vars in 1144 bytes} [Fri May 27 19:40:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:40:53.745049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c595fd6-486e-426e-9fb2-60622f60135c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:53.841009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:53.859188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a811f-b37d-4812-b2bc-e5f7ba50dcb8 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:53.916188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c08513-33bf-475c-b21a-1911b54c1d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:53.917032 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c08513-33bf-475c-b21a-1911b54c1d6a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:53.917311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c08513-33bf-475c-b21a-1911b54c1d6a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:53.918475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c08513-33bf-475c-b21a-1911b54c1d6a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:53.923368 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c595fd6-486e-426e-9fb2-60622f60135c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:53.930099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c08513-33bf-475c-b21a-1911b54c1d6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:53.932449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c08513-33bf-475c-b21a-1911b54c1d6a None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-48c08513-33bf-475c-b21a-1911b54c1d6a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:53.949294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:53.950296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:53.951836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:53.951836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:53.951836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:53.951836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:53.951836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:53.951836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:53.951836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:53.951836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:53.951836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 19:40:53.951836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:53.951836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 417/817] 10.222.0.15 () {56 vars in 1117 bytes} [Fri May 27 19:40:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:53.952452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c08513-33bf-475c-b21a-1911b54c1d6a None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:53.968185 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:53.974123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b537739-f674-482f-8143-b37fb37610ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:53.974750 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b537739-f674-482f-8143-b37fb37610ba None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:53.975036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b537739-f674-482f-8143-b37fb37610ba None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:53.975310 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b537739-f674-482f-8143-b37fb37610ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:54.070525 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b537739-f674-482f-8143-b37fb37610ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:54.073463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b537739-f674-482f-8143-b37fb37610ba None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:54.090308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c08513-33bf-475c-b21a-1911b54c1d6a None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:54.139769 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940da9f-1b58-4be6-92c3-4171245a007f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:54.140938 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940da9f-1b58-4be6-92c3-4171245a007f None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:54.141304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940da9f-1b58-4be6-92c3-4171245a007f None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:54.141658 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940da9f-1b58-4be6-92c3-4171245a007f None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:54.142770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940da9f-1b58-4be6-92c3-4171245a007f None admin] RBAC: Adding query filter params (name=network) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:54.143160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940da9f-1b58-4be6-92c3-4171245a007f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:54.145341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940da9f-1b58-4be6-92c3-4171245a007f None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:54.152956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 418/818] 10.222.0.15 () {56 vars in 1112 bytes} [Fri May 27 19:40:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:54.153917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940da9f-1b58-4be6-92c3-4171245a007f None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:54.170940 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:54.204596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 401/819] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:40:54.205987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b537739-f674-482f-8143-b37fb37610ba None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:54.239434 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:54.273997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940da9f-1b58-4be6-92c3-4171245a007f None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:54.315332 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c23d2-2648-4eaa-8765-dcc28ca2ad62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:54.316270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c23d2-2648-4eaa-8765-dcc28ca2ad62 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:54.316562 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c23d2-2648-4eaa-8765-dcc28ca2ad62 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:54.317246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c23d2-2648-4eaa-8765-dcc28ca2ad62 None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:54.318392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c23d2-2648-4eaa-8765-dcc28ca2ad62 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:54.318715 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c23d2-2648-4eaa-8765-dcc28ca2ad62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:54.319940 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b537739-f674-482f-8143-b37fb37610ba None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:54.320168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c23d2-2648-4eaa-8765-dcc28ca2ad62 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:54.343974 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 419/820] 10.222.0.15 () {56 vars in 1149 bytes} [Fri May 27 19:40:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:54.344849 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c23d2-2648-4eaa-8765-dcc28ca2ad62 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:54.362017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3118a-61d9-4f4c-8b25-dc90eb55e598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:54.362831 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3118a-61d9-4f4c-8b25-dc90eb55e598 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:54.363192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3118a-61d9-4f4c-8b25-dc90eb55e598 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:54.363545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3118a-61d9-4f4c-8b25-dc90eb55e598 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:54.364395 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3118a-61d9-4f4c-8b25-dc90eb55e598 None admin] RBAC: Adding query filter params (type=network) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:54.364779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3118a-61d9-4f4c-8b25-dc90eb55e598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:54.366293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3118a-61d9-4f4c-8b25-dc90eb55e598 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:54.372625 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 402/821] 10.222.0.15 () {56 vars in 1112 bytes} [Fri May 27 19:40:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:54.373473 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3118a-61d9-4f4c-8b25-dc90eb55e598 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:54.436991 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:54.478312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c23d2-2648-4eaa-8765-dcc28ca2ad62 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:54.520561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735feb7c-9842-4a40-a553-9e77eb0c9c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:54.521373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735feb7c-9842-4a40-a553-9e77eb0c9c89 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:54.521665 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735feb7c-9842-4a40-a553-9e77eb0c9c89 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:54.521946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735feb7c-9842-4a40-a553-9e77eb0c9c89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:54.534835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735feb7c-9842-4a40-a553-9e77eb0c9c89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:54.536620 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:54.537726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735feb7c-9842-4a40-a553-9e77eb0c9c89 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:54.550459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3118a-61d9-4f4c-8b25-dc90eb55e598 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:54.563685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-735feb7c-9842-4a40-a553-9e77eb0c9c89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:54.563685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:54.563685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:54.563685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:54.563685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:54.563685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:54.563685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:54.563685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:54.563685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:54.563685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:54.563685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:54.563685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:54.563685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:54.563685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:54.563685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:54.565446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:54.567844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:54.567844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:54.567844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:54.567844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:54.571089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 420/822] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:54.572723 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735feb7c-9842-4a40-a553-9e77eb0c9c89 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:54.619529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966ffae-0f3e-4865-b48a-4d5bf598d214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:54.621387 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966ffae-0f3e-4865-b48a-4d5bf598d214 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:54.622130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966ffae-0f3e-4865-b48a-4d5bf598d214 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:54.622934 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966ffae-0f3e-4865-b48a-4d5bf598d214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:54.641581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966ffae-0f3e-4865-b48a-4d5bf598d214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:54.644475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966ffae-0f3e-4865-b48a-4d5bf598d214 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:54.678823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-7966ffae-0f3e-4865-b48a-4d5bf598d214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:54.678823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:54.678823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:54.678823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:54.678823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:54.678823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:54.678823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:54.678823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:54.678823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:54.678823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:54.678823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:54.678823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:54.678823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:54.678823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:54.678823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:54.680549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:54.684020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:54.684020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:54.684020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:54.684020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:54.684820 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735feb7c-9842-4a40-a553-9e77eb0c9c89 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:54.694792 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 403/823] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:54.694792 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966ffae-0f3e-4865-b48a-4d5bf598d214 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:54.710524 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:54.733070 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdcac6-9c3c-4c96-9211-956127b92791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:54.734570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdcac6-9c3c-4c96-9211-956127b92791 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:54.735292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdcac6-9c3c-4c96-9211-956127b92791 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:54.736829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdcac6-9c3c-4c96-9211-956127b92791 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:54.737895 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdcac6-9c3c-4c96-9211-956127b92791 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:54.739648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdcac6-9c3c-4c96-9211-956127b92791 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:54.815430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966ffae-0f3e-4865-b48a-4d5bf598d214 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:54.855848 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ebcde-4c46-4a67-948a-addd0c739e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:54.860757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ebcde-4c46-4a67-948a-addd0c739e5a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:54.860757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ebcde-4c46-4a67-948a-addd0c739e5a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:54.860757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ebcde-4c46-4a67-948a-addd0c739e5a None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:54.860757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ebcde-4c46-4a67-948a-addd0c739e5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:54.860757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ebcde-4c46-4a67-948a-addd0c739e5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:54.860757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ebcde-4c46-4a67-948a-addd0c739e5a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:54.861446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 421/824] 10.222.0.15 () {60 vars in 1144 bytes} [Fri May 27 19:40:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:40:54.863578 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdcac6-9c3c-4c96-9211-956127b92791 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:54.882481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 404/825] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:54.882481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ebcde-4c46-4a67-948a-addd0c739e5a None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:54.894843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:55.091271 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdcac6-9c3c-4c96-9211-956127b92791 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:55.117232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ebcde-4c46-4a67-948a-addd0c739e5a None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:55.138724 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a9646-f14b-472e-b3fa-bd22d09e43ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:55.140010 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a9646-f14b-472e-b3fa-bd22d09e43ad None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:55.140516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a9646-f14b-472e-b3fa-bd22d09e43ad None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:55.141469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a9646-f14b-472e-b3fa-bd22d09e43ad None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:55.142496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a9646-f14b-472e-b3fa-bd22d09e43ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:55.143255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a9646-f14b-472e-b3fa-bd22d09e43ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:55.145189 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a9646-f14b-472e-b3fa-bd22d09e43ad None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:55.161574 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 422/826] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:55.168648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a9646-f14b-472e-b3fa-bd22d09e43ad None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:55.176658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04074467-a999-449f-aec6-6e7eb59ec941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:55.177561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074467-a999-449f-aec6-6e7eb59ec941 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:55.177923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074467-a999-449f-aec6-6e7eb59ec941 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:55.178275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04074467-a999-449f-aec6-6e7eb59ec941 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:55.188258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04074467-a999-449f-aec6-6e7eb59ec941 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:55.190652 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04074467-a999-449f-aec6-6e7eb59ec941 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:55.208745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:55.211494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-04074467-a999-449f-aec6-6e7eb59ec941 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:55.211494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:55.211494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:55.211494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:55.211494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:55.211494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:55.211494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:55.211494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:55.211494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:55.211494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:55.211494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:55.211494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:55.211494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:55.211494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:55.211494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:55.212730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:55.213894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:55.213894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:55.213894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:55.213894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:55.213894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:55.213894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:55.213894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:55.213894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:55.217452 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 405/827] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:55.223916 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04074467-a999-449f-aec6-6e7eb59ec941 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:55.312703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:55.313169 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a9646-f14b-472e-b3fa-bd22d09e43ad None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:55.357287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01c9ae-87be-443e-a9a2-ce1503086bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:55.358536 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01c9ae-87be-443e-a9a2-ce1503086bd1 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:55.359001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01c9ae-87be-443e-a9a2-ce1503086bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:55.359474 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01c9ae-87be-443e-a9a2-ce1503086bd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:55.361740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04074467-a999-449f-aec6-6e7eb59ec941 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:55.367783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01c9ae-87be-443e-a9a2-ce1503086bd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:55.370023 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01c9ae-87be-443e-a9a2-ce1503086bd1 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:55.386444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-bd01c9ae-87be-443e-a9a2-ce1503086bd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:55.386444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:55.386444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:55.386444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:55.386444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:55.386444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:55.386444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:55.386444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:55.386444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:55.386444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:55.386444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:55.386444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:55.386444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:55.386444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:55.386444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:55.387516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:55.388641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:55.388641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:55.388641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:55.388641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:55.388641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:55.388641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:55.388641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:55.388641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:55.391777 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 423/828] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:55.398579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01c9ae-87be-443e-a9a2-ce1503086bd1 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:55.402022 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37c573-b1c9-4a8c-b272-7b7b8b3fa5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:55.403531 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37c573-b1c9-4a8c-b272-7b7b8b3fa5ea None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:55.403531 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37c573-b1c9-4a8c-b272-7b7b8b3fa5ea None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:55.403531 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37c573-b1c9-4a8c-b272-7b7b8b3fa5ea None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:55.404422 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37c573-b1c9-4a8c-b272-7b7b8b3fa5ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:55.404801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37c573-b1c9-4a8c-b272-7b7b8b3fa5ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:55.407241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37c573-b1c9-4a8c-b272-7b7b8b3fa5ea None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:55.428030 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 406/829] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:55.429294 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37c573-b1c9-4a8c-b272-7b7b8b3fa5ea None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:55.518770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:55.522888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01c9ae-87be-443e-a9a2-ce1503086bd1 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:55.559818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de48e63-04ef-43bf-af28-2bc829214909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:55.560838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de48e63-04ef-43bf-af28-2bc829214909 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:55.561275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37c573-b1c9-4a8c-b272-7b7b8b3fa5ea None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:55.561558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de48e63-04ef-43bf-af28-2bc829214909 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:55.562026 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de48e63-04ef-43bf-af28-2bc829214909 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:55.563056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de48e63-04ef-43bf-af28-2bc829214909 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:55.563581 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de48e63-04ef-43bf-af28-2bc829214909 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:55.565207 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de48e63-04ef-43bf-af28-2bc829214909 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:55.582615 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 424/830] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:55.584521 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de48e63-04ef-43bf-af28-2bc829214909 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:55.591921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:55.603577 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdbeed-50d7-473d-8b54-d628b3aef258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:55.604520 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdbeed-50d7-473d-8b54-d628b3aef258 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:55.605429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdbeed-50d7-473d-8b54-d628b3aef258 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:55.605429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdbeed-50d7-473d-8b54-d628b3aef258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:55.605929 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdbeed-50d7-473d-8b54-d628b3aef258 None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=105353b6b1a941ac81df7ad35567ba7c) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:55.606248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdbeed-50d7-473d-8b54-d628b3aef258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:55.608235 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdbeed-50d7-473d-8b54-d628b3aef258 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:55.621514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 407/831] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:40:55 2022] GET /identity/v3/role_assignments?user.id=105353b6b1a941ac81df7ad35567ba7c&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:55.717306 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de48e63-04ef-43bf-af28-2bc829214909 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:55.759168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c28eb-1cbb-458a-8125-3fde6cae36a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:55.760973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c28eb-1cbb-458a-8125-3fde6cae36a2 None admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:55.761505 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c28eb-1cbb-458a-8125-3fde6cae36a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:55.762027 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c28eb-1cbb-458a-8125-3fde6cae36a2 None admin] PATH_INFO: `/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/bffc7facb4ce4ab9967b0c8d88d0433b/roles/30112fca4d6549a790f2eadf20635343` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:55.779323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c28eb-1cbb-458a-8125-3fde6cae36a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=400421f9ccc6478783fa6bbc822b0687, user_id=bffc7facb4ce4ab9967b0c8d88d0433b, role_id=30112fca4d6549a790f2eadf20635343)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:55.781253 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c28eb-1cbb-458a-8125-3fde6cae36a2 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:55.871061 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 425/832] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:40:55 2022] PUT /identity/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/bffc7facb4ce4ab9967b0c8d88d0433b/roles/30112fca4d6549a790f2eadf20635343 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:40:56.280028 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8460cb1-5a41-47ef-9bc4-063375e519da None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:56.280537 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8460cb1-5a41-47ef-9bc4-063375e519da None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:56.280537 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8460cb1-5a41-47ef-9bc4-063375e519da None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:56.282297 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 408/833] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:56.287955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da58c12-c3ac-4817-8bfa-521f61cd7678 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:56.288255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da58c12-c3ac-4817-8bfa-521f61cd7678 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:56.288546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da58c12-c3ac-4817-8bfa-521f61cd7678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:56.293935 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:56.308801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-7da58c12-c3ac-4817-8bfa-521f61cd7678 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:56.310334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-7da58c12-c3ac-4817-8bfa-521f61cd7678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:56.385196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 426/834] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:40:56.411485 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8460cb1-5a41-47ef-9bc4-063375e519da None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:56.449155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b63de3-b5c8-4c88-9694-d357c44147d6 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:56.449484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b63de3-b5c8-4c88-9694-d357c44147d6 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:56.449800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b63de3-b5c8-4c88-9694-d357c44147d6 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:56.451616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 427/835] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:40:56.456724 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27238c4e-ebc1-461f-b38c-5ed217af00c2 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:56.457020 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27238c4e-ebc1-461f-b38c-5ed217af00c2 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:56.457300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27238c4e-ebc1-461f-b38c-5ed217af00c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:56.474693 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-27238c4e-ebc1-461f-b38c-5ed217af00c2 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:56.475924 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-27238c4e-ebc1-461f-b38c-5ed217af00c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:56.547239 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8460cb1-5a41-47ef-9bc4-063375e519da None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:56.552397 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 428/836] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:40:56.579471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27238c4e-ebc1-461f-b38c-5ed217af00c2 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:56.590499 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549a90e-ef40-48a4-8385-1c5206e96f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:56.593090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549a90e-ef40-48a4-8385-1c5206e96f17 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:56.593419 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549a90e-ef40-48a4-8385-1c5206e96f17 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:56.593701 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549a90e-ef40-48a4-8385-1c5206e96f17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:56.608365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549a90e-ef40-48a4-8385-1c5206e96f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-3549a90e-ef40-48a4-8385-1c5206e96f17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:56.618228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:56.619275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:56.620120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:56.620120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:56.620120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:56.620120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:56.620120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:56.620120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:56.620120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:56.620120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:56.620120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:56.620120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:56.620120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:40:56.620120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:56.620779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 409/837] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:40:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:56.631261 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549a90e-ef40-48a4-8385-1c5206e96f17 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:56.654683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:56.697203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27238c4e-ebc1-461f-b38c-5ed217af00c2 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:56.706703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:56.735957 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639116e-9553-4be1-830e-ebfda9c68d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:56.736749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639116e-9553-4be1-830e-ebfda9c68d08 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:56.737032 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639116e-9553-4be1-830e-ebfda9c68d08 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:56.737305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639116e-9553-4be1-830e-ebfda9c68d08 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:56.738741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639116e-9553-4be1-830e-ebfda9c68d08 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:56.739378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639116e-9553-4be1-830e-ebfda9c68d08 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-8639116e-9553-4be1-830e-ebfda9c68d08 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:56.753444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:56.754707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:56.755666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:56.755666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:56.755666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:56.755666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:56.755666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:56.755666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:56.755666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:56.755666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:56.755666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:56.755666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:56.755666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:40:56.755666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:56.755666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 19:40:56.755666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:56.755666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 429/838] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:40:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:56.761654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639116e-9553-4be1-830e-ebfda9c68d08 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:56.789628 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549a90e-ef40-48a4-8385-1c5206e96f17 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:56.839307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23acf1-5027-4b9c-b242-3869427789f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:56.840594 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23acf1-5027-4b9c-b242-3869427789f1 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:56.841091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23acf1-5027-4b9c-b242-3869427789f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:56.841607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23acf1-5027-4b9c-b242-3869427789f1 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:56.843763 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23acf1-5027-4b9c-b242-3869427789f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:56.844296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23acf1-5027-4b9c-b242-3869427789f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:56.845883 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23acf1-5027-4b9c-b242-3869427789f1 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:56.862655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 410/839] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:56.863755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23acf1-5027-4b9c-b242-3869427789f1 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:56.892390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639116e-9553-4be1-830e-ebfda9c68d08 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:56.930911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:56.942236 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b9c01-e03b-43cd-9249-85b0e4ae2dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:56.944874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b9c01-e03b-43cd-9249-85b0e4ae2dd5 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:56.944874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b9c01-e03b-43cd-9249-85b0e4ae2dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:56.944874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b9c01-e03b-43cd-9249-85b0e4ae2dd5 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:56.944874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b9c01-e03b-43cd-9249-85b0e4ae2dd5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:56.944874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b9c01-e03b-43cd-9249-85b0e4ae2dd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:56.946816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b9c01-e03b-43cd-9249-85b0e4ae2dd5 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:56.952062 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 430/840] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:40:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:56.960205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b9c01-e03b-43cd-9249-85b0e4ae2dd5 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:56.984922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23acf1-5027-4b9c-b242-3869427789f1 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:57.006749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:57.031623 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe1a4a-a1f1-466e-8f62-043536869657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:57.032437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe1a4a-a1f1-466e-8f62-043536869657 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:57.032725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe1a4a-a1f1-466e-8f62-043536869657 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:57.033007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe1a4a-a1f1-466e-8f62-043536869657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:57.044938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe1a4a-a1f1-466e-8f62-043536869657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:57.046452 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe1a4a-a1f1-466e-8f62-043536869657 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:57.064867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-acbe1a4a-a1f1-466e-8f62-043536869657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:57.064867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:57.064867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:57.064867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:57.064867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:57.064867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:57.064867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:57.064867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:57.064867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:57.064867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:57.064867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:57.064867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:57.064867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:57.064867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:57.064867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:57.066142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:57.067488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:57.067488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:57.067488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:57.067488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:57.070891 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 411/841] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:57.072365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe1a4a-a1f1-466e-8f62-043536869657 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:57.083771 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b9c01-e03b-43cd-9249-85b0e4ae2dd5 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:57.127972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b53b01-e398-4bb5-83cd-ec4095e59f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:57.128620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b53b01-e398-4bb5-83cd-ec4095e59f5c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:57.128914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b53b01-e398-4bb5-83cd-ec4095e59f5c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:57.129512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b53b01-e398-4bb5-83cd-ec4095e59f5c None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:57.129957 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b53b01-e398-4bb5-83cd-ec4095e59f5c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:57.130274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b53b01-e398-4bb5-83cd-ec4095e59f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:57.131742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b53b01-e398-4bb5-83cd-ec4095e59f5c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:57.137560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 431/842] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:40:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:57.195917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe1a4a-a1f1-466e-8f62-043536869657 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:57.237571 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536132f-bae3-4a7f-9895-ef134a7fb323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:57.238315 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536132f-bae3-4a7f-9895-ef134a7fb323 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:57.238674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536132f-bae3-4a7f-9895-ef134a7fb323 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:57.239002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536132f-bae3-4a7f-9895-ef134a7fb323 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:57.239815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536132f-bae3-4a7f-9895-ef134a7fb323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:57.240183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536132f-bae3-4a7f-9895-ef134a7fb323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:57.241978 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536132f-bae3-4a7f-9895-ef134a7fb323 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:57.266010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 412/843] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:57.271542 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b53b01-e398-4bb5-83cd-ec4095e59f5c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:57.342786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:57.390375 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b53b01-e398-4bb5-83cd-ec4095e59f5c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:57.426648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb21a2d-3f1d-4fe0-b7a6-d8b19fbf22ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:57.427456 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb21a2d-3f1d-4fe0-b7a6-d8b19fbf22ab None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:57.427749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb21a2d-3f1d-4fe0-b7a6-d8b19fbf22ab None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:57.428031 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb21a2d-3f1d-4fe0-b7a6-d8b19fbf22ab None admin] PATH_INFO: `/v3/users/swift` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:57.436671 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb21a2d-3f1d-4fe0-b7a6-d8b19fbf22ab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:57.438115 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb21a2d-3f1d-4fe0-b7a6-d8b19fbf22ab None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-9fb21a2d-3f1d-4fe0-b7a6-d8b19fbf22ab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:57.452739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:57.453716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:57.454700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:57.454700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:57.454700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:57.454700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:57.454700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:57.454700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:57.454700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:57.454700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:57.454700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 19:40:57.454700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:57.454700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 432/844] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:40:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:57.459777 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536132f-bae3-4a7f-9895-ef134a7fb323 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:57.498881 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:57.578370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536132f-bae3-4a7f-9895-ef134a7fb323 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:57.617035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941f6ce-8a18-4f25-aa19-0260d8173e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:57.617725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941f6ce-8a18-4f25-aa19-0260d8173e0a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:57.618049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941f6ce-8a18-4f25-aa19-0260d8173e0a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:57.618356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941f6ce-8a18-4f25-aa19-0260d8173e0a None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:57.619211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941f6ce-8a18-4f25-aa19-0260d8173e0a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:57.619525 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941f6ce-8a18-4f25-aa19-0260d8173e0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:57.620956 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941f6ce-8a18-4f25-aa19-0260d8173e0a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:57.639285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 413/845] 10.222.0.15 () {56 vars in 1135 bytes} [Fri May 27 19:40:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:57.645083 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb21a2d-3f1d-4fe0-b7a6-d8b19fbf22ab None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:57.756578 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb21a2d-3f1d-4fe0-b7a6-d8b19fbf22ab None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:57.772946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:57.795018 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b93e7-9b53-463e-a927-77c704e87e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:57.795752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b93e7-9b53-463e-a927-77c704e87e47 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:57.796049 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b93e7-9b53-463e-a927-77c704e87e47 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:57.796335 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b93e7-9b53-463e-a927-77c704e87e47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:57.873685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b93e7-9b53-463e-a927-77c704e87e47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:57.875248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b93e7-9b53-463e-a927-77c704e87e47 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:57.984054 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 433/846] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:40:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:40:57.989906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941f6ce-8a18-4f25-aa19-0260d8173e0a None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:58.079225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:58.083029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876aaec-2dc4-448f-b4f8-8428c9e2b418 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:58.083331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876aaec-2dc4-448f-b4f8-8428c9e2b418 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:58.083620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876aaec-2dc4-448f-b4f8-8428c9e2b418 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:58.085143 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 434/847] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:40:58.093036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905a6f3-bf06-424a-b5bb-540a6a6cf491 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:58.093036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905a6f3-bf06-424a-b5bb-540a6a6cf491 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:58.093036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905a6f3-bf06-424a-b5bb-540a6a6cf491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:58.106743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941f6ce-8a18-4f25-aa19-0260d8173e0a None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:58.118625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-b905a6f3-bf06-424a-b5bb-540a6a6cf491 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:58.120455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b905a6f3-bf06-424a-b5bb-540a6a6cf491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:58.132516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:58.151624 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe408e-4863-4425-87f0-bd8645871b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:58.152470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe408e-4863-4425-87f0-bd8645871b7c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:58.152769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe408e-4863-4425-87f0-bd8645871b7c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:58.153110 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe408e-4863-4425-87f0-bd8645871b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:58.167158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe408e-4863-4425-87f0-bd8645871b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:58.168833 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe408e-4863-4425-87f0-bd8645871b7c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:58.197822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-fcbe408e-4863-4425-87f0-bd8645871b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:58.197822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:58.197822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:58.197822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:58.197822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:58.197822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:58.197822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:58.197822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:58.197822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:58.197822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:58.197822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:58.197822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:58.197822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:58.197822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:58.197822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:58.198939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:58.199912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:58.199912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:58.199912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:58.199912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:58.202657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 414/848] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:58.205387 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe408e-4863-4425-87f0-bd8645871b7c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:58.222363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 435/849] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:40:58.237619 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905a6f3-bf06-424a-b5bb-540a6a6cf491 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:58.316727 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe408e-4863-4425-87f0-bd8645871b7c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:58.356610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905a6f3-bf06-424a-b5bb-540a6a6cf491 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:58.359349 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bc726-763c-4140-a968-b9b7e80d796c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:58.360709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bc726-763c-4140-a968-b9b7e80d796c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:58.360709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bc726-763c-4140-a968-b9b7e80d796c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:58.360709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0bc726-763c-4140-a968-b9b7e80d796c None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:58.361304 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bc726-763c-4140-a968-b9b7e80d796c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:58.361621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bc726-763c-4140-a968-b9b7e80d796c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:58.363046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0bc726-763c-4140-a968-b9b7e80d796c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:58.378549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:58.379895 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 415/850] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:58.381428 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bc726-763c-4140-a968-b9b7e80d796c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:58.396340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2617c1e-dba1-48f9-a2e5-a21ffab90a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:58.397526 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2617c1e-dba1-48f9-a2e5-a21ffab90a53 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:58.398037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2617c1e-dba1-48f9-a2e5-a21ffab90a53 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:58.398573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2617c1e-dba1-48f9-a2e5-a21ffab90a53 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:58.399971 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2617c1e-dba1-48f9-a2e5-a21ffab90a53 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:58.401642 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2617c1e-dba1-48f9-a2e5-a21ffab90a53 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-e2617c1e-dba1-48f9-a2e5-a21ffab90a53 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:58.416479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:58.417611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:58.418598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:58.418598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:58.418598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:58.418598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:58.418598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:58.418598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:58.418598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:58.418598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:58.418598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:58.418598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:58.418598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:58.418598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:40:58.418598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:40:58.418598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 19:40:58.418598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:58.427585 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 436/851] 10.222.0.15 () {56 vars in 1132 bytes} [Fri May 27 19:40:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:58.429046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2617c1e-dba1-48f9-a2e5-a21ffab90a53 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:58.442223 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:58.520013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0bc726-763c-4140-a968-b9b7e80d796c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:58.559943 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2617c1e-dba1-48f9-a2e5-a21ffab90a53 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:58.560163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddd75f-4475-4e13-8ffe-8949264a3e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:58.561080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddd75f-4475-4e13-8ffe-8949264a3e44 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:58.561561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddd75f-4475-4e13-8ffe-8949264a3e44 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:58.562011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddd75f-4475-4e13-8ffe-8949264a3e44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:58.570518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddd75f-4475-4e13-8ffe-8949264a3e44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:58.573108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddd75f-4475-4e13-8ffe-8949264a3e44 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:58.590443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-30ddd75f-4475-4e13-8ffe-8949264a3e44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:58.590443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:58.590443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:58.590443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:58.590443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:58.590443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:58.590443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:58.590443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:58.590443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:58.590443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:58.590443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:58.590443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:58.590443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:40:58.590443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:40:58.590443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:58.591390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:58.593118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:40:58.593118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:40:58.593118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:40:58.593118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:40:58.593118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:40:58.593118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:40:58.593118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:40:58.593118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:58.593118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 416/852] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:40:58.593846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ecff1-9949-4c0c-8767-830899f4ec89 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:58.594066 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ecff1-9949-4c0c-8767-830899f4ec89 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:58.594494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ecff1-9949-4c0c-8767-830899f4ec89 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:58.596161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 417/853] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:58.599332 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ecff1-9949-4c0c-8767-830899f4ec89 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:58.601398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a34afe4-f2c7-4247-ad51-b02db0b09717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:58.602080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34afe4-f2c7-4247-ad51-b02db0b09717 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:58.602449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34afe4-f2c7-4247-ad51-b02db0b09717 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:58.602818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a34afe4-f2c7-4247-ad51-b02db0b09717 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:58.603547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34afe4-f2c7-4247-ad51-b02db0b09717 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:58.603864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34afe4-f2c7-4247-ad51-b02db0b09717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:58.605248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a34afe4-f2c7-4247-ad51-b02db0b09717 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:58.610454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 437/854] 10.222.0.15 () {56 vars in 1126 bytes} [Fri May 27 19:40:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:58.611666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8c213-f836-4bad-b427-d5f8ee1d913e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:58.611976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8c213-f836-4bad-b427-d5f8ee1d913e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:58.612233 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8c213-f836-4bad-b427-d5f8ee1d913e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:58.631929 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-5fa8c213-f836-4bad-b427-d5f8ee1d913e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:58.633356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5fa8c213-f836-4bad-b427-d5f8ee1d913e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:58.666880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:58.714401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 438/855] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:40:58.714401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8c213-f836-4bad-b427-d5f8ee1d913e None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:58.714401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:58.726355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ecff1-9949-4c0c-8767-830899f4ec89 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:58.770157 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4bd5c-b5d7-4526-9b7c-8c90fd659ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:58.770788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4bd5c-b5d7-4526-9b7c-8c90fd659ff7 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:58.771087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4bd5c-b5d7-4526-9b7c-8c90fd659ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:58.771383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4bd5c-b5d7-4526-9b7c-8c90fd659ff7 None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:58.772159 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4bd5c-b5d7-4526-9b7c-8c90fd659ff7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:58.772475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4bd5c-b5d7-4526-9b7c-8c90fd659ff7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:58.773950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a4bd5c-b5d7-4526-9b7c-8c90fd659ff7 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:58.787573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 418/856] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:58.792162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4bd5c-b5d7-4526-9b7c-8c90fd659ff7 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:58.830473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8c213-f836-4bad-b427-d5f8ee1d913e None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:58.868767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78711420-9712-437d-ab43-8ce541d61cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:58.869446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78711420-9712-437d-ab43-8ce541d61cd7 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:58.869724 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78711420-9712-437d-ab43-8ce541d61cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:58.870009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78711420-9712-437d-ab43-8ce541d61cd7 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:58.870752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78711420-9712-437d-ab43-8ce541d61cd7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:58.871070 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78711420-9712-437d-ab43-8ce541d61cd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:58.872566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78711420-9712-437d-ab43-8ce541d61cd7 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:58.878038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 439/857] 10.222.0.15 () {56 vars in 1126 bytes} [Fri May 27 19:40:58 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:58.878872 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78711420-9712-437d-ab43-8ce541d61cd7 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:58.925435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4bd5c-b5d7-4526-9b7c-8c90fd659ff7 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:58.943816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:58.969778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c68a6-e172-4d5a-a8c8-1b87ba6780aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:58.970988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c68a6-e172-4d5a-a8c8-1b87ba6780aa None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:58.971470 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:58.971944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c68a6-e172-4d5a-a8c8-1b87ba6780aa None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:58.972424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c68a6-e172-4d5a-a8c8-1b87ba6780aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:58.987769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c68a6-e172-4d5a-a8c8-1b87ba6780aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-d76c68a6-e172-4d5a-a8c8-1b87ba6780aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:40:58.997634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:58.999125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:59.000178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:59.000178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:59.000178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:59.000178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:59.000178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:40:59.000178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:40:59.000178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:40:59.000178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:40:59.000178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:40:59.000178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:40:59.000178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:40:59.000178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:59.002806 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 419/858] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:40:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:59.009086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c68a6-e172-4d5a-a8c8-1b87ba6780aa None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:59.024978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78711420-9712-437d-ab43-8ce541d61cd7 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:59.073310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25914c-f389-41b7-aa62-82a537602bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:59.073993 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25914c-f389-41b7-aa62-82a537602bb4 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:59.074320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25914c-f389-41b7-aa62-82a537602bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:59.074726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25914c-f389-41b7-aa62-82a537602bb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:59.075584 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25914c-f389-41b7-aa62-82a537602bb4 None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=799058a415e44194a50697841b410062) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:59.076640 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25914c-f389-41b7-aa62-82a537602bb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:59.078166 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25914c-f389-41b7-aa62-82a537602bb4 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:59.094370 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 440/859] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:40:58 2022] GET /identity/v3/role_assignments?user.id=799058a415e44194a50697841b410062&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:59.161943 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c68a6-e172-4d5a-a8c8-1b87ba6780aa None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:59.207184 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4560779-7ca1-46a4-9194-a49379088cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:59.207980 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4560779-7ca1-46a4-9194-a49379088cf7 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:59.208271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4560779-7ca1-46a4-9194-a49379088cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:59.208608 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4560779-7ca1-46a4-9194-a49379088cf7 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:59.209428 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4560779-7ca1-46a4-9194-a49379088cf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:59.209810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4560779-7ca1-46a4-9194-a49379088cf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:59.211366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4560779-7ca1-46a4-9194-a49379088cf7 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:59.222774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 420/860] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:40:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:40:59.231736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25914c-f389-41b7-aa62-82a537602bb4 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:59.355375 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25914c-f389-41b7-aa62-82a537602bb4 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:59.389785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:59.397099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d8b62-d658-45ac-995d-fc037122fda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:59.401769 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d8b62-d658-45ac-995d-fc037122fda9 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:59.401769 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d8b62-d658-45ac-995d-fc037122fda9 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:59.401769 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d8b62-d658-45ac-995d-fc037122fda9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:59.410973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d8b62-d658-45ac-995d-fc037122fda9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:59.412739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d8b62-d658-45ac-995d-fc037122fda9 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:59.432365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-833d8b62-d658-45ac-995d-fc037122fda9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:59.432365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:59.432365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:59.432365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:59.432365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:59.432365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:59.432365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:59.432365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:59.432365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:59.432365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:59.432365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:59.432365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:59.432365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:40:59.432365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:40:59.432365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:59.433390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:59.434278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:40:59.434278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:40:59.434278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:40:59.434278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:40:59.436406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 441/861] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:59.442514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4560779-7ca1-46a4-9194-a49379088cf7 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:59.491952 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:59.494749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898501-7804-420f-a39c-fdb61f9189aa None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:59.495041 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898501-7804-420f-a39c-fdb61f9189aa None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:59.495430 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5898501-7804-420f-a39c-fdb61f9189aa None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:59.497157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 442/862] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:40:59.503958 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898d8be-c4c2-41b6-8d53-7fb22b09e475 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:59.508035 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898d8be-c4c2-41b6-8d53-7fb22b09e475 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:59.508035 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898d8be-c4c2-41b6-8d53-7fb22b09e475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:59.526642 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-3898d8be-c4c2-41b6-8d53-7fb22b09e475 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:40:59.528200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-3898d8be-c4c2-41b6-8d53-7fb22b09e475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:40:59.607074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4560779-7ca1-46a4-9194-a49379088cf7 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:59.626267 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 443/863] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:40:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:40:59.653439 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438799a-6167-4581-8c70-d54ed18d4237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:59.654392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438799a-6167-4581-8c70-d54ed18d4237 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:59.654739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438799a-6167-4581-8c70-d54ed18d4237 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:59.655127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438799a-6167-4581-8c70-d54ed18d4237 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:59.655810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898d8be-c4c2-41b6-8d53-7fb22b09e475 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:59.656164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438799a-6167-4581-8c70-d54ed18d4237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:40:59.656714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438799a-6167-4581-8c70-d54ed18d4237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:59.658820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438799a-6167-4581-8c70-d54ed18d4237 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:59.679666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 421/864] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:40:59.680889 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438799a-6167-4581-8c70-d54ed18d4237 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:59.791811 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898d8be-c4c2-41b6-8d53-7fb22b09e475 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:59.812644 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:59.816637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:40:59.830510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438799a-6167-4581-8c70-d54ed18d4237 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:40:59.839904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f07df-3252-45eb-86cf-aadbd50986e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:59.840588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f07df-3252-45eb-86cf-aadbd50986e8 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:59.840877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f07df-3252-45eb-86cf-aadbd50986e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:59.841160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f07df-3252-45eb-86cf-aadbd50986e8 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:59.841961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f07df-3252-45eb-86cf-aadbd50986e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:59.843416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f07df-3252-45eb-86cf-aadbd50986e8 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:59.874201 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f8321-b9d5-4261-8d35-1a1063ee3d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:40:59.875322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f8321-b9d5-4261-8d35-1a1063ee3d15 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:40:59.875617 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f8321-b9d5-4261-8d35-1a1063ee3d15 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:40:59.875887 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f8321-b9d5-4261-8d35-1a1063ee3d15 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:40:59.883203 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f8321-b9d5-4261-8d35-1a1063ee3d15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:40:59.888044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f8321-b9d5-4261-8d35-1a1063ee3d15 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-3a3f8321-b9d5-4261-8d35-1a1063ee3d15 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:40:59.901321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:40:59.902526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:40:59.903911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:40:59.903911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:40:59.903911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:40:59.903911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:40:59.903911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:40:59.903911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:40:59.903911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:40:59.903911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:40:59.903911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 19:40:59.903911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:40:59.906656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 422/865] 10.222.0.15 () {56 vars in 1117 bytes} [Fri May 27 19:40:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:40:59.908135 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f8321-b9d5-4261-8d35-1a1063ee3d15 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:40:59.951620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 444/866] 10.222.0.15 () {60 vars in 1141 bytes} [Fri May 27 19:40:59 2022] POST /identity/v3/services => generated 251 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 19:41:00.076887 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f8321-b9d5-4261-8d35-1a1063ee3d15 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:00.152076 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f12488-bc63-4463-92ba-4957f642e97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:00.152817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f12488-bc63-4463-92ba-4957f642e97d None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:00.153139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f12488-bc63-4463-92ba-4957f642e97d None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:00.153472 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f12488-bc63-4463-92ba-4957f642e97d None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:00.155327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f12488-bc63-4463-92ba-4957f642e97d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:00.155327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f12488-bc63-4463-92ba-4957f642e97d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:00.156494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f12488-bc63-4463-92ba-4957f642e97d None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:00.181494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 423/867] 10.222.0.15 () {56 vars in 1149 bytes} [Fri May 27 19:40:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:00.187985 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f07df-3252-45eb-86cf-aadbd50986e8 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:00.315308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f07df-3252-45eb-86cf-aadbd50986e8 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:00.359337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea207aae-8c42-4a78-97da-18e594c26978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:00.360110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea207aae-8c42-4a78-97da-18e594c26978 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:00.360518 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea207aae-8c42-4a78-97da-18e594c26978 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:00.360801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea207aae-8c42-4a78-97da-18e594c26978 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:00.413610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:00.442764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea207aae-8c42-4a78-97da-18e594c26978 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:00.444372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea207aae-8c42-4a78-97da-18e594c26978 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:00.576289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 445/868] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:41:00 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:41:00.581970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f12488-bc63-4463-92ba-4957f642e97d None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:00.598727 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:00.687249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f12488-bc63-4463-92ba-4957f642e97d None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:00.722992 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fdd5e-df81-47d2-b763-df780561354b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:00.723807 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fdd5e-df81-47d2-b763-df780561354b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:00.724098 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fdd5e-df81-47d2-b763-df780561354b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:00.724379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fdd5e-df81-47d2-b763-df780561354b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:00.735364 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fdd5e-df81-47d2-b763-df780561354b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:00.736827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fdd5e-df81-47d2-b763-df780561354b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:00.755865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-077fdd5e-df81-47d2-b763-df780561354b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:00.755865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:00.755865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:00.755865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:00.755865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:00.755865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:00.755865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:00.755865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:00.755865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:00.755865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:00.755865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:00.755865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:00.755865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:41:00.755865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:41:00.755865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:00.756846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:00.757767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:41:00.757767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:41:00.757767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:00.757767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:00.757767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 424/869] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:00.763520 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea207aae-8c42-4a78-97da-18e594c26978 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:00.839581 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:00.871909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea207aae-8c42-4a78-97da-18e594c26978 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:00.908931 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4caa4-bf30-4d15-8952-119e729e29ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:00.909605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4caa4-bf30-4d15-8952-119e729e29ab None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:00.909894 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4caa4-bf30-4d15-8952-119e729e29ab None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:00.910178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4caa4-bf30-4d15-8952-119e729e29ab None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:00.911008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4caa4-bf30-4d15-8952-119e729e29ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:00.911320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4caa4-bf30-4d15-8952-119e729e29ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:00.912707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4caa4-bf30-4d15-8952-119e729e29ab None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:00.924943 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 446/870] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:00.931084 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fdd5e-df81-47d2-b763-df780561354b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:00.997248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:01.041268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fdd5e-df81-47d2-b763-df780561354b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:01.079393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a7738-27d2-40ef-9d65-6a51cebfa843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:01.080203 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a7738-27d2-40ef-9d65-6a51cebfa843 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:01.080494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a7738-27d2-40ef-9d65-6a51cebfa843 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:01.080777 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a7738-27d2-40ef-9d65-6a51cebfa843 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:01.088873 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a7738-27d2-40ef-9d65-6a51cebfa843 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:01.090333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a7738-27d2-40ef-9d65-6a51cebfa843 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:01.104838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-b54a7738-27d2-40ef-9d65-6a51cebfa843 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:01.104838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:01.104838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:01.104838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:01.104838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:01.104838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:01.104838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:01.104838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:01.104838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:01.104838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:01.104838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:01.104838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:01.104838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:41:01.104838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:41:01.104838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:01.105793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:01.106742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:41:01.106742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:41:01.106742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:41:01.106742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:41:01.106742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:41:01.106742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:41:01.106742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:01.106742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:01.106742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 425/871] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:41:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:01.113812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4caa4-bf30-4d15-8952-119e729e29ab None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:01.222624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4caa4-bf30-4d15-8952-119e729e29ab None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:01.231422 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289eb576-7d8d-4da8-9b52-8cc7fe62c8c9 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:01.231747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289eb576-7d8d-4da8-9b52-8cc7fe62c8c9 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:01.232004 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289eb576-7d8d-4da8-9b52-8cc7fe62c8c9 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:01.234745 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 426/872] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:01.239002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc1a62-3b03-475e-94b5-d4ebcc6f144a None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:01.239299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc1a62-3b03-475e-94b5-d4ebcc6f144a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:01.239949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc1a62-3b03-475e-94b5-d4ebcc6f144a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:01.258856 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:01.261752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b6dc1a62-3b03-475e-94b5-d4ebcc6f144a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:01.263151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b6dc1a62-3b03-475e-94b5-d4ebcc6f144a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:01.264351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f033f3e-612e-4ad9-b66c-cd5c79fb8957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:01.265179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f033f3e-612e-4ad9-b66c-cd5c79fb8957 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:01.265572 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f033f3e-612e-4ad9-b66c-cd5c79fb8957 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:01.265975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f033f3e-612e-4ad9-b66c-cd5c79fb8957 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:01.267728 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f033f3e-612e-4ad9-b66c-cd5c79fb8957 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:01.267728 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f033f3e-612e-4ad9-b66c-cd5c79fb8957 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:01.268928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f033f3e-612e-4ad9-b66c-cd5c79fb8957 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:01.282534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 447/873] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:41:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:01.288304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f033f3e-612e-4ad9-b66c-cd5c79fb8957 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:01.374613 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 427/874] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:01.395469 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc1a62-3b03-475e-94b5-d4ebcc6f144a None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:01.421951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f033f3e-612e-4ad9-b66c-cd5c79fb8957 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:01.465075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522140a9-a37c-4144-b9c4-51050170f5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:01.466947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:01.467892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522140a9-a37c-4144-b9c4-51050170f5c7 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:01.468744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522140a9-a37c-4144-b9c4-51050170f5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:01.469232 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522140a9-a37c-4144-b9c4-51050170f5c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:01.471947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522140a9-a37c-4144-b9c4-51050170f5c7 None admin] RBAC: Adding query filter params (role.id=30112fca4d6549a790f2eadf20635343, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=bffc7facb4ce4ab9967b0c8d88d0433b) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:01.472701 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522140a9-a37c-4144-b9c4-51050170f5c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:01.477410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522140a9-a37c-4144-b9c4-51050170f5c7 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:01.486096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 448/875] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:41:01 2022] GET /identity/v3/role_assignments?user.id=bffc7facb4ce4ab9967b0c8d88d0433b&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=30112fca4d6549a790f2eadf20635343 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:01.500356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123214fe-8ea7-4b7c-ad58-2dfb1276dae6 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:01.500706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123214fe-8ea7-4b7c-ad58-2dfb1276dae6 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:01.500976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123214fe-8ea7-4b7c-ad58-2dfb1276dae6 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:01.503063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 449/876] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:41:01.510050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cf908-1e8e-4ef6-afaf-2473864f4f07 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:01.510438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cf908-1e8e-4ef6-afaf-2473864f4f07 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:01.510920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932cf908-1e8e-4ef6-afaf-2473864f4f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:01.537572 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc1a62-3b03-475e-94b5-d4ebcc6f144a None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:01.538385 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-932cf908-1e8e-4ef6-afaf-2473864f4f07 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:01.540186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-932cf908-1e8e-4ef6-afaf-2473864f4f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:01.582645 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0dc6a-262f-4efe-80bf-a674f9091b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:01.583735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0dc6a-262f-4efe-80bf-a674f9091b5b None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:01.584275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0dc6a-262f-4efe-80bf-a674f9091b5b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:01.584767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0dc6a-262f-4efe-80bf-a674f9091b5b None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:01.585835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0dc6a-262f-4efe-80bf-a674f9091b5b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:01.587697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe0dc6a-262f-4efe-80bf-a674f9091b5b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:01.611257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:01.630536 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 450/877] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:01.651327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 428/878] 10.222.0.15 () {60 vars in 1141 bytes} [Fri May 27 19:41:01 2022] POST /identity/v3/services => generated 269 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 19:41:01.659190 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cf908-1e8e-4ef6-afaf-2473864f4f07 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:01.785225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932cf908-1e8e-4ef6-afaf-2473864f4f07 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:01.837597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd9bf5-ae5e-44a1-abf3-9f9536868df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:01.838699 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd9bf5-ae5e-44a1-abf3-9f9536868df1 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:01.839092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd9bf5-ae5e-44a1-abf3-9f9536868df1 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:01.839482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd9bf5-ae5e-44a1-abf3-9f9536868df1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:01.840251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd9bf5-ae5e-44a1-abf3-9f9536868df1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:01.841806 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd9bf5-ae5e-44a1-abf3-9f9536868df1 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-41dd9bf5-ae5e-44a1-abf3-9f9536868df1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:01.855870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:01.856911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:01.857730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:01.857730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:01.857730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:01.857730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:01.857730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:01.857730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:01.857730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:01.857730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:01.857730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:01.857730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:01.857730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:41:01.857730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:01.857730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 19:41:01.857730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:01.857730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 451/879] 10.222.0.15 () {56 vars in 1126 bytes} [Fri May 27 19:41:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:01.863277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0dc6a-262f-4efe-80bf-a674f9091b5b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:01.992037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0dc6a-262f-4efe-80bf-a674f9091b5b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:02.007611 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:02.032332 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71b99c-7937-471a-8953-0e77db1fdff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:02.033017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71b99c-7937-471a-8953-0e77db1fdff9 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:02.033303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71b99c-7937-471a-8953-0e77db1fdff9 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:02.033583 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71b99c-7937-471a-8953-0e77db1fdff9 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:02.034299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71b99c-7937-471a-8953-0e77db1fdff9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:02.034639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71b99c-7937-471a-8953-0e77db1fdff9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:02.036093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71b99c-7937-471a-8953-0e77db1fdff9 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:02.043730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 429/880] 10.222.0.15 () {56 vars in 1122 bytes} [Fri May 27 19:41:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:02.051570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd9bf5-ae5e-44a1-abf3-9f9536868df1 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:02.105039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:02.168028 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd9bf5-ae5e-44a1-abf3-9f9536868df1 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:02.218364 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd5051-02a8-4d1f-8cd2-3cd0e239f5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:02.219063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd5051-02a8-4d1f-8cd2-3cd0e239f5d6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:02.219348 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd5051-02a8-4d1f-8cd2-3cd0e239f5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:02.219624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd5051-02a8-4d1f-8cd2-3cd0e239f5d6 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:02.220359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd5051-02a8-4d1f-8cd2-3cd0e239f5d6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:02.220670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd5051-02a8-4d1f-8cd2-3cd0e239f5d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:02.222099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd5051-02a8-4d1f-8cd2-3cd0e239f5d6 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:02.228888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 452/881] 10.222.0.15 () {56 vars in 1122 bytes} [Fri May 27 19:41:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:02.407575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67436b-75fb-49d4-b5a4-1302f43f73ab None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:02.407883 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67436b-75fb-49d4-b5a4-1302f43f73ab None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:02.408117 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67436b-75fb-49d4-b5a4-1302f43f73ab None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:02.409801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 430/882] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:02.416721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05381e42-af1e-4477-ac4b-653b43575f48 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:02.417046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05381e42-af1e-4477-ac4b-653b43575f48 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:02.417355 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05381e42-af1e-4477-ac4b-653b43575f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:02.435812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-05381e42-af1e-4477-ac4b-653b43575f48 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:02.437080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-05381e42-af1e-4477-ac4b-653b43575f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:02.524460 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 453/883] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:02.547692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67436b-75fb-49d4-b5a4-1302f43f73ab None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:02.662381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67436b-75fb-49d4-b5a4-1302f43f73ab None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:02.698891 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d47eb-afc6-4b9c-a4ff-45dbb0beffbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:02.699698 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d47eb-afc6-4b9c-a4ff-45dbb0beffbd None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:02.699987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d47eb-afc6-4b9c-a4ff-45dbb0beffbd None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:02.700269 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d47eb-afc6-4b9c-a4ff-45dbb0beffbd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:02.700920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d47eb-afc6-4b9c-a4ff-45dbb0beffbd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:02.702291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d47eb-afc6-4b9c-a4ff-45dbb0beffbd None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-224d47eb-afc6-4b9c-a4ff-45dbb0beffbd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:02.717358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:02.718528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:02.719392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:02.719392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:02.719392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:02.719392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:02.719392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:02.719392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:02.719392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:02.719392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:02.719392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:02.719392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:02.719392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:41:02.719392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:02.719392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 19:41:02.719392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:02.719392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 431/884] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:41:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:02.721745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05381e42-af1e-4477-ac4b-653b43575f48 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:02.770542 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:02.831292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05381e42-af1e-4477-ac4b-653b43575f48 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:02.870370 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e85f2-28da-4c30-95ec-51548033f5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:02.871066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e85f2-28da-4c30-95ec-51548033f5d0 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:02.871354 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e85f2-28da-4c30-95ec-51548033f5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:02.871633 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e85f2-28da-4c30-95ec-51548033f5d0 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:02.872352 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e85f2-28da-4c30-95ec-51548033f5d0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:02.872726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e85f2-28da-4c30-95ec-51548033f5d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:02.874173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e85f2-28da-4c30-95ec-51548033f5d0 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:02.879499 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 454/885] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:41:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:02.888459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d47eb-afc6-4b9c-a4ff-45dbb0beffbd None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:02.964899 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:03.061096 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d47eb-afc6-4b9c-a4ff-45dbb0beffbd None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:03.119744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd49695-3b7a-427d-99c5-d556f11ed190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:03.121243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd49695-3b7a-427d-99c5-d556f11ed190 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:03.122003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd49695-3b7a-427d-99c5-d556f11ed190 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:03.122784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd49695-3b7a-427d-99c5-d556f11ed190 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:03.124278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd49695-3b7a-427d-99c5-d556f11ed190 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:03.125061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd49695-3b7a-427d-99c5-d556f11ed190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:03.127713 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd49695-3b7a-427d-99c5-d556f11ed190 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:03.136869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 432/886] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:41:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:03.145747 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e85f2-28da-4c30-95ec-51548033f5d0 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:03.324010 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e85f2-28da-4c30-95ec-51548033f5d0 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:03.351200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:03.386058 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625b3b0-38f3-44dc-ab0e-f137ad63e82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:03.387180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625b3b0-38f3-44dc-ab0e-f137ad63e82a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:03.387682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625b3b0-38f3-44dc-ab0e-f137ad63e82a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:03.388175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625b3b0-38f3-44dc-ab0e-f137ad63e82a None admin] PATH_INFO: `/v3/endpoints` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:03.389925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625b3b0-38f3-44dc-ab0e-f137ad63e82a None admin] RBAC: Adding query filter params (interface=public, service_id=a2dd8c61fd684f7cbd47c74e44c5863a, region_id=RegionOne) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:03.391205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625b3b0-38f3-44dc-ab0e-f137ad63e82a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:03.393989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625b3b0-38f3-44dc-ab0e-f137ad63e82a None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:03.405122 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 455/887] 10.222.0.15 () {56 vars in 1251 bytes} [Fri May 27 19:41:03 2022] GET /identity/v3/endpoints?service_id=a2dd8c61fd684f7cbd47c74e44c5863a&interface=public®ion_id=RegionOne => generated 194 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:03.413040 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd49695-3b7a-427d-99c5-d556f11ed190 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:03.528791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd49695-3b7a-427d-99c5-d556f11ed190 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:03.531628 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:03.564560 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea240f-3833-4762-ab9f-760136eb621c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:03.565233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea240f-3833-4762-ab9f-760136eb621c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:03.565506 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea240f-3833-4762-ab9f-760136eb621c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:03.565808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea240f-3833-4762-ab9f-760136eb621c None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:03.566586 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea240f-3833-4762-ab9f-760136eb621c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:03.567948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea240f-3833-4762-ab9f-760136eb621c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:03.574431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 433/888] 10.222.0.15 () {56 vars in 1087 bytes} [Fri May 27 19:41:03 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 19:41:04.005103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97ff3c-e0aa-40ca-9290-d11a7625a416 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:04.005420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97ff3c-e0aa-40ca-9290-d11a7625a416 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:04.005601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97ff3c-e0aa-40ca-9290-d11a7625a416 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:04.007315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 456/889] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:04.013261 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c3d1e-5209-46c1-8807-eae6333025cc None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:04.013717 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c3d1e-5209-46c1-8807-eae6333025cc None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:04.013915 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c3d1e-5209-46c1-8807-eae6333025cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:04.031568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-d82c3d1e-5209-46c1-8807-eae6333025cc None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:04.032775 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d82c3d1e-5209-46c1-8807-eae6333025cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:04.106888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 434/890] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:04.130533 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97ff3c-e0aa-40ca-9290-d11a7625a416 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:04.247967 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97ff3c-e0aa-40ca-9290-d11a7625a416 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:04.292022 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65ae4b-758e-40f5-88d7-9239e16883a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:04.292858 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65ae4b-758e-40f5-88d7-9239e16883a1 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:04.293148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65ae4b-758e-40f5-88d7-9239e16883a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:04.293427 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65ae4b-758e-40f5-88d7-9239e16883a1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:04.304699 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65ae4b-758e-40f5-88d7-9239e16883a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-1a65ae4b-758e-40f5-88d7-9239e16883a1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:41:04.313507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:04.314519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:04.315380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:04.315380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:04.315380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:04.315380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:04.315380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:41:04.315380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:41:04.315380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:41:04.315380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:41:04.315380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:41:04.315380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:41:04.315380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 19:41:04.315380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:04.315380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 457/891] 10.222.0.15 () {56 vars in 1120 bytes} [Fri May 27 19:41:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:04.321521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c3d1e-5209-46c1-8807-eae6333025cc None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:04.429248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:04.433620 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c3d1e-5209-46c1-8807-eae6333025cc None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:04.486087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88695711-a8b1-4db7-9965-5fea9fe14463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:04.487131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88695711-a8b1-4db7-9965-5fea9fe14463 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:04.487626 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88695711-a8b1-4db7-9965-5fea9fe14463 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:04.488111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88695711-a8b1-4db7-9965-5fea9fe14463 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:04.489085 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88695711-a8b1-4db7-9965-5fea9fe14463 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:04.489612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88695711-a8b1-4db7-9965-5fea9fe14463 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:04.491247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88695711-a8b1-4db7-9965-5fea9fe14463 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:04.502991 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 435/892] 10.222.0.15 () {56 vars in 1115 bytes} [Fri May 27 19:41:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:04.509395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65ae4b-758e-40f5-88d7-9239e16883a1 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:04.544042 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:04.555893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b4250-5dbb-4555-9334-bbb3ea5a4108 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:04.562532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b4250-5dbb-4555-9334-bbb3ea5a4108 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:04.562532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b4250-5dbb-4555-9334-bbb3ea5a4108 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:04.562532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 436/893] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:41:04.564130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cc2e2-9d7c-4763-a7ee-b12630fe2a5f None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:04.564666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cc2e2-9d7c-4763-a7ee-b12630fe2a5f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:04.565150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327cc2e2-9d7c-4763-a7ee-b12630fe2a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:04.585435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-327cc2e2-9d7c-4763-a7ee-b12630fe2a5f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:04.587883 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-327cc2e2-9d7c-4763-a7ee-b12630fe2a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:04.678674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 437/894] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:04.691395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65ae4b-758e-40f5-88d7-9239e16883a1 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:04.697143 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cc2e2-9d7c-4763-a7ee-b12630fe2a5f None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:04.777335 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef749d82-b93f-44b7-9d56-cdb96482d57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:04.779008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef749d82-b93f-44b7-9d56-cdb96482d57c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:04.780469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef749d82-b93f-44b7-9d56-cdb96482d57c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:04.780987 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef749d82-b93f-44b7-9d56-cdb96482d57c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:04.808995 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef749d82-b93f-44b7-9d56-cdb96482d57c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:04.809961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:04.814518 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef749d82-b93f-44b7-9d56-cdb96482d57c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:04.821199 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327cc2e2-9d7c-4763-a7ee-b12630fe2a5f None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:04.853822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-ef749d82-b93f-44b7-9d56-cdb96482d57c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:04.853822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:04.853822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:04.853822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:04.853822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:04.853822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:04.853822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:04.853822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:04.853822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:04.853822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:04.853822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:04.853822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:04.853822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:41:04.853822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:41:04.853822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:04.854870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:04.855765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:41:04.855765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:41:04.855765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:04.855765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:04.862511 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 458/895] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:04.863844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f54a2-c496-490a-bada-b8b7d545202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:04.864996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f54a2-c496-490a-bada-b8b7d545202d None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:04.865506 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f54a2-c496-490a-bada-b8b7d545202d None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:04.865683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef749d82-b93f-44b7-9d56-cdb96482d57c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:04.866156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f54a2-c496-490a-bada-b8b7d545202d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:04.867050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f54a2-c496-490a-bada-b8b7d545202d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:04.869231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f54a2-c496-490a-bada-b8b7d545202d None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-1b9f54a2-c496-490a-bada-b8b7d545202d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:04.882678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:04.884293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:04.885151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:04.885151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:04.885151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:04.885151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:04.885151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:04.885151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:04.885151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:04.885151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:04.885151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:04.885151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:04.885151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:04.885151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:41:04.885151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:04.885151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 19:41:04.885151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:04.888145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 438/896] 10.222.0.15 () {56 vars in 1132 bytes} [Fri May 27 19:41:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:04.894460 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f54a2-c496-490a-bada-b8b7d545202d None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:05.003729 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f54a2-c496-490a-bada-b8b7d545202d None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:05.024447 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:05.041586 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff6d14-20d2-4730-8b5b-abb402362c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:05.042954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff6d14-20d2-4730-8b5b-abb402362c41 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:05.043471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff6d14-20d2-4730-8b5b-abb402362c41 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:05.043968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff6d14-20d2-4730-8b5b-abb402362c41 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:05.044946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff6d14-20d2-4730-8b5b-abb402362c41 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:05.045579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff6d14-20d2-4730-8b5b-abb402362c41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:05.047497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff6d14-20d2-4730-8b5b-abb402362c41 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:05.058785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 439/897] 10.222.0.15 () {56 vars in 1126 bytes} [Fri May 27 19:41:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:05.059668 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef749d82-b93f-44b7-9d56-cdb96482d57c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:05.060377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff6d14-20d2-4730-8b5b-abb402362c41 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:05.081591 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:05.128827 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7658525-7501-46f7-a036-7de0f9936f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:05.129541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7658525-7501-46f7-a036-7de0f9936f7c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:05.129878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7658525-7501-46f7-a036-7de0f9936f7c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:05.130165 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7658525-7501-46f7-a036-7de0f9936f7c None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:05.131107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7658525-7501-46f7-a036-7de0f9936f7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:05.131420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7658525-7501-46f7-a036-7de0f9936f7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:05.134033 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7658525-7501-46f7-a036-7de0f9936f7c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:05.147010 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 459/898] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:05.155540 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7658525-7501-46f7-a036-7de0f9936f7c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:05.174240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff6d14-20d2-4730-8b5b-abb402362c41 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:05.214315 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b6020-badd-418f-adac-ef410065eb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:05.215027 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b6020-badd-418f-adac-ef410065eb1c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:05.215321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b6020-badd-418f-adac-ef410065eb1c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:05.215603 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b6020-badd-418f-adac-ef410065eb1c None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:05.216321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b6020-badd-418f-adac-ef410065eb1c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:05.216639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b6020-badd-418f-adac-ef410065eb1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:05.218109 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b6020-badd-418f-adac-ef410065eb1c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:05.228692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 440/899] 10.222.0.15 () {56 vars in 1126 bytes} [Fri May 27 19:41:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:05.229706 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b6020-badd-418f-adac-ef410065eb1c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:05.296791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7658525-7501-46f7-a036-7de0f9936f7c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:05.330838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:05.354405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b6020-badd-418f-adac-ef410065eb1c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:05.360058 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c6c37-8fa0-4d4b-b978-d60e8862e70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:05.361656 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c6c37-8fa0-4d4b-b978-d60e8862e70e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:05.362151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c6c37-8fa0-4d4b-b978-d60e8862e70e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:05.363635 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c6c37-8fa0-4d4b-b978-d60e8862e70e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:05.378698 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c6c37-8fa0-4d4b-b978-d60e8862e70e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:05.381647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c6c37-8fa0-4d4b-b978-d60e8862e70e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:05.386883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:05.392893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240f0a3-2b63-42e1-b11d-8ac3e739e5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:05.393565 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240f0a3-2b63-42e1-b11d-8ac3e739e5f1 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:05.393855 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240f0a3-2b63-42e1-b11d-8ac3e739e5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:05.394140 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240f0a3-2b63-42e1-b11d-8ac3e739e5f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:05.395207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240f0a3-2b63-42e1-b11d-8ac3e739e5f1 None admin] RBAC: Adding query filter params (interface=public, service_id=6f1aade9545d453e9e12b1726ad62ce9, region_id=RegionOne) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:05.395529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240f0a3-2b63-42e1-b11d-8ac3e739e5f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:05.397275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240f0a3-2b63-42e1-b11d-8ac3e739e5f1 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:05.408130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 441/900] 10.222.0.15 () {56 vars in 1251 bytes} [Fri May 27 19:41:05 2022] GET /identity/v3/endpoints?service_id=6f1aade9545d453e9e12b1726ad62ce9&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:05.409084 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240f0a3-2b63-42e1-b11d-8ac3e739e5f1 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-708c6c37-8fa0-4d4b-b978-d60e8862e70e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:41:05.416415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:05.418491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:05.420612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:05.420612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:05.420612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:41:05.420612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:41:05.420612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:41:05.420612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:41:05.420612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:41:05.420612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:41:05.420612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 19:41:05.420612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:05.433592 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 460/901] 10.222.0.15 () {56 vars in 1117 bytes} [Fri May 27 19:41:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:05.435850 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c6c37-8fa0-4d4b-b978-d60e8862e70e None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:05.538973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240f0a3-2b63-42e1-b11d-8ac3e739e5f1 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:05.586982 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e524a-4771-41cf-9575-c9d76291dd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:05.587587 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e524a-4771-41cf-9575-c9d76291dd29 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:05.587876 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e524a-4771-41cf-9575-c9d76291dd29 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:05.588158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e524a-4771-41cf-9575-c9d76291dd29 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:05.588858 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e524a-4771-41cf-9575-c9d76291dd29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:05.590608 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e524a-4771-41cf-9575-c9d76291dd29 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:05.606658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 442/902] 10.222.0.15 () {56 vars in 1087 bytes} [Fri May 27 19:41:05 2022] GET /identity/v3/services => generated 1268 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:41:05.627864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c6c37-8fa0-4d4b-b978-d60e8862e70e None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:05.692070 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab41205-d46e-467d-876c-f754ca1291cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:05.693562 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab41205-d46e-467d-876c-f754ca1291cf None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:05.694287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab41205-d46e-467d-876c-f754ca1291cf None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:05.695029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab41205-d46e-467d-876c-f754ca1291cf None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:05.697469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab41205-d46e-467d-876c-f754ca1291cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:05.698241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab41205-d46e-467d-876c-f754ca1291cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:05.701314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab41205-d46e-467d-876c-f754ca1291cf None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:05.741452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 461/903] 10.222.0.15 () {56 vars in 1149 bytes} [Fri May 27 19:41:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:05.747447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e524a-4771-41cf-9575-c9d76291dd29 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:05.771836 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:05.891010 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494d05c-3ee1-4dac-b3e3-4c415fc0b218 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:05.891648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494d05c-3ee1-4dac-b3e3-4c415fc0b218 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:05.892147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494d05c-3ee1-4dac-b3e3-4c415fc0b218 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:05.894944 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 462/904] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:05.901659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2962e-cb48-4bf1-832c-999c46357663 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:05.902213 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2962e-cb48-4bf1-832c-999c46357663 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:05.902726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2962e-cb48-4bf1-832c-999c46357663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:05.903255 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e524a-4771-41cf-9575-c9d76291dd29 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:05.927403 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-eda2962e-cb48-4bf1-832c-999c46357663 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:05.930671 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-eda2962e-cb48-4bf1-832c-999c46357663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:05.958245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744fffa-0040-445f-b94e-afe1f4a294fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:05.959808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744fffa-0040-445f-b94e-afe1f4a294fd None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:05.960317 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744fffa-0040-445f-b94e-afe1f4a294fd None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:05.960813 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d744fffa-0040-445f-b94e-afe1f4a294fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:06.004916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:06.024079 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 463/905] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:06.025844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555d5f9-0dff-489d-b19e-e62507c39be5 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:06.026411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555d5f9-0dff-489d-b19e-e62507c39be5 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:06.026918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555d5f9-0dff-489d-b19e-e62507c39be5 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:06.028678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 464/906] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:06.033709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36325f63-c4f5-432d-bc08-555928bbdf6f None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:06.034294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36325f63-c4f5-432d-bc08-555928bbdf6f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:06.034845 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36325f63-c4f5-432d-bc08-555928bbdf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:06.059409 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-36325f63-c4f5-432d-bc08-555928bbdf6f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:06.060599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-36325f63-c4f5-432d-bc08-555928bbdf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:06.065882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744fffa-0040-445f-b94e-afe1f4a294fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:06.067377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d744fffa-0040-445f-b94e-afe1f4a294fd None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:06.079655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:06.137153 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 465/907] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:06.139242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36325f63-c4f5-432d-bc08-555928bbdf6f None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:06.210311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 443/908] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:41:05 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:41:06.212536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744fffa-0040-445f-b94e-afe1f4a294fd None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:06.269313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36325f63-c4f5-432d-bc08-555928bbdf6f None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:06.290131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:06.307832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dac8a0-a29a-4567-9a3d-e305bef4cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:06.308548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dac8a0-a29a-4567-9a3d-e305bef4cc72 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:06.308798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dac8a0-a29a-4567-9a3d-e305bef4cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:06.309228 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dac8a0-a29a-4567-9a3d-e305bef4cc72 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:06.310093 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dac8a0-a29a-4567-9a3d-e305bef4cc72 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:06.311748 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dac8a0-a29a-4567-9a3d-e305bef4cc72 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:06.354505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d744fffa-0040-445f-b94e-afe1f4a294fd None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:06.371346 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:06.382406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 466/909] 10.222.0.15 () {60 vars in 1141 bytes} [Fri May 27 19:41:06 2022] POST /identity/v3/services => generated 241 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:41:06.382406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dac8a0-a29a-4567-9a3d-e305bef4cc72 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:06.430756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faab52c-5d8f-4b77-a972-b20d7eee164c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:06.432393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faab52c-5d8f-4b77-a972-b20d7eee164c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:06.433054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faab52c-5d8f-4b77-a972-b20d7eee164c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:06.433559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faab52c-5d8f-4b77-a972-b20d7eee164c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:06.434800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faab52c-5d8f-4b77-a972-b20d7eee164c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:06.437283 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faab52c-5d8f-4b77-a972-b20d7eee164c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-7faab52c-5d8f-4b77-a972-b20d7eee164c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:06.458257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:06.460240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:06.461582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:06.461582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:06.461582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:06.461582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:06.461582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:06.461582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:06.461582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:06.461582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:06.461582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:06.461582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:06.461582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:41:06.461582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:06.461582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 19:41:06.461582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:06.461582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 444/910] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:41:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:06.467234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faab52c-5d8f-4b77-a972-b20d7eee164c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:06.592350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dac8a0-a29a-4567-9a3d-e305bef4cc72 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:06.655749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faab52c-5d8f-4b77-a972-b20d7eee164c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:06.659474 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac186b6-a2fb-4d2b-b260-782e0ee3b4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:06.660649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac186b6-a2fb-4d2b-b260-782e0ee3b4b4 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:06.661074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac186b6-a2fb-4d2b-b260-782e0ee3b4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:06.661507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac186b6-a2fb-4d2b-b260-782e0ee3b4b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:06.681351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac186b6-a2fb-4d2b-b260-782e0ee3b4b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:06.683948 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac186b6-a2fb-4d2b-b260-782e0ee3b4b4 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:06.711467 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c08f8-631a-40ab-ab71-047bacd87a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:06.712561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c08f8-631a-40ab-ab71-047bacd87a59 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:06.712969 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c08f8-631a-40ab-ab71-047bacd87a59 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:06.713431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c08f8-631a-40ab-ab71-047bacd87a59 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:06.714658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c08f8-631a-40ab-ab71-047bacd87a59 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:06.715173 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c08f8-631a-40ab-ab71-047bacd87a59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:06.717528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c08f8-631a-40ab-ab71-047bacd87a59 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:06.723187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-9ac186b6-a2fb-4d2b-b260-782e0ee3b4b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:06.723187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:06.723187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:06.723187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:06.723187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:06.723187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:06.723187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:06.723187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:06.723187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:06.723187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:06.723187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:06.723187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:06.723187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:41:06.723187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:41:06.723187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:06.724997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:06.727351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:41:06.727351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:41:06.727351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:06.727351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:06.730477 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 467/911] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:06.732156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 445/912] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:41:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:06.738420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac186b6-a2fb-4d2b-b260-782e0ee3b4b4 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:06.741993 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c08f8-631a-40ab-ab71-047bacd87a59 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:06.796436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:06.812726 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:06.905242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac186b6-a2fb-4d2b-b260-782e0ee3b4b4 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:06.943412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b618a-b4c2-457b-82e9-219404ea6cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:06.944542 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b618a-b4c2-457b-82e9-219404ea6cc2 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:06.944542 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b618a-b4c2-457b-82e9-219404ea6cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:06.944849 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b618a-b4c2-457b-82e9-219404ea6cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:06.946138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b618a-b4c2-457b-82e9-219404ea6cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:06.946559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b618a-b4c2-457b-82e9-219404ea6cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:06.948280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3b618a-b4c2-457b-82e9-219404ea6cc2 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:06.963572 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 468/913] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:06.971297 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c08f8-631a-40ab-ab71-047bacd87a59 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:06.972263 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b618a-b4c2-457b-82e9-219404ea6cc2 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:07.038781 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229920fa-2776-4cd5-aa7f-d5aa7265d4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:07.040211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229920fa-2776-4cd5-aa7f-d5aa7265d4ca None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:07.041603 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229920fa-2776-4cd5-aa7f-d5aa7265d4ca None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:07.042305 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229920fa-2776-4cd5-aa7f-d5aa7265d4ca None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:07.044213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229920fa-2776-4cd5-aa7f-d5aa7265d4ca None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:07.044937 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229920fa-2776-4cd5-aa7f-d5aa7265d4ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:07.048636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229920fa-2776-4cd5-aa7f-d5aa7265d4ca None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:07.065804 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 446/914] 10.222.0.15 () {56 vars in 1114 bytes} [Fri May 27 19:41:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:07.066789 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229920fa-2776-4cd5-aa7f-d5aa7265d4ca None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:07.149532 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:07.171485 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b618a-b4c2-457b-82e9-219404ea6cc2 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:07.231882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:07.238045 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229920fa-2776-4cd5-aa7f-d5aa7265d4ca None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:07.247014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a70beb-9abf-4a40-8169-8b0afd3a3f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:07.248709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a70beb-9abf-4a40-8169-8b0afd3a3f8e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:07.249424 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a70beb-9abf-4a40-8169-8b0afd3a3f8e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:07.250139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a70beb-9abf-4a40-8169-8b0afd3a3f8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:07.265086 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a70beb-9abf-4a40-8169-8b0afd3a3f8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:07.269469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a70beb-9abf-4a40-8169-8b0afd3a3f8e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:07.299077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cc3f1-61ca-4895-9d96-da972ee90454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:07.300210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cc3f1-61ca-4895-9d96-da972ee90454 None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:07.300780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cc3f1-61ca-4895-9d96-da972ee90454 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:07.301334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0cc3f1-61ca-4895-9d96-da972ee90454 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:07.302693 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cc3f1-61ca-4895-9d96-da972ee90454 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:07.304412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-93a70beb-9abf-4a40-8169-8b0afd3a3f8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:07.304412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:07.304412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:07.304412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:07.304412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:07.304412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:07.304412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:07.304412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:07.304412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:07.304412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:07.304412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:07.304412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:07.304412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:41:07.304412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:41:07.304412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:07.306060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:07.307956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:41:07.307956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:41:07.307956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:41:07.307956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:41:07.307956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:41:07.307956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:41:07.307956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:07.307956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:07.309534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0cc3f1-61ca-4895-9d96-da972ee90454 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:07.313902 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 469/915] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:41:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:07.321186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a70beb-9abf-4a40-8169-8b0afd3a3f8e None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:07.402545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 447/916] 10.222.0.15 () {60 vars in 1144 bytes} [Fri May 27 19:41:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:41:07.475137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a70beb-9abf-4a40-8169-8b0afd3a3f8e None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:07.544275 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a5e10-dab2-4871-8ea1-6da7f8e2a46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:07.545343 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a5e10-dab2-4871-8ea1-6da7f8e2a46a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:07.545803 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a5e10-dab2-4871-8ea1-6da7f8e2a46a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:07.546248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a5e10-dab2-4871-8ea1-6da7f8e2a46a None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:07.547942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a5e10-dab2-4871-8ea1-6da7f8e2a46a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:07.548442 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a5e10-dab2-4871-8ea1-6da7f8e2a46a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:07.551017 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a5e10-dab2-4871-8ea1-6da7f8e2a46a None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:07.572226 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 470/917] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:41:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:07.583552 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cc3f1-61ca-4895-9d96-da972ee90454 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:07.765306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0cc3f1-61ca-4895-9d96-da972ee90454 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:07.813065 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe9fd7-1f15-449f-ab89-36cf127220ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:07.814178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe9fd7-1f15-449f-ab89-36cf127220ca None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:07.814748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe9fd7-1f15-449f-ab89-36cf127220ca None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:07.815233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe9fd7-1f15-449f-ab89-36cf127220ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:07.816339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe9fd7-1f15-449f-ab89-36cf127220ca None admin] RBAC: Adding query filter params (role.id=3b05f783f43c417193b4c5198a955e79, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=bffc7facb4ce4ab9967b0c8d88d0433b) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:07.816880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe9fd7-1f15-449f-ab89-36cf127220ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:07.818694 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe9fd7-1f15-449f-ab89-36cf127220ca None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:07.826474 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 448/918] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:41:07 2022] GET /identity/v3/role_assignments?user.id=bffc7facb4ce4ab9967b0c8d88d0433b&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=3b05f783f43c417193b4c5198a955e79 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:08.058169 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f746f-a7f5-492a-aa92-28e9b53064a6 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:08.058639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f746f-a7f5-492a-aa92-28e9b53064a6 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:08.059063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f746f-a7f5-492a-aa92-28e9b53064a6 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:08.061768 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 471/919] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:08.069719 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddca73-eb79-40a0-85d3-d78b7653b129 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:08.070307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddca73-eb79-40a0-85d3-d78b7653b129 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:08.072619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddca73-eb79-40a0-85d3-d78b7653b129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:08.097848 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-69ddca73-eb79-40a0-85d3-d78b7653b129 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:08.099584 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-69ddca73-eb79-40a0-85d3-d78b7653b129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:08.123008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:08.193917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 449/920] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:08.228040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f746f-a7f5-492a-aa92-28e9b53064a6 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:08.247182 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:08.360464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f746f-a7f5-492a-aa92-28e9b53064a6 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:08.400409 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fcf9e-26ff-4ee4-8ae2-eebc213782a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:08.401299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fcf9e-26ff-4ee4-8ae2-eebc213782a8 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:08.401775 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fcf9e-26ff-4ee4-8ae2-eebc213782a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:08.402069 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fcf9e-26ff-4ee4-8ae2-eebc213782a8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:08.402838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fcf9e-26ff-4ee4-8ae2-eebc213782a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:08.404244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fcf9e-26ff-4ee4-8ae2-eebc213782a8 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-ef3fcf9e-26ff-4ee4-8ae2-eebc213782a8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:08.419325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:08.420337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:08.421161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 472/921] 10.222.0.15 () {56 vars in 1132 bytes} [Fri May 27 19:41:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:08.430296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddca73-eb79-40a0-85d3-d78b7653b129 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:08.555489 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddca73-eb79-40a0-85d3-d78b7653b129 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:08.592114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bd1ba-934e-4e53-9495-0904a702abf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:08.592865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bd1ba-934e-4e53-9495-0904a702abf5 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:08.593161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bd1ba-934e-4e53-9495-0904a702abf5 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:08.593442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bd1ba-934e-4e53-9495-0904a702abf5 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:08.594186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bd1ba-934e-4e53-9495-0904a702abf5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:08.594534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bd1ba-934e-4e53-9495-0904a702abf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:08.595976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bd1ba-934e-4e53-9495-0904a702abf5 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:08.602315 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 450/922] 10.222.0.15 () {56 vars in 1126 bytes} [Fri May 27 19:41:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:08.612090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fcf9e-26ff-4ee4-8ae2-eebc213782a8 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:08.690706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:08.720845 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fcf9e-26ff-4ee4-8ae2-eebc213782a8 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:08.756523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33849079-8c5f-473e-bfe7-6a26ced77a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:08.757212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33849079-8c5f-473e-bfe7-6a26ced77a53 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:08.757568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33849079-8c5f-473e-bfe7-6a26ced77a53 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:08.758459 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33849079-8c5f-473e-bfe7-6a26ced77a53 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:08.759215 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33849079-8c5f-473e-bfe7-6a26ced77a53 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:08.759533 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33849079-8c5f-473e-bfe7-6a26ced77a53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:08.761054 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33849079-8c5f-473e-bfe7-6a26ced77a53 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:08.767455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 473/923] 10.222.0.15 () {56 vars in 1126 bytes} [Fri May 27 19:41:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:08.773412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bd1ba-934e-4e53-9495-0904a702abf5 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:08.792988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedff87-170a-4a7a-9584-6d8a7c7f31fc None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:08.793300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedff87-170a-4a7a-9584-6d8a7c7f31fc None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:08.793571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedff87-170a-4a7a-9584-6d8a7c7f31fc None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:08.794858 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:08.795285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 474/924] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:08.801519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba068fe8-5f36-4b2a-8971-96b835aa6d0f None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:08.801809 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba068fe8-5f36-4b2a-8971-96b835aa6d0f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:08.802134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba068fe8-5f36-4b2a-8971-96b835aa6d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:08.822701 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-ba068fe8-5f36-4b2a-8971-96b835aa6d0f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:08.823970 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ba068fe8-5f36-4b2a-8971-96b835aa6d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:08.895783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bd1ba-934e-4e53-9495-0904a702abf5 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:08.902585 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 475/925] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:08.917953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba068fe8-5f36-4b2a-8971-96b835aa6d0f None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:08.934580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7ea5f-cd30-4844-a254-067202858f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:08.935477 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7ea5f-cd30-4844-a254-067202858f3e None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:08.936086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7ea5f-cd30-4844-a254-067202858f3e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:08.936377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7ea5f-cd30-4844-a254-067202858f3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:08.937136 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7ea5f-cd30-4844-a254-067202858f3e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:08.938523 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7ea5f-cd30-4844-a254-067202858f3e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:08.990045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:09.029088 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba068fe8-5f36-4b2a-8971-96b835aa6d0f None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:09.035770 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 451/926] 10.222.0.15 () {60 vars in 1144 bytes} [Fri May 27 19:41:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 19:41:09.084240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cae006-b41a-4a95-af15-185274ca1ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:09.085429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cae006-b41a-4a95-af15-185274ca1ada None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:09.086558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cae006-b41a-4a95-af15-185274ca1ada None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:09.087026 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cae006-b41a-4a95-af15-185274ca1ada None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:09.087949 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cae006-b41a-4a95-af15-185274ca1ada None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:09.089547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cae006-b41a-4a95-af15-185274ca1ada None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-35cae006-b41a-4a95-af15-185274ca1ada None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:09.103904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:09.105001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:09.105851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:09.105851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:09.105851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:09.105851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:09.105851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:09.105851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:09.105851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:09.105851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:09.105851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:09.105851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:09.105851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:41:09.105851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:09.105851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 19:41:09.105851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:09.108714 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 476/927] 10.222.0.15 () {56 vars in 1126 bytes} [Fri May 27 19:41:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:09.115255 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7ea5f-cd30-4844-a254-067202858f3e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:09.196879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:09.240510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7ea5f-cd30-4844-a254-067202858f3e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:09.278785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5453f-28fa-4628-850d-ede8dcadb2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:09.279616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5453f-28fa-4628-850d-ede8dcadb2c4 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:09.279900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5453f-28fa-4628-850d-ede8dcadb2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:09.280178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5453f-28fa-4628-850d-ede8dcadb2c4 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:09.280882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5453f-28fa-4628-850d-ede8dcadb2c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:09.281186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5453f-28fa-4628-850d-ede8dcadb2c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:09.282572 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5453f-28fa-4628-850d-ede8dcadb2c4 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:09.288102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 452/928] 10.222.0.15 () {56 vars in 1122 bytes} [Fri May 27 19:41:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:09.294601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cae006-b41a-4a95-af15-185274ca1ada None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:09.403227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cae006-b41a-4a95-af15-185274ca1ada None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:09.431018 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:09.439682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49728d04-b329-43c3-9925-957aa081213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:09.440353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49728d04-b329-43c3-9925-957aa081213c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:09.440636 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49728d04-b329-43c3-9925-957aa081213c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:09.440911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49728d04-b329-43c3-9925-957aa081213c None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:09.441628 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49728d04-b329-43c3-9925-957aa081213c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:09.441929 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49728d04-b329-43c3-9925-957aa081213c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:09.443329 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49728d04-b329-43c3-9925-957aa081213c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:09.460796 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 477/929] 10.222.0.15 () {56 vars in 1122 bytes} [Fri May 27 19:41:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:09.461010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5453f-28fa-4628-850d-ede8dcadb2c4 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:09.574240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5453f-28fa-4628-850d-ede8dcadb2c4 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:09.605406 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:09.610518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966935bc-de25-413d-8b03-25a1939d54bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:09.611166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966935bc-de25-413d-8b03-25a1939d54bd None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:09.611450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966935bc-de25-413d-8b03-25a1939d54bd None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:09.611725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966935bc-de25-413d-8b03-25a1939d54bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:09.612603 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966935bc-de25-413d-8b03-25a1939d54bd None admin] RBAC: Adding query filter params (interface=public, service_id=087bd1ffb2ff47f788aae7b1ad6c7ef3, region_id=RegionOne) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:09.612916 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966935bc-de25-413d-8b03-25a1939d54bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:09.614276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966935bc-de25-413d-8b03-25a1939d54bd None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:09.620580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 453/930] 10.222.0.15 () {56 vars in 1251 bytes} [Fri May 27 19:41:09 2022] GET /identity/v3/endpoints?service_id=087bd1ffb2ff47f788aae7b1ad6c7ef3&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:09.626270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49728d04-b329-43c3-9925-957aa081213c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:09.746503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49728d04-b329-43c3-9925-957aa081213c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:09.786484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bf55d-ecfa-457a-a842-50d9a4d75412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:09.787556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bf55d-ecfa-457a-a842-50d9a4d75412 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:09.788091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bf55d-ecfa-457a-a842-50d9a4d75412 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:09.788566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bf55d-ecfa-457a-a842-50d9a4d75412 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:09.789603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1bf55d-ecfa-457a-a842-50d9a4d75412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:09.791211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1bf55d-ecfa-457a-a842-50d9a4d75412 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:09.798660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 478/931] 10.222.0.15 () {56 vars in 1087 bytes} [Fri May 27 19:41:09 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:41:09.941231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75e29e-6cc8-4765-9089-eeed69b4b6d5 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:09.941685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75e29e-6cc8-4765-9089-eeed69b4b6d5 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:09.942114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75e29e-6cc8-4765-9089-eeed69b4b6d5 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:09.944604 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 454/932] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:09.950511 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86783b5-557c-4cd9-8bb8-56d6f3819458 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:09.951153 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86783b5-557c-4cd9-8bb8-56d6f3819458 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:09.951647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86783b5-557c-4cd9-8bb8-56d6f3819458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:09.970747 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e86783b5-557c-4cd9-8bb8-56d6f3819458 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:09.972371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e86783b5-557c-4cd9-8bb8-56d6f3819458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:10.027552 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:10.057350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 479/933] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:10.080048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75e29e-6cc8-4765-9089-eeed69b4b6d5 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:10.246577 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75e29e-6cc8-4765-9089-eeed69b4b6d5 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:10.306689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33770e5b-9c07-4fa6-a901-c66530cb9be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:10.308212 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33770e5b-9c07-4fa6-a901-c66530cb9be4 None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:10.308952 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33770e5b-9c07-4fa6-a901-c66530cb9be4 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:10.309690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33770e5b-9c07-4fa6-a901-c66530cb9be4 None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:10.311383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33770e5b-9c07-4fa6-a901-c66530cb9be4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:10.314323 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33770e5b-9c07-4fa6-a901-c66530cb9be4 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:10.317070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: WARNING keystone.server.flask.common [None req-33770e5b-9c07-4fa6-a901-c66530cb9be4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 19:41:10.328029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8e92c-3bf3-47c6-b109-3786bdb209d1 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:10.328927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8e92c-3bf3-47c6-b109-3786bdb209d1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:10.329782 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8e92c-3bf3-47c6-b109-3786bdb209d1 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:10.333009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 480/934] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:10.342248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3f0fa-5215-4e29-9477-9fedd6a247eb None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:10.342885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3f0fa-5215-4e29-9477-9fedd6a247eb None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:10.343458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3f0fa-5215-4e29-9477-9fedd6a247eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:10.372175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c3e3f0fa-5215-4e29-9477-9fedd6a247eb None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:10.373868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c3e3f0fa-5215-4e29-9477-9fedd6a247eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:10.384760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.sql.core [None req-33770e5b-9c07-4fa6-a901-c66530cb9be4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 19:41:10.384760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 19:41:10.384760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [parameters: {'id': '55d43d3f666f4f46b809dae4808c3c1d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 19:41:10.384760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92146) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 19:41:10.407752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-33770e5b-9c07-4fa6-a901-c66530cb9be4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 55d43d3f666f4f46b809dae4808c3c1d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 55d43d3f666f4f46b809dae4808c3c1d. May 27 19:41:10.407752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:10.407752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 19:41:10.407752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 19:41:10.407752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 19:41:10.407752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 19:41:10.407752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 19:41:10.407752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application result = self._query(query) May 27 19:41:10.407752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 19:41:10.407752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application conn.query(q) May 27 19:41:10.407752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 19:41:10.407752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 19:41:10.407752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application result.read() May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 27 19:41:10.408685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return project_ref.to_dict() May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application next(self.gen) May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application yield resource May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application next(self.gen) May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self.session.rollback() May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self.force_reraise() May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise self.value May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application session.commit() May 27 19:41:10.409656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._prepare_impl() May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self.session.flush() May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._flush(objects) May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application compat.raise_( May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application flush_context.execute() May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 19:41:10.410616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rec.execute(self) May 27 19:41:10.411596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 19:41:10.411596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 19:41:10.411596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 19:41:10.411596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 19:41:10.411596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 19:41:10.411596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 19:41:10.411596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 19:41:10.411596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 19:41:10.411596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 19:41:10.411596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 19:41:10.411596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 19:41:10.411596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 19:41:10.411596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 19:41:10.411596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 19:41:10.411596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application result = self._query(query) May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application conn.query(q) May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application result.read() May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 19:41:10.412410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 19:41:10.413267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 19:41:10.413267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 19:41:10.413267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 19:41:10.413267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 19:41:10.413267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 19:41:10.413267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 19:41:10.413267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 19:41:10.413267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 19:41:10.413267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [parameters: {'id': '55d43d3f666f4f46b809dae4808c3c1d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 19:41:10.413267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 19:41:10.413267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:10.413267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:10.413267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:10.413267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:10.413267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:10.416791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:10.419048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:10.419048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 27 19:41:10.419048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 27 19:41:10.419048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:10.419048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:10.419048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 27 19:41:10.419048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.Conflict( May 27 19:41:10.419048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 55d43d3f666f4f46b809dae4808c3c1d. May 27 19:41:10.419048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:10.420681 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 455/935] 10.222.0.15 () {60 vars in 1140 bytes} [Fri May 27 19:41:10 2022] POST /identity/v3/projects => generated 262 bytes in 341 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:10.424999 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33770e5b-9c07-4fa6-a901-c66530cb9be4 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:10.503393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:10.520454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 481/936] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:10.553860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3f0fa-5215-4e29-9477-9fedd6a247eb None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:10.567954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33770e5b-9c07-4fa6-a901-c66530cb9be4 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:10.613505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821221ae-d61e-453f-b480-42dae3cef55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:10.614629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821221ae-d61e-453f-b480-42dae3cef55e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:10.615070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821221ae-d61e-453f-b480-42dae3cef55e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:10.615505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821221ae-d61e-453f-b480-42dae3cef55e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:10.626869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821221ae-d61e-453f-b480-42dae3cef55e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:10.629759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821221ae-d61e-453f-b480-42dae3cef55e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:10.650091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-821221ae-d61e-453f-b480-42dae3cef55e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:10.650091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:10.650091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:10.650091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:10.650091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:10.650091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:10.650091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:10.650091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:10.650091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:10.650091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:10.650091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:10.650091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:10.650091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:41:10.650091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:41:10.650091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:10.651224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:10.652243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:41:10.652243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:41:10.652243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:41:10.652243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:41:10.652243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:41:10.652243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:41:10.652243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:10.652243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:10.654538 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 456/937] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:41:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:10.662699 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821221ae-d61e-453f-b480-42dae3cef55e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:10.750110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3f0fa-5215-4e29-9477-9fedd6a247eb None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:10.775101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:10.800257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821221ae-d61e-453f-b480-42dae3cef55e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:10.811475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cfae3-1070-4693-869e-37a7c1d05155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:10.812854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cfae3-1070-4693-869e-37a7c1d05155 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:10.813359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cfae3-1070-4693-869e-37a7c1d05155 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:10.814140 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cfae3-1070-4693-869e-37a7c1d05155 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:10.819218 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:10.833004 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7cfae3-1070-4693-869e-37a7c1d05155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:41:10.843789 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec4476-a6c0-41b0-9baf-d972afd1d8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:10.844647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec4476-a6c0-41b0-9baf-d972afd1d8e9 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:10.845088 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec4476-a6c0-41b0-9baf-d972afd1d8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:10.845518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec4476-a6c0-41b0-9baf-d972afd1d8e9 None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:10.846710 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec4476-a6c0-41b0-9baf-d972afd1d8e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:10.847191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec4476-a6c0-41b0-9baf-d972afd1d8e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:10.848983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec4476-a6c0-41b0-9baf-d972afd1d8e9 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-cd7cfae3-1070-4693-869e-37a7c1d05155 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:41:10.852398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:10.853558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:10.854535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:10.854535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:10.854535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:10.854535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:10.854535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:41:10.854535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:41:10.854535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:41:10.854535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:41:10.854535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:41:10.854535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:41:10.854535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 19:41:10.854535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:10.855189 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 482/938] 10.222.0.15 () {56 vars in 1120 bytes} [Fri May 27 19:41:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:10.864012 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cfae3-1070-4693-869e-37a7c1d05155 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:10.882371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 457/939] 10.222.0.15 () {56 vars in 1112 bytes} [Fri May 27 19:41:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:11.069650 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cfae3-1070-4693-869e-37a7c1d05155 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:11.136914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32971e-c45d-441b-8ec1-5e1505e46ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:11.138073 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32971e-c45d-441b-8ec1-5e1505e46ba0 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:11.138594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32971e-c45d-441b-8ec1-5e1505e46ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:11.139017 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32971e-c45d-441b-8ec1-5e1505e46ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:11.140265 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32971e-c45d-441b-8ec1-5e1505e46ba0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:11.140812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32971e-c45d-441b-8ec1-5e1505e46ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:11.143053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32971e-c45d-441b-8ec1-5e1505e46ba0 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:11.157131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 483/940] 10.222.0.15 () {56 vars in 1115 bytes} [Fri May 27 19:41:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:11.165526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec4476-a6c0-41b0-9baf-d972afd1d8e9 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:11.328210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec4476-a6c0-41b0-9baf-d972afd1d8e9 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:11.370450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e223b7-0a9c-4b74-b12f-9b0a275a766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:11.371658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e223b7-0a9c-4b74-b12f-9b0a275a766c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:11.372152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e223b7-0a9c-4b74-b12f-9b0a275a766c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:11.372690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e223b7-0a9c-4b74-b12f-9b0a275a766c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:11.387133 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e223b7-0a9c-4b74-b12f-9b0a275a766c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:11.388927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e223b7-0a9c-4b74-b12f-9b0a275a766c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:11.409514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-45e223b7-0a9c-4b74-b12f-9b0a275a766c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:11.409514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:11.409514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:11.409514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:11.409514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:11.409514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:11.409514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:11.409514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:11.409514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:11.409514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:11.409514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:11.409514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:11.409514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:41:11.409514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:41:11.409514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:11.410541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:11.411469 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:41:11.411469 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:41:11.411469 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:11.411469 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:11.414327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 458/941] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:11.423215 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32971e-c45d-441b-8ec1-5e1505e46ba0 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:11.490679 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:11.595283 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32971e-c45d-441b-8ec1-5e1505e46ba0 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:11.633772 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de410f-9800-459d-996c-ab78c2c86a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:11.634845 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de410f-9800-459d-996c-ab78c2c86a0e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:11.635342 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de410f-9800-459d-996c-ab78c2c86a0e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:11.635854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de410f-9800-459d-996c-ab78c2c86a0e None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:11.636804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de410f-9800-459d-996c-ab78c2c86a0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:11.637329 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de410f-9800-459d-996c-ab78c2c86a0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:11.638991 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de410f-9800-459d-996c-ab78c2c86a0e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:11.652621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 484/942] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:11.660287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e223b7-0a9c-4b74-b12f-9b0a275a766c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:11.702078 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:11.825696 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e223b7-0a9c-4b74-b12f-9b0a275a766c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:11.865443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be60e05-d571-4fe8-8da4-25bd35c343d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:11.866176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be60e05-d571-4fe8-8da4-25bd35c343d6 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:11.866495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be60e05-d571-4fe8-8da4-25bd35c343d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:11.866805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be60e05-d571-4fe8-8da4-25bd35c343d6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:11.875067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be60e05-d571-4fe8-8da4-25bd35c343d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:11.876528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be60e05-d571-4fe8-8da4-25bd35c343d6 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-1be60e05-d571-4fe8-8da4-25bd35c343d6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:41:11.892414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:11.893906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:11.895424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:11.895424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:11.895424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:41:11.895424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:41:11.895424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:41:11.895424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:41:11.895424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:41:11.895424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:41:11.895424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 19:41:11.895424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:11.895424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 459/943] 10.222.0.15 () {56 vars in 1117 bytes} [Fri May 27 19:41:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:11.906275 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de410f-9800-459d-996c-ab78c2c86a0e None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:11.989353 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c7def-c8d8-460a-8f32-2e883bb5fa6e None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:11.989748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c7def-c8d8-460a-8f32-2e883bb5fa6e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:11.989977 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c7def-c8d8-460a-8f32-2e883bb5fa6e None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:11.991703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 460/944] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:41:11.997906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656f8f-a506-4700-bf72-59d497a30677 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:11.998196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656f8f-a506-4700-bf72-59d497a30677 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:11.998498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656f8f-a506-4700-bf72-59d497a30677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:12.017614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-57656f8f-a506-4700-bf72-59d497a30677 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:12.019182 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-57656f8f-a506-4700-bf72-59d497a30677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:12.038531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:12.047932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de410f-9800-459d-996c-ab78c2c86a0e None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:12.086109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cea2f1-532a-45dc-9a26-8b6dc5bcc28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:12.086809 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cea2f1-532a-45dc-9a26-8b6dc5bcc28c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:12.087099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cea2f1-532a-45dc-9a26-8b6dc5bcc28c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:12.087381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cea2f1-532a-45dc-9a26-8b6dc5bcc28c None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:12.088229 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cea2f1-532a-45dc-9a26-8b6dc5bcc28c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:12.088540 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cea2f1-532a-45dc-9a26-8b6dc5bcc28c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:12.089985 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cea2f1-532a-45dc-9a26-8b6dc5bcc28c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:12.113449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 485/945] 10.222.0.15 () {56 vars in 1149 bytes} [Fri May 27 19:41:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:12.114896 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cea2f1-532a-45dc-9a26-8b6dc5bcc28c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:12.130493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 461/946] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:12.144036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656f8f-a506-4700-bf72-59d497a30677 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:12.160504 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:12.237191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cea2f1-532a-45dc-9a26-8b6dc5bcc28c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:12.252590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656f8f-a506-4700-bf72-59d497a30677 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:12.276662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eada31-272f-417b-b469-7d57a68476eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:12.277603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eada31-272f-417b-b469-7d57a68476eb None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:12.277892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eada31-272f-417b-b469-7d57a68476eb None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:12.278173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eada31-272f-417b-b469-7d57a68476eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:12.289858 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eada31-272f-417b-b469-7d57a68476eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:12.291327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a8b5e-98d0-4254-a634-ce8654173b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:12.291823 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eada31-272f-417b-b469-7d57a68476eb None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:12.292133 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a8b5e-98d0-4254-a634-ce8654173b3c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:12.292424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a8b5e-98d0-4254-a634-ce8654173b3c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:12.292702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a8b5e-98d0-4254-a634-ce8654173b3c None admin] PATH_INFO: `/v3/services/compute` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:12.293374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a8b5e-98d0-4254-a634-ce8654173b3c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:12.294785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a8b5e-98d0-4254-a634-ce8654173b3c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-014a8b5e-98d0-4254-a634-ce8654173b3c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:12.307797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:12.308990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:12.309984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:12.309984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:12.309984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:12.309984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:12.309984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:12.309984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:12.309984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:12.309984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:12.309984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:12.309984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:12.309984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:41:12.309984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:12.309984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 19:41:12.309984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:12.309984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 462/947] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:41:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:12.310819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddab27-d501-47c3-93db-015ce21c7c49 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:12.310819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddab27-d501-47c3-93db-015ce21c7c49 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:12.311110 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddab27-d501-47c3-93db-015ce21c7c49 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:12.316483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 463/948] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:12.316483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddab27-d501-47c3-93db-015ce21c7c49 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:12.319691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-c0eada31-272f-417b-b469-7d57a68476eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:12.319691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:12.319691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:12.319691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:12.319691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:12.319691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:12.319691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:12.319691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:12.319691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:12.319691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:12.319691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:12.319691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:12.319691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:41:12.319691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:41:12.319691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:12.320808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:12.321953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:41:12.321953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:41:12.321953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:12.321953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:12.323541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 486/949] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:12.325005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c710e4-b57f-4636-a271-ac47f47fd301 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:12.325296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c710e4-b57f-4636-a271-ac47f47fd301 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:12.325572 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c710e4-b57f-4636-a271-ac47f47fd301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:12.332783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:12.345836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-f5c710e4-b57f-4636-a271-ac47f47fd301 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:12.347668 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f5c710e4-b57f-4636-a271-ac47f47fd301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:12.406544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:12.424576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 487/950] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:12.427692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c710e4-b57f-4636-a271-ac47f47fd301 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:12.432304 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddab27-d501-47c3-93db-015ce21c7c49 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:12.473921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba35f0d-c9a0-47b5-82df-2500aa31d3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:12.474924 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba35f0d-c9a0-47b5-82df-2500aa31d3d1 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:12.475458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba35f0d-c9a0-47b5-82df-2500aa31d3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:12.475909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba35f0d-c9a0-47b5-82df-2500aa31d3d1 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:12.477453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba35f0d-c9a0-47b5-82df-2500aa31d3d1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:12.477906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba35f0d-c9a0-47b5-82df-2500aa31d3d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:12.479542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba35f0d-c9a0-47b5-82df-2500aa31d3d1 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:12.486093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 464/951] 10.222.0.15 () {56 vars in 1112 bytes} [Fri May 27 19:41:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:12.487329 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba35f0d-c9a0-47b5-82df-2500aa31d3d1 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:12.561638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c710e4-b57f-4636-a271-ac47f47fd301 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:12.604757 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e1912-7c29-4abe-a912-33fbcf46d857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:12.605600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e1912-7c29-4abe-a912-33fbcf46d857 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:12.606194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e1912-7c29-4abe-a912-33fbcf46d857 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:12.606529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e1912-7c29-4abe-a912-33fbcf46d857 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:12.607268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e1912-7c29-4abe-a912-33fbcf46d857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:12.607584 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e1912-7c29-4abe-a912-33fbcf46d857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:12.608972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e1912-7c29-4abe-a912-33fbcf46d857 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:12.610773 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:12.618455 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba35f0d-c9a0-47b5-82df-2500aa31d3d1 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:12.621625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 488/952] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:12.622747 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e1912-7c29-4abe-a912-33fbcf46d857 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:12.660450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf16048-0843-4fc4-b2fb-67747fe6fbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:12.661454 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf16048-0843-4fc4-b2fb-67747fe6fbab None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:12.662380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf16048-0843-4fc4-b2fb-67747fe6fbab None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:12.662380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf16048-0843-4fc4-b2fb-67747fe6fbab None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:12.662816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf16048-0843-4fc4-b2fb-67747fe6fbab None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:12.664280 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf16048-0843-4fc4-b2fb-67747fe6fbab None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-ecf16048-0843-4fc4-b2fb-67747fe6fbab None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:12.677410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:12.678684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:12.680251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:12.680251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:12.680251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:12.680251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:12.680251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:12.680251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:12.680251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:12.680251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:12.680251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:12.680251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:12.680251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:41:12.680251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:12.680251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 19:41:12.680251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:12.680251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 465/953] 10.222.0.15 () {56 vars in 1126 bytes} [Fri May 27 19:41:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:12.681074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf16048-0843-4fc4-b2fb-67747fe6fbab None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:12.691495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:12.740413 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e1912-7c29-4abe-a912-33fbcf46d857 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:12.776095 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0e485-edcc-4693-a583-51099a7f7a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:12.776773 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0e485-edcc-4693-a583-51099a7f7a80 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:12.777066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0e485-edcc-4693-a583-51099a7f7a80 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:12.777351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0e485-edcc-4693-a583-51099a7f7a80 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:12.778083 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0e485-edcc-4693-a583-51099a7f7a80 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:12.778424 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0e485-edcc-4693-a583-51099a7f7a80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:12.779817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0e485-edcc-4693-a583-51099a7f7a80 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:12.784499 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 489/954] 10.222.0.15 () {56 vars in 1112 bytes} [Fri May 27 19:41:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:12.785307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0e485-edcc-4693-a583-51099a7f7a80 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:12.810744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf16048-0843-4fc4-b2fb-67747fe6fbab None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:12.862149 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39739d-4bf9-4e55-b78d-e4757b355d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:12.864219 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39739d-4bf9-4e55-b78d-e4757b355d73 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:12.864733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39739d-4bf9-4e55-b78d-e4757b355d73 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:12.865463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39739d-4bf9-4e55-b78d-e4757b355d73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:12.867795 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:12.878094 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39739d-4bf9-4e55-b78d-e4757b355d73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:12.884026 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39739d-4bf9-4e55-b78d-e4757b355d73 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:12.903205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-3f39739d-4bf9-4e55-b78d-e4757b355d73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:12.903205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:12.903205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:12.903205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:12.903205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:12.903205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:12.903205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:12.903205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:12.903205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:12.903205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:12.903205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:12.903205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:12.903205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:41:12.903205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:41:12.903205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:12.904462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:12.905336 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:41:12.905336 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:41:12.905336 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:41:12.905336 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:41:12.905336 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:41:12.905336 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:41:12.905336 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:12.905336 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:12.908300 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 466/955] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:41:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:12.915884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39739d-4bf9-4e55-b78d-e4757b355d73 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:12.946722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0e485-edcc-4693-a583-51099a7f7a80 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:13.006475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:13.012910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055d5f8-72bd-4150-8f89-186ee1410025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:13.014244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055d5f8-72bd-4150-8f89-186ee1410025 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:13.021157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055d5f8-72bd-4150-8f89-186ee1410025 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:13.021157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055d5f8-72bd-4150-8f89-186ee1410025 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:13.021157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055d5f8-72bd-4150-8f89-186ee1410025 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:13.021157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055d5f8-72bd-4150-8f89-186ee1410025 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:13.021157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055d5f8-72bd-4150-8f89-186ee1410025 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:13.027423 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 490/956] 10.222.0.15 () {56 vars in 1122 bytes} [Fri May 27 19:41:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:13.033087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055d5f8-72bd-4150-8f89-186ee1410025 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:13.053607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39739d-4bf9-4e55-b78d-e4757b355d73 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:13.110084 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84901e-a60b-4b2f-a743-f790dbb23f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:13.111116 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84901e-a60b-4b2f-a743-f790dbb23f1e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:13.111412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84901e-a60b-4b2f-a743-f790dbb23f1e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:13.111698 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84901e-a60b-4b2f-a743-f790dbb23f1e None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:13.112763 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84901e-a60b-4b2f-a743-f790dbb23f1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:13.113085 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84901e-a60b-4b2f-a743-f790dbb23f1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:13.115450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84901e-a60b-4b2f-a743-f790dbb23f1e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:13.132375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 467/957] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:41:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:13.140773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84901e-a60b-4b2f-a743-f790dbb23f1e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:13.181972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055d5f8-72bd-4150-8f89-186ee1410025 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:13.207622 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:13.221099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef623e-862b-484e-b8c1-ad1685b03353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:13.221908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef623e-862b-484e-b8c1-ad1685b03353 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:13.222416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef623e-862b-484e-b8c1-ad1685b03353 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:13.222794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef623e-862b-484e-b8c1-ad1685b03353 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:13.223689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef623e-862b-484e-b8c1-ad1685b03353 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:13.224162 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef623e-862b-484e-b8c1-ad1685b03353 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:13.225670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef623e-862b-484e-b8c1-ad1685b03353 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:13.232288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 491/958] 10.222.0.15 () {56 vars in 1122 bytes} [Fri May 27 19:41:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:13.237982 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef623e-862b-484e-b8c1-ad1685b03353 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:13.279922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84901e-a60b-4b2f-a743-f790dbb23f1e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:13.314765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:13.325546 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa589e28-a982-44d4-9e50-71fae685d29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:13.326570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa589e28-a982-44d4-9e50-71fae685d29e None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:13.326861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa589e28-a982-44d4-9e50-71fae685d29e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:13.327763 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa589e28-a982-44d4-9e50-71fae685d29e None admin] PATH_INFO: `/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/bffc7facb4ce4ab9967b0c8d88d0433b/roles/3b05f783f43c417193b4c5198a955e79` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:13.330863 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa589e28-a982-44d4-9e50-71fae685d29e None admin] RBAC: Authorizing `identity:create_grant(project_id=400421f9ccc6478783fa6bbc822b0687, user_id=bffc7facb4ce4ab9967b0c8d88d0433b, role_id=3b05f783f43c417193b4c5198a955e79)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:13.333019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa589e28-a982-44d4-9e50-71fae685d29e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:13.358096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef623e-862b-484e-b8c1-ad1685b03353 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:13.402662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 468/959] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:41:13 2022] PUT /identity/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/bffc7facb4ce4ab9967b0c8d88d0433b/roles/3b05f783f43c417193b4c5198a955e79 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:41:13.405963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d0f96-80cd-4a21-98d7-2e688f309c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:13.407111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d0f96-80cd-4a21-98d7-2e688f309c30 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:13.407629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d0f96-80cd-4a21-98d7-2e688f309c30 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:13.408146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d0f96-80cd-4a21-98d7-2e688f309c30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:13.409394 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d0f96-80cd-4a21-98d7-2e688f309c30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:13.411895 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5d0f96-80cd-4a21-98d7-2e688f309c30 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:13.506430 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 492/960] 10.222.0.15 () {60 vars in 1144 bytes} [Fri May 27 19:41:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 19:41:13.623456 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26511bb6-6432-4c70-b54d-773ca1ae04d1 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:13.623972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26511bb6-6432-4c70-b54d-773ca1ae04d1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:13.624076 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26511bb6-6432-4c70-b54d-773ca1ae04d1 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:13.625436 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 469/961] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:13.632122 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fbf15-d14c-44ea-b280-00bb145c3517 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:13.633286 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fbf15-d14c-44ea-b280-00bb145c3517 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:13.633286 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fbf15-d14c-44ea-b280-00bb145c3517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:13.655014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-d02fbf15-d14c-44ea-b280-00bb145c3517 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:13.656699 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d02fbf15-d14c-44ea-b280-00bb145c3517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:13.719798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:13.773987 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 493/962] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:13.814468 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26511bb6-6432-4c70-b54d-773ca1ae04d1 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:13.976972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26511bb6-6432-4c70-b54d-773ca1ae04d1 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:14.026142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3537285-fdb8-4a4f-b5db-d77c5874639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:14.026755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3537285-fdb8-4a4f-b5db-d77c5874639b None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:14.027043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3537285-fdb8-4a4f-b5db-d77c5874639b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:14.027327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3537285-fdb8-4a4f-b5db-d77c5874639b None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:14.028056 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3537285-fdb8-4a4f-b5db-d77c5874639b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:14.029494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3537285-fdb8-4a4f-b5db-d77c5874639b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:14.058747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.sql.core [None req-e3537285-fdb8-4a4f-b5db-d77c5874639b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 19:41:14.058747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 19:41:14.058747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [parameters: {'user_id': '7bba2b6820d046b39acb066b7cce37e9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 19:41:14.058747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92146) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 19:41:14.066417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-e3537285-fdb8-4a4f-b5db-d77c5874639b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 19:41:14.066417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:14.066417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 19:41:14.066417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 19:41:14.066417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 19:41:14.066417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 19:41:14.066417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 19:41:14.066417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application result = self._query(query) May 27 19:41:14.066417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 19:41:14.066417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application conn.query(q) May 27 19:41:14.066417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 19:41:14.066417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 19:41:14.066417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 19:41:14.066417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application result.read() May 27 19:41:14.066417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 19:41:14.067919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application next(self.gen) May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application yield resource May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application next(self.gen) May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self.session.rollback() May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self.force_reraise() May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise self.value May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application session.commit() May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 19:41:14.069791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._prepare_impl() May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self.session.flush() May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._flush(objects) May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application compat.raise_( May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application flush_context.execute() May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rec.execute(self) May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 19:41:14.073372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application result = connection._execute_20( May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 19:41:14.083125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application result = self._query(query) May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application conn.query(q) May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application result.read() May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 19:41:14.084592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 19:41:14.087145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 19:41:14.087145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 19:41:14.087145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 19:41:14.087145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 19:41:14.087145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 19:41:14.087145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 19:41:14.087145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [parameters: {'user_id': '7bba2b6820d046b39acb066b7cce37e9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 19:41:14.087145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 19:41:14.087145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:14.087145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:14.087145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:14.087145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:14.087145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:14.087145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:14.087145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 27 19:41:14.090420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 27 19:41:14.093879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 27 19:41:14.093879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 27 19:41:14.093879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 19:41:14.093879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 19:41:14.093879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 19:41:14.093879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:14.093879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 470/963] 10.222.0.15 () {60 vars in 1131 bytes} [Fri May 27 19:41:13 2022] POST /identity/v3/users => generated 160 bytes in 255 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:14.095191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fbf15-d14c-44ea-b280-00bb145c3517 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:14.194745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fbf15-d14c-44ea-b280-00bb145c3517 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:14.234094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255597bc-2ebc-4871-94b4-75822f8e929a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:14.234932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255597bc-2ebc-4871-94b4-75822f8e929a None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:14.235219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255597bc-2ebc-4871-94b4-75822f8e929a None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:14.235505 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255597bc-2ebc-4871-94b4-75822f8e929a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:14.243976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255597bc-2ebc-4871-94b4-75822f8e929a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:14.245440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255597bc-2ebc-4871-94b4-75822f8e929a None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-255597bc-2ebc-4871-94b4-75822f8e929a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:41:14.260932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:14.263523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:14.265548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:14.265548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:14.265548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:41:14.265548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:41:14.265548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:41:14.265548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:41:14.265548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:41:14.265548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:41:14.265548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 19:41:14.265548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:14.265548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 494/964] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:41:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:14.279688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3537285-fdb8-4a4f-b5db-d77c5874639b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:14.344698 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:14.426580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3537285-fdb8-4a4f-b5db-d77c5874639b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:14.462558 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e434eb-74d1-4b5b-9977-0ebed6d95842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:14.463241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e434eb-74d1-4b5b-9977-0ebed6d95842 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:14.463526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e434eb-74d1-4b5b-9977-0ebed6d95842 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:14.463802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e434eb-74d1-4b5b-9977-0ebed6d95842 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:14.464609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e434eb-74d1-4b5b-9977-0ebed6d95842 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:14.464922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e434eb-74d1-4b5b-9977-0ebed6d95842 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:14.466582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e434eb-74d1-4b5b-9977-0ebed6d95842 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:14.507275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 471/965] 10.222.0.15 () {56 vars in 1101 bytes} [Fri May 27 19:41:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:16.003433 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcdd98-37b1-4230-b0b4-07ff5cda69ac None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:16.003961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcdd98-37b1-4230-b0b4-07ff5cda69ac None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:16.004077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcdd98-37b1-4230-b0b4-07ff5cda69ac None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:16.005395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 495/966] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:16.010912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4619c-1f7a-4fbb-a40d-337693a76fee None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:16.011316 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4619c-1f7a-4fbb-a40d-337693a76fee None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:16.011624 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4619c-1f7a-4fbb-a40d-337693a76fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:16.029037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-24e4619c-1f7a-4fbb-a40d-337693a76fee None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:16.030587 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-24e4619c-1f7a-4fbb-a40d-337693a76fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:16.102616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 472/967] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:16.124905 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcdd98-37b1-4230-b0b4-07ff5cda69ac None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:16.154700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:16.230766 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcdd98-37b1-4230-b0b4-07ff5cda69ac None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:16.265614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87965c9d-c458-4d21-9e28-79c304c2224e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:16.266378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87965c9d-c458-4d21-9e28-79c304c2224e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:16.266665 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87965c9d-c458-4d21-9e28-79c304c2224e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:16.266945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87965c9d-c458-4d21-9e28-79c304c2224e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:16.267611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87965c9d-c458-4d21-9e28-79c304c2224e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:16.269015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87965c9d-c458-4d21-9e28-79c304c2224e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:16.270887 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8d0d9-c1e7-42af-8203-81c9fdd244bf None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:16.271377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8d0d9-c1e7-42af-8203-81c9fdd244bf None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:16.271882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e8d0d9-c1e7-42af-8203-81c9fdd244bf None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:16.278389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 473/968] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:16.281232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bbe79-672f-4321-9d0a-f786187797b8 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:16.281978 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bbe79-672f-4321-9d0a-f786187797b8 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-87965c9d-c458-4d21-9e28-79c304c2224e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:16.282506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:16.284340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:16.285978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:16.285978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:16.285978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:16.285978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:16.285978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:16.285978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:16.285978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:16.285978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:16.285978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:16.285978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:16.285978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:41:16.285978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:16.285978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 19:41:16.285978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:16.285978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 496/969] 10.222.0.15 () {56 vars in 1126 bytes} [Fri May 27 19:41:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:16.288919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bbe79-672f-4321-9d0a-f786187797b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:16.290009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87965c9d-c458-4d21-9e28-79c304c2224e None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:16.310972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-de1bbe79-672f-4321-9d0a-f786187797b8 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:16.312500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-de1bbe79-672f-4321-9d0a-f786187797b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:16.348462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:16.400047 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 474/970] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:16.410473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:16.420626 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87965c9d-c458-4d21-9e28-79c304c2224e None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:16.425864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bbe79-672f-4321-9d0a-f786187797b8 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:16.462287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735b4fb-9b96-4b17-bbf7-3e92ae4cab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:16.462985 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735b4fb-9b96-4b17-bbf7-3e92ae4cab14 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:16.463316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735b4fb-9b96-4b17-bbf7-3e92ae4cab14 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:16.463677 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735b4fb-9b96-4b17-bbf7-3e92ae4cab14 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:16.464450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735b4fb-9b96-4b17-bbf7-3e92ae4cab14 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:16.464834 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735b4fb-9b96-4b17-bbf7-3e92ae4cab14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:16.466097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735b4fb-9b96-4b17-bbf7-3e92ae4cab14 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:16.475071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 497/971] 10.222.0.15 () {56 vars in 1122 bytes} [Fri May 27 19:41:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:16.480776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735b4fb-9b96-4b17-bbf7-3e92ae4cab14 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:16.594181 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bbe79-672f-4321-9d0a-f786187797b8 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:16.599689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735b4fb-9b96-4b17-bbf7-3e92ae4cab14 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:16.631028 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f98c5c-7bdf-4985-94c8-2638e789d953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:16.631720 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f98c5c-7bdf-4985-94c8-2638e789d953 None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:16.632057 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f98c5c-7bdf-4985-94c8-2638e789d953 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:16.632840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f98c5c-7bdf-4985-94c8-2638e789d953 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:16.633571 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f98c5c-7bdf-4985-94c8-2638e789d953 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:16.634976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f98c5c-7bdf-4985-94c8-2638e789d953 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:16.653429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cfa5a-c040-4fd1-8f88-a1333155f000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:16.654131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cfa5a-c040-4fd1-8f88-a1333155f000 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:16.655749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cfa5a-c040-4fd1-8f88-a1333155f000 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:16.655749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cfa5a-c040-4fd1-8f88-a1333155f000 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:16.655749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cfa5a-c040-4fd1-8f88-a1333155f000 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:16.656140 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cfa5a-c040-4fd1-8f88-a1333155f000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:16.657165 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cfa5a-c040-4fd1-8f88-a1333155f000 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:16.662133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 498/972] 10.222.0.15 () {56 vars in 1122 bytes} [Fri May 27 19:41:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:16.668578 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cfa5a-c040-4fd1-8f88-a1333155f000 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:16.691537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:16.747467 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 475/973] 10.222.0.15 () {60 vars in 1141 bytes} [Fri May 27 19:41:16 2022] POST /identity/v3/services => generated 242 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:41:16.792211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cfa5a-c040-4fd1-8f88-a1333155f000 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:16.847361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4e174-6ac3-4a7d-b329-9d96899488ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:16.847948 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4e174-6ac3-4a7d-b329-9d96899488ea None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:16.848229 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4e174-6ac3-4a7d-b329-9d96899488ea None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:16.848503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4e174-6ac3-4a7d-b329-9d96899488ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:16.849611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4e174-6ac3-4a7d-b329-9d96899488ea None admin] RBAC: Adding query filter params (interface=admin, service_id=087bd1ffb2ff47f788aae7b1ad6c7ef3, region_id=RegionOne) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:16.849940 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4e174-6ac3-4a7d-b329-9d96899488ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:16.851947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4e174-6ac3-4a7d-b329-9d96899488ea None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:16.859431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 499/974] 10.222.0.15 () {56 vars in 1249 bytes} [Fri May 27 19:41:16 2022] GET /identity/v3/endpoints?service_id=087bd1ffb2ff47f788aae7b1ad6c7ef3&interface=admin®ion_id=RegionOne => generated 193 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:16.865546 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f98c5c-7bdf-4985-94c8-2638e789d953 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:16.905718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf9cf5-8058-4782-96e5-6f47ee11f299 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:16.906506 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:16.906746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf9cf5-8058-4782-96e5-6f47ee11f299 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:16.907185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf9cf5-8058-4782-96e5-6f47ee11f299 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:16.909550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 500/975] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:16.916805 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02366e-e738-4f92-8099-04aeb6924f9e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:16.917558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02366e-e738-4f92-8099-04aeb6924f9e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:16.917744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02366e-e738-4f92-8099-04aeb6924f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:16.944357 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-6b02366e-e738-4f92-8099-04aeb6924f9e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:16.945664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-6b02366e-e738-4f92-8099-04aeb6924f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:17.033054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f98c5c-7bdf-4985-94c8-2638e789d953 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:17.072070 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 501/976] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:17.078289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00149756-225e-4d30-8084-988123ee3d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:17.079172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00149756-225e-4d30-8084-988123ee3d96 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:17.079600 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00149756-225e-4d30-8084-988123ee3d96 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:17.080032 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00149756-225e-4d30-8084-988123ee3d96 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:17.080899 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00149756-225e-4d30-8084-988123ee3d96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:17.082432 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00149756-225e-4d30-8084-988123ee3d96 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:17.090262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 476/977] 10.222.0.15 () {56 vars in 1087 bytes} [Fri May 27 19:41:16 2022] GET /identity/v3/services => generated 1727 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 19:41:17.101946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02366e-e738-4f92-8099-04aeb6924f9e None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:17.114990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:17.263587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02366e-e738-4f92-8099-04aeb6924f9e None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:17.324685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f98b39-efee-4b34-89eb-25c5f3f94d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:17.326805 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f98b39-efee-4b34-89eb-25c5f3f94d39 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:17.327553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f98b39-efee-4b34-89eb-25c5f3f94d39 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:17.328276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f98b39-efee-4b34-89eb-25c5f3f94d39 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:17.345476 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f98b39-efee-4b34-89eb-25c5f3f94d39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-30f98b39-efee-4b34-89eb-25c5f3f94d39 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:41:17.359194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:17.361117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:17.362785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:17.362785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:17.362785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:17.362785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:17.362785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:41:17.362785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:41:17.362785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:41:17.362785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:41:17.362785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:41:17.362785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:41:17.362785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 19:41:17.362785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:17.362785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 502/978] 10.222.0.15 () {56 vars in 1120 bytes} [Fri May 27 19:41:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:17.370238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00149756-225e-4d30-8084-988123ee3d96 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:17.483185 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:17.494259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00149756-225e-4d30-8084-988123ee3d96 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:17.533419 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e829af-4f68-4312-a8e7-cf44a962227c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:17.534099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e829af-4f68-4312-a8e7-cf44a962227c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:17.534411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e829af-4f68-4312-a8e7-cf44a962227c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:17.534699 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e829af-4f68-4312-a8e7-cf44a962227c None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:17.535458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e829af-4f68-4312-a8e7-cf44a962227c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:17.535769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e829af-4f68-4312-a8e7-cf44a962227c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:17.537136 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e829af-4f68-4312-a8e7-cf44a962227c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:17.547005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 477/979] 10.222.0.15 () {56 vars in 1115 bytes} [Fri May 27 19:41:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:17.552821 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f98b39-efee-4b34-89eb-25c5f3f94d39 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:17.660180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:17.709158 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f98b39-efee-4b34-89eb-25c5f3f94d39 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:17.760179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b53d8-0872-46f9-bbe3-75a6cd8b8497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:17.761375 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b53d8-0872-46f9-bbe3-75a6cd8b8497 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:17.761799 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b53d8-0872-46f9-bbe3-75a6cd8b8497 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:17.762222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b53d8-0872-46f9-bbe3-75a6cd8b8497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:17.779285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b53d8-0872-46f9-bbe3-75a6cd8b8497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:17.781596 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b53d8-0872-46f9-bbe3-75a6cd8b8497 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:17.810813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-802b53d8-0872-46f9-bbe3-75a6cd8b8497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:17.810813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:17.810813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:17.810813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:17.810813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:17.810813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:17.810813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:17.810813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:17.810813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:17.810813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:17.810813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:17.810813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:17.810813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:41:17.810813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:41:17.810813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:17.811783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:17.818148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:41:17.818148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:41:17.818148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:17.818148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:17.818148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 503/980] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:17.819169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e829af-4f68-4312-a8e7-cf44a962227c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:17.973731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e829af-4f68-4312-a8e7-cf44a962227c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:18.016352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c777ae-4590-47d7-b0ea-191be420ec82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:18.017302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c777ae-4590-47d7-b0ea-191be420ec82 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:18.017594 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c777ae-4590-47d7-b0ea-191be420ec82 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:18.017874 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c777ae-4590-47d7-b0ea-191be420ec82 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:18.018642 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c777ae-4590-47d7-b0ea-191be420ec82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:18.018958 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c777ae-4590-47d7-b0ea-191be420ec82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:18.020340 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c777ae-4590-47d7-b0ea-191be420ec82 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:18.042448 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 478/981] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:18.045602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b53d8-0872-46f9-bbe3-75a6cd8b8497 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:18.212679 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b53d8-0872-46f9-bbe3-75a6cd8b8497 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:18.249787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:18.267994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755e09e-3a52-4109-9535-b4bd89793a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:18.269905 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755e09e-3a52-4109-9535-b4bd89793a98 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:18.269905 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755e09e-3a52-4109-9535-b4bd89793a98 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:18.270312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755e09e-3a52-4109-9535-b4bd89793a98 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:18.282971 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755e09e-3a52-4109-9535-b4bd89793a98 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:18.285622 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755e09e-3a52-4109-9535-b4bd89793a98 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-f755e09e-3a52-4109-9535-b4bd89793a98 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:41:18.314876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:18.315868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:18.316829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:18.316829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:18.316829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:41:18.316829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:41:18.316829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:41:18.316829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:41:18.316829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:41:18.316829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:41:18.316829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 19:41:18.316829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:18.318007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 504/982] 10.222.0.15 () {56 vars in 1117 bytes} [Fri May 27 19:41:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:18.325316 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c777ae-4590-47d7-b0ea-191be420ec82 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:18.342246 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:18.440645 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c777ae-4590-47d7-b0ea-191be420ec82 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:18.493516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc4cdd-0196-448e-9981-441fcfb215c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:18.494433 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc4cdd-0196-448e-9981-441fcfb215c2 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:18.494873 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc4cdd-0196-448e-9981-441fcfb215c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:18.495316 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc4cdd-0196-448e-9981-441fcfb215c2 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:18.496320 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc4cdd-0196-448e-9981-441fcfb215c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:18.496781 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc4cdd-0196-448e-9981-441fcfb215c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:18.498635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc4cdd-0196-448e-9981-441fcfb215c2 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:18.518709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 479/983] 10.222.0.15 () {56 vars in 1149 bytes} [Fri May 27 19:41:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:18.527127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755e09e-3a52-4109-9535-b4bd89793a98 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:18.695369 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755e09e-3a52-4109-9535-b4bd89793a98 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:18.751289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29196f9-37de-4d36-b964-ad2218fdeac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:18.752395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29196f9-37de-4d36-b964-ad2218fdeac5 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:18.752901 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29196f9-37de-4d36-b964-ad2218fdeac5 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:18.753392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29196f9-37de-4d36-b964-ad2218fdeac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:18.838308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:18.862752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29196f9-37de-4d36-b964-ad2218fdeac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:18.864545 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29196f9-37de-4d36-b964-ad2218fdeac5 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:19.033878 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f8942-763b-48f3-a068-72eeac2d4436 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:19.034244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f8942-763b-48f3-a068-72eeac2d4436 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:19.034480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f8942-763b-48f3-a068-72eeac2d4436 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:19.038382 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 480/984] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:41:19.038592 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 505/985] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:41:18 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:41:19.042393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c70e97-af85-409e-8f43-25a5ca851adc None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:19.042873 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c70e97-af85-409e-8f43-25a5ca851adc None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:19.043408 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c70e97-af85-409e-8f43-25a5ca851adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:19.043589 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29196f9-37de-4d36-b964-ad2218fdeac5 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:19.071499 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-50c70e97-af85-409e-8f43-25a5ca851adc None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:19.073470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-50c70e97-af85-409e-8f43-25a5ca851adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:19.136621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:19.145890 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:19.157151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29196f9-37de-4d36-b964-ad2218fdeac5 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:19.158557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 481/986] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:19.175154 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c70e97-af85-409e-8f43-25a5ca851adc None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:19.211497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078aec5b-0559-4026-a5a7-5ea64360be70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:19.212840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078aec5b-0559-4026-a5a7-5ea64360be70 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:19.213408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078aec5b-0559-4026-a5a7-5ea64360be70 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:19.213817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078aec5b-0559-4026-a5a7-5ea64360be70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:19.232552 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078aec5b-0559-4026-a5a7-5ea64360be70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:19.235353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078aec5b-0559-4026-a5a7-5ea64360be70 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:19.258865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-078aec5b-0559-4026-a5a7-5ea64360be70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:19.258865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:19.258865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:19.258865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:19.258865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:19.258865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:19.258865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:19.258865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:19.258865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:19.258865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:19.258865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:19.258865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:19.258865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:41:19.258865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:41:19.258865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:19.259855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:19.260764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:41:19.260764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:41:19.260764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:19.260764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:19.262506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 506/987] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:19.267139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078aec5b-0559-4026-a5a7-5ea64360be70 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:19.286103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c70e97-af85-409e-8f43-25a5ca851adc None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:19.329564 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e573d-82fd-4970-a001-ca87bb7c626d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:19.330946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e573d-82fd-4970-a001-ca87bb7c626d None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:19.331456 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e573d-82fd-4970-a001-ca87bb7c626d None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:19.331948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e573d-82fd-4970-a001-ca87bb7c626d None admin] PATH_INFO: `/v3/services/compute` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:19.333156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e573d-82fd-4970-a001-ca87bb7c626d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:19.335735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e573d-82fd-4970-a001-ca87bb7c626d None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-6a9e573d-82fd-4970-a001-ca87bb7c626d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:19.357461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:19.358766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:19.359755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:19.359755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:19.359755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:19.359755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:19.359755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:19.359755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:19.359755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:19.359755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:19.359755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:19.359755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:19.359755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:41:19.359755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:19.359755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 19:41:19.359755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:19.360490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 482/988] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:41:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:19.366897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e573d-82fd-4970-a001-ca87bb7c626d None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:19.402159 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078aec5b-0559-4026-a5a7-5ea64360be70 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:19.448883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33af00-7f1a-4447-8a10-ca70d9e576a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:19.449933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33af00-7f1a-4447-8a10-ca70d9e576a1 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:19.450419 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33af00-7f1a-4447-8a10-ca70d9e576a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:19.451660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33af00-7f1a-4447-8a10-ca70d9e576a1 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:19.452973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33af00-7f1a-4447-8a10-ca70d9e576a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:19.453534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33af00-7f1a-4447-8a10-ca70d9e576a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:19.455172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:19.456042 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33af00-7f1a-4447-8a10-ca70d9e576a1 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:19.458757 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:19.486081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 507/989] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:19.487722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33af00-7f1a-4447-8a10-ca70d9e576a1 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:19.512740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e573d-82fd-4970-a001-ca87bb7c626d None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:19.556417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96b18e-213c-4d7c-a405-aab9080b38f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:19.557506 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96b18e-213c-4d7c-a405-aab9080b38f6 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:19.558011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96b18e-213c-4d7c-a405-aab9080b38f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:19.558530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96b18e-213c-4d7c-a405-aab9080b38f6 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:19.559442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96b18e-213c-4d7c-a405-aab9080b38f6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:19.559970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96b18e-213c-4d7c-a405-aab9080b38f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:19.561556 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96b18e-213c-4d7c-a405-aab9080b38f6 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:19.567731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 483/990] 10.222.0.15 () {56 vars in 1112 bytes} [Fri May 27 19:41:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:19.574588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96b18e-213c-4d7c-a405-aab9080b38f6 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:19.623050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33af00-7f1a-4447-8a10-ca70d9e576a1 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:19.667035 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b784675-b46a-40b1-8920-3402869519ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:19.668173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784675-b46a-40b1-8920-3402869519ea None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:19.668588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784675-b46a-40b1-8920-3402869519ea None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:19.669072 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b784675-b46a-40b1-8920-3402869519ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:19.678012 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b784675-b46a-40b1-8920-3402869519ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:19.680801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b784675-b46a-40b1-8920-3402869519ea None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:19.691164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96b18e-213c-4d7c-a405-aab9080b38f6 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:19.701512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-8b784675-b46a-40b1-8920-3402869519ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:19.701512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:19.701512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:19.701512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:19.701512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:19.701512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:19.701512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:19.701512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:19.701512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:19.701512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:19.701512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:19.701512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:19.701512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:41:19.701512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:41:19.701512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:19.702787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:19.704686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:41:19.704686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:41:19.704686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:41:19.704686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:41:19.704686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:41:19.704686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:41:19.704686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:19.704686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:19.704686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 508/991] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:41:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:19.712857 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b784675-b46a-40b1-8920-3402869519ea None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:19.737399 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:19.751855 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c5e20-dbe8-499f-a90c-04b2173a18fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:19.755181 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c5e20-dbe8-499f-a90c-04b2173a18fa None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:19.755181 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c5e20-dbe8-499f-a90c-04b2173a18fa None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:19.755181 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18c5e20-dbe8-499f-a90c-04b2173a18fa None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:19.755181 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c5e20-dbe8-499f-a90c-04b2173a18fa None admin] RBAC: Adding query filter params (type=compute) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:19.755181 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c5e20-dbe8-499f-a90c-04b2173a18fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:19.755764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18c5e20-dbe8-499f-a90c-04b2173a18fa None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:19.763754 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 484/992] 10.222.0.15 () {56 vars in 1112 bytes} [Fri May 27 19:41:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:19.772147 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c5e20-dbe8-499f-a90c-04b2173a18fa None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:19.794473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:19.855655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b784675-b46a-40b1-8920-3402869519ea None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:19.899575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7223fe-fb9e-494e-96ea-61aaa1cf7262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:19.900091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18c5e20-dbe8-499f-a90c-04b2173a18fa None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:19.900260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7223fe-fb9e-494e-96ea-61aaa1cf7262 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:19.900540 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7223fe-fb9e-494e-96ea-61aaa1cf7262 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:19.900784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7223fe-fb9e-494e-96ea-61aaa1cf7262 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:19.901582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7223fe-fb9e-494e-96ea-61aaa1cf7262 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:19.901898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7223fe-fb9e-494e-96ea-61aaa1cf7262 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:19.903393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7223fe-fb9e-494e-96ea-61aaa1cf7262 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:19.917349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 509/993] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:41:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:19.925711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7223fe-fb9e-494e-96ea-61aaa1cf7262 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:19.955265 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d02d2d-4fb0-4727-a9b4-cef6cfaba26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:19.956364 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d02d2d-4fb0-4727-a9b4-cef6cfaba26a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:19.956872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d02d2d-4fb0-4727-a9b4-cef6cfaba26a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:19.957385 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d02d2d-4fb0-4727-a9b4-cef6cfaba26a None admin] PATH_INFO: `/v3/endpoints` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:19.958863 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d02d2d-4fb0-4727-a9b4-cef6cfaba26a None admin] RBAC: Adding query filter params (interface=public, service_id=00d13f4f4d9442f8ae4202fa82051804, region_id=RegionOne) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:19.959414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d02d2d-4fb0-4727-a9b4-cef6cfaba26a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:19.962612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d02d2d-4fb0-4727-a9b4-cef6cfaba26a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:19.974029 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 485/994] 10.222.0.15 () {56 vars in 1251 bytes} [Fri May 27 19:41:19 2022] GET /identity/v3/endpoints?service_id=00d13f4f4d9442f8ae4202fa82051804&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:19.975361 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d02d2d-4fb0-4727-a9b4-cef6cfaba26a None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:20.038610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:20.048945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7223fe-fb9e-494e-96ea-61aaa1cf7262 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:20.063606 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:20.084184 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d02d2d-4fb0-4727-a9b4-cef6cfaba26a None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:20.085544 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4eee89-529e-4373-a0d9-780d68e2f7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:20.086202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eee89-529e-4373-a0d9-780d68e2f7ea None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:20.086533 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eee89-529e-4373-a0d9-780d68e2f7ea None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:20.086816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eee89-529e-4373-a0d9-780d68e2f7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:20.087650 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4eee89-529e-4373-a0d9-780d68e2f7ea None admin] RBAC: Adding query filter params (role.id=3b05f783f43c417193b4c5198a955e79, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=bffc7facb4ce4ab9967b0c8d88d0433b) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:20.087962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4eee89-529e-4373-a0d9-780d68e2f7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:20.089411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4eee89-529e-4373-a0d9-780d68e2f7ea None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:20.095853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 510/995] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:41:19 2022] GET /identity/v3/role_assignments?user.id=bffc7facb4ce4ab9967b0c8d88d0433b&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=3b05f783f43c417193b4c5198a955e79 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:20.097129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f2600-6c82-4eed-9377-d1bdf3fc7626 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:20.097427 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f2600-6c82-4eed-9377-d1bdf3fc7626 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:20.097707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f2600-6c82-4eed-9377-d1bdf3fc7626 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:20.099232 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 511/996] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:20.105008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d395f-12b3-472a-8d59-8a654155bec6 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:20.105394 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d395f-12b3-472a-8d59-8a654155bec6 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:20.105564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d395f-12b3-472a-8d59-8a654155bec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:20.124867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-b51d395f-12b3-472a-8d59-8a654155bec6 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:20.126073 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae579df-67bc-43bf-bccd-9d1e937c505c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:20.126279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b51d395f-12b3-472a-8d59-8a654155bec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:20.126802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae579df-67bc-43bf-bccd-9d1e937c505c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:20.127093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae579df-67bc-43bf-bccd-9d1e937c505c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:20.127378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae579df-67bc-43bf-bccd-9d1e937c505c None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:20.128076 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae579df-67bc-43bf-bccd-9d1e937c505c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:20.130744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae579df-67bc-43bf-bccd-9d1e937c505c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:20.140204 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 486/997] 10.222.0.15 () {56 vars in 1087 bytes} [Fri May 27 19:41:19 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 19:41:20.210988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 512/998] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:20.234091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae579df-67bc-43bf-bccd-9d1e937c505c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:20.362074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae579df-67bc-43bf-bccd-9d1e937c505c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:20.385570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:20.406557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd58f9c-c444-40e6-8a22-f94bc89e3faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:20.407919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd58f9c-c444-40e6-8a22-f94bc89e3faf None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:20.408405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd58f9c-c444-40e6-8a22-f94bc89e3faf None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:20.408888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd58f9c-c444-40e6-8a22-f94bc89e3faf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:20.410058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd58f9c-c444-40e6-8a22-f94bc89e3faf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:20.412561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd58f9c-c444-40e6-8a22-f94bc89e3faf None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-5bd58f9c-c444-40e6-8a22-f94bc89e3faf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:20.438011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:20.439311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:20.440311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:20.440311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:20.440311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:20.440311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:20.440311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:20.440311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:20.440311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:20.440311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:20.440311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:20.440311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:20.440311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:41:20.440311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:20.440311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 19:41:20.440311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:20.440311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 487/999] 10.222.0.15 () {56 vars in 1126 bytes} [Fri May 27 19:41:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:20.447481 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d395f-12b3-472a-8d59-8a654155bec6 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:20.628629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d395f-12b3-472a-8d59-8a654155bec6 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:20.646222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:20.691108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88859c-789b-4580-90f1-316325b270a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:20.692236 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88859c-789b-4580-90f1-316325b270a3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:20.692729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88859c-789b-4580-90f1-316325b270a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:20.693222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88859c-789b-4580-90f1-316325b270a3 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:20.694579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88859c-789b-4580-90f1-316325b270a3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:20.695132 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88859c-789b-4580-90f1-316325b270a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:20.697663 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88859c-789b-4580-90f1-316325b270a3 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:20.709210 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 513/1000] 10.222.0.15 () {56 vars in 1122 bytes} [Fri May 27 19:41:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:20.712541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd58f9c-c444-40e6-8a22-f94bc89e3faf None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:20.829884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd58f9c-c444-40e6-8a22-f94bc89e3faf None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:20.868872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ac30d-0eef-4128-a458-948c37eccde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:20.869547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ac30d-0eef-4128-a458-948c37eccde0 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:20.869830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ac30d-0eef-4128-a458-948c37eccde0 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:20.870109 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ac30d-0eef-4128-a458-948c37eccde0 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:20.870848 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ac30d-0eef-4128-a458-948c37eccde0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:20.871160 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ac30d-0eef-4128-a458-948c37eccde0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:20.872914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ac30d-0eef-4128-a458-948c37eccde0 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:20.878596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 488/1001] 10.222.0.15 () {56 vars in 1122 bytes} [Fri May 27 19:41:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:20.884631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88859c-789b-4580-90f1-316325b270a3 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:21.034471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88859c-789b-4580-90f1-316325b270a3 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:21.086883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5c05e-fd64-4808-94a9-fe23cd183a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:21.087784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5c05e-fd64-4808-94a9-fe23cd183a7b None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:21.088210 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5c05e-fd64-4808-94a9-fe23cd183a7b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:21.088625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5c05e-fd64-4808-94a9-fe23cd183a7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:21.089777 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5c05e-fd64-4808-94a9-fe23cd183a7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:21.092149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5c05e-fd64-4808-94a9-fe23cd183a7b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:21.195806 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 514/1002] 10.222.0.15 () {60 vars in 1144 bytes} [Fri May 27 19:41:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 19:41:22.478986 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ad26d-db5f-4e6a-bb38-69c42736d005 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:22.479770 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ad26d-db5f-4e6a-bb38-69c42736d005 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:22.479770 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ad26d-db5f-4e6a-bb38-69c42736d005 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:22.481430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 489/1003] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:41:22.487009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1149d-ef1d-48d5-a769-6e8c18d64d8f None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:22.487755 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1149d-ef1d-48d5-a769-6e8c18d64d8f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:22.487755 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1149d-ef1d-48d5-a769-6e8c18d64d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:22.504692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-35f1149d-ef1d-48d5-a769-6e8c18d64d8f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:22.505889 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-35f1149d-ef1d-48d5-a769-6e8c18d64d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:22.535106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:22.589389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 515/1004] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:22 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:22.606059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5607f1c-a853-4084-89e9-8cb81581dfdc None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:22.606912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5607f1c-a853-4084-89e9-8cb81581dfdc None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:22.607361 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5607f1c-a853-4084-89e9-8cb81581dfdc None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:22.610399 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 490/1005] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:22.612667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1149d-ef1d-48d5-a769-6e8c18d64d8f None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:22.615248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed696f8-0087-45fc-be74-17b2a357536e None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:22.615714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed696f8-0087-45fc-be74-17b2a357536e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:22.616840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed696f8-0087-45fc-be74-17b2a357536e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:22.637505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-aed696f8-0087-45fc-be74-17b2a357536e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:22.639148 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-aed696f8-0087-45fc-be74-17b2a357536e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:22.696168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:22.726044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 491/1006] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:22 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:22.728644 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1149d-ef1d-48d5-a769-6e8c18d64d8f None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:22.753653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed696f8-0087-45fc-be74-17b2a357536e None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:22.778403 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6767c1-0eb9-4c42-94ec-9003e27299eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:22.779447 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6767c1-0eb9-4c42-94ec-9003e27299eb None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:22.779883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6767c1-0eb9-4c42-94ec-9003e27299eb None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:22.780452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6767c1-0eb9-4c42-94ec-9003e27299eb None admin] PATH_INFO: `/v3/services/compute` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:22.781288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6767c1-0eb9-4c42-94ec-9003e27299eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:22.782958 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6767c1-0eb9-4c42-94ec-9003e27299eb None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-0b6767c1-0eb9-4c42-94ec-9003e27299eb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:22.798835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:22.800764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:22.803482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:22.803482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:22.803482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:22.803482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:22.803482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:22.803482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:22.803482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:22.803482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:22.803482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:22.803482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:22.803482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:41:22.803482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:22.803482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 19:41:22.803482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:22.803482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 516/1007] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:41:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:22.808109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6767c1-0eb9-4c42-94ec-9003e27299eb None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:22.841563 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:22.888456 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed696f8-0087-45fc-be74-17b2a357536e None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:22.932326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f141094-3210-4305-9ca2-3660d83e55af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:22.933144 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f141094-3210-4305-9ca2-3660d83e55af None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:22.933433 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f141094-3210-4305-9ca2-3660d83e55af None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:22.933716 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f141094-3210-4305-9ca2-3660d83e55af None admin] PATH_INFO: `/v3/services/image` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:22.934420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f141094-3210-4305-9ca2-3660d83e55af None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:22.935821 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f141094-3210-4305-9ca2-3660d83e55af None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:22.939410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6767c1-0eb9-4c42-94ec-9003e27299eb None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-4f141094-3210-4305-9ca2-3660d83e55af None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:22.949044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:22.951429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:22.953311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:22.953311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:22.953311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:22.953311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:22.953311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:22.953311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:22.953311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:22.953311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:22.953311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:22.953311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:22.953311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:41:22.953311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:22.953311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 19:41:22.953311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:22.953311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 492/1008] 10.222.0.15 () {56 vars in 1105 bytes} [Fri May 27 19:41:22 2022] GET /identity/v3/services/image => generated 86 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:22.959705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f141094-3210-4305-9ca2-3660d83e55af None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:22.999072 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25279912-d59d-4b47-bcd5-07fe4a2f5ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:23.000088 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25279912-d59d-4b47-bcd5-07fe4a2f5ebc None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:23.000396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25279912-d59d-4b47-bcd5-07fe4a2f5ebc None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:23.000851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25279912-d59d-4b47-bcd5-07fe4a2f5ebc None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:23.001892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25279912-d59d-4b47-bcd5-07fe4a2f5ebc None admin] RBAC: Adding query filter params (name=compute) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:23.002430 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25279912-d59d-4b47-bcd5-07fe4a2f5ebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:23.004926 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25279912-d59d-4b47-bcd5-07fe4a2f5ebc None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:23.018628 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 517/1009] 10.222.0.15 () {56 vars in 1112 bytes} [Fri May 27 19:41:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:23.019779 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25279912-d59d-4b47-bcd5-07fe4a2f5ebc None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:23.035214 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:23.116513 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f141094-3210-4305-9ca2-3660d83e55af None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:23.139865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:23.158709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25279912-d59d-4b47-bcd5-07fe4a2f5ebc None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:23.159822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4555f8-baf6-40fd-a41a-dfc4adc8cad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:23.160640 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4555f8-baf6-40fd-a41a-dfc4adc8cad1 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:23.160801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4555f8-baf6-40fd-a41a-dfc4adc8cad1 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:23.161053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4555f8-baf6-40fd-a41a-dfc4adc8cad1 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:23.161773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4555f8-baf6-40fd-a41a-dfc4adc8cad1 None admin] RBAC: Adding query filter params (name=image) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:23.162085 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4555f8-baf6-40fd-a41a-dfc4adc8cad1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:23.163551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4555f8-baf6-40fd-a41a-dfc4adc8cad1 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:23.176853 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 493/1010] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:23.179994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4555f8-baf6-40fd-a41a-dfc4adc8cad1 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:23.207208 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f7d15-5f28-444e-b2cd-1b090b7d0539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:23.208377 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f7d15-5f28-444e-b2cd-1b090b7d0539 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:23.208751 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f7d15-5f28-444e-b2cd-1b090b7d0539 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:23.209164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f7d15-5f28-444e-b2cd-1b090b7d0539 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:23.210777 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f7d15-5f28-444e-b2cd-1b090b7d0539 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:23.211261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f7d15-5f28-444e-b2cd-1b090b7d0539 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:23.212970 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f7d15-5f28-444e-b2cd-1b090b7d0539 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:23.224169 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 518/1011] 10.222.0.15 () {56 vars in 1112 bytes} [Fri May 27 19:41:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:23.226402 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f7d15-5f28-444e-b2cd-1b090b7d0539 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:23.325748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4555f8-baf6-40fd-a41a-dfc4adc8cad1 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:23.335242 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:23.369488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f7d15-5f28-444e-b2cd-1b090b7d0539 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:23.377001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4287d9-e65a-4618-9d58-05ebe19b4425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:23.377678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4287d9-e65a-4618-9d58-05ebe19b4425 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:23.377969 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4287d9-e65a-4618-9d58-05ebe19b4425 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:23.378249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4287d9-e65a-4618-9d58-05ebe19b4425 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:23.379140 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4287d9-e65a-4618-9d58-05ebe19b4425 None admin] RBAC: Adding query filter params (type=image) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:23.379457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4287d9-e65a-4618-9d58-05ebe19b4425 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:23.381398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4287d9-e65a-4618-9d58-05ebe19b4425 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:23.387966 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 494/1012] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:23.415307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768484b-75c3-46de-bb6b-7e866c360e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:23.416192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768484b-75c3-46de-bb6b-7e866c360e06 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:23.416604 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768484b-75c3-46de-bb6b-7e866c360e06 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:23.417034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768484b-75c3-46de-bb6b-7e866c360e06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:23.417950 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768484b-75c3-46de-bb6b-7e866c360e06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:23.419601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a768484b-75c3-46de-bb6b-7e866c360e06 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:23.457282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41426251-36e6-4d89-91cd-6025ea089a0f None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:23.457587 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41426251-36e6-4d89-91cd-6025ea089a0f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:23.457867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41426251-36e6-4d89-91cd-6025ea089a0f None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:23.459364 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 495/1013] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:41:23.465602 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c96d00-bab1-440e-b4c7-26e06f2722a8 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:23.465901 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c96d00-bab1-440e-b4c7-26e06f2722a8 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:23.466186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c96d00-bab1-440e-b4c7-26e06f2722a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:23.488525 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-87c96d00-bab1-440e-b4c7-26e06f2722a8 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:23.489836 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-87c96d00-bab1-440e-b4c7-26e06f2722a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:23.514377 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 519/1014] 10.222.0.15 () {60 vars in 1144 bytes} [Fri May 27 19:41:23 2022] POST /identity/v3/endpoints => generated 334 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 19:41:23.592851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 496/1015] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:23 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:23.617401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768484b-75c3-46de-bb6b-7e866c360e06 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:23.627503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:23.745216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a768484b-75c3-46de-bb6b-7e866c360e06 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:23.789310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ec0cf-9e86-47b1-9708-11916d7c10e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:23.790638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ec0cf-9e86-47b1-9708-11916d7c10e6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:23.791078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ec0cf-9e86-47b1-9708-11916d7c10e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:23.791499 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ec0cf-9e86-47b1-9708-11916d7c10e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:23.793323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ec0cf-9e86-47b1-9708-11916d7c10e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:23.796017 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ec0cf-9e86-47b1-9708-11916d7c10e6 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:23.798678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 520/1016] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:23.805562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c96d00-bab1-440e-b4c7-26e06f2722a8 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:23.930761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:23.937854 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c96d00-bab1-440e-b4c7-26e06f2722a8 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:23.976368 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b14a3f-8759-4ec2-a70b-f212262403cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:23.977038 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b14a3f-8759-4ec2-a70b-f212262403cb None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:23.977324 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b14a3f-8759-4ec2-a70b-f212262403cb None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:23.977594 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b14a3f-8759-4ec2-a70b-f212262403cb None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:23.978322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b14a3f-8759-4ec2-a70b-f212262403cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:23.979789 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b14a3f-8759-4ec2-a70b-f212262403cb None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:24.106209 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 497/1017] 10.222.0.15 () {60 vars in 1141 bytes} [Fri May 27 19:41:23 2022] POST /identity/v3/projects => generated 311 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 19:41:25.675558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60d2f4-9b7d-44e1-8b2f-712392158105 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:25.676332 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60d2f4-9b7d-44e1-8b2f-712392158105 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:25.676332 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60d2f4-9b7d-44e1-8b2f-712392158105 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:25.677745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 521/1018] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:41:25.684648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8307701-b7e2-4e83-9b7b-1f2c34f3b347 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:25.685424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8307701-b7e2-4e83-9b7b-1f2c34f3b347 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:25.685579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8307701-b7e2-4e83-9b7b-1f2c34f3b347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:25.716459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b8307701-b7e2-4e83-9b7b-1f2c34f3b347 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:25.718656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b8307701-b7e2-4e83-9b7b-1f2c34f3b347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:25.840327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 498/1019] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:25 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:25.865053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60d2f4-9b7d-44e1-8b2f-712392158105 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:25.955578 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:25.983998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60d2f4-9b7d-44e1-8b2f-712392158105 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:26.024811 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b102a2-253d-4e78-82dc-437a7cd8d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:26.025486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b102a2-253d-4e78-82dc-437a7cd8d9e8 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:26.025779 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b102a2-253d-4e78-82dc-437a7cd8d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:26.026042 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b102a2-253d-4e78-82dc-437a7cd8d9e8 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:26.026817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b102a2-253d-4e78-82dc-437a7cd8d9e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:26.028198 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b102a2-253d-4e78-82dc-437a7cd8d9e8 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:26.106473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 522/1020] 10.222.0.15 () {60 vars in 1141 bytes} [Fri May 27 19:41:25 2022] POST /identity/v3/services => generated 242 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:41:26.168552 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2266e-ffed-4f1e-adc4-78d0b77f0584 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:26.168966 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2266e-ffed-4f1e-adc4-78d0b77f0584 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:26.169131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2266e-ffed-4f1e-adc4-78d0b77f0584 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:26.171138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 499/1021] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:41:26.177034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce9bd1-68ab-49e2-81f3-62ae3d1afa89 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:26.177460 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce9bd1-68ab-49e2-81f3-62ae3d1afa89 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:26.177597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce9bd1-68ab-49e2-81f3-62ae3d1afa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:26.197742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c0ce9bd1-68ab-49e2-81f3-62ae3d1afa89 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:26.199005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c0ce9bd1-68ab-49e2-81f3-62ae3d1afa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:26.290611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 523/1022] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:26.311766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2266e-ffed-4f1e-adc4-78d0b77f0584 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:26.407775 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:26.433746 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2266e-ffed-4f1e-adc4-78d0b77f0584 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:26.481469 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8135fa2-247b-47b3-9db6-8e722c6b5953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:26.482414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8135fa2-247b-47b3-9db6-8e722c6b5953 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:26.482584 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8135fa2-247b-47b3-9db6-8e722c6b5953 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:26.482853 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8135fa2-247b-47b3-9db6-8e722c6b5953 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:26.499870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8135fa2-247b-47b3-9db6-8e722c6b5953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-d8135fa2-247b-47b3-9db6-8e722c6b5953 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:41:26.508689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:26.510682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:26.512380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:26.512380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:26.512380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:26.512380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:26.512380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:41:26.512380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:41:26.512380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:41:26.512380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:41:26.512380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:41:26.512380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:41:26.512380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 19:41:26.512380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:26.512380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 500/1023] 10.222.0.15 () {56 vars in 1120 bytes} [Fri May 27 19:41:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:26.517758 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce9bd1-68ab-49e2-81f3-62ae3d1afa89 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:26.586173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:26.631663 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce9bd1-68ab-49e2-81f3-62ae3d1afa89 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:26.673106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938a8c3-7659-455c-a143-c24b252d04fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:26.673682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938a8c3-7659-455c-a143-c24b252d04fd None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:26.673967 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938a8c3-7659-455c-a143-c24b252d04fd None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:26.674248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938a8c3-7659-455c-a143-c24b252d04fd None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:26.675058 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938a8c3-7659-455c-a143-c24b252d04fd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:26.675371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938a8c3-7659-455c-a143-c24b252d04fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:26.676927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938a8c3-7659-455c-a143-c24b252d04fd None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:26.689465 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 524/1024] 10.222.0.15 () {56 vars in 1115 bytes} [Fri May 27 19:41:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:26.693870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8135fa2-247b-47b3-9db6-8e722c6b5953 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:26.809966 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8135fa2-247b-47b3-9db6-8e722c6b5953 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:26.847341 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b7f76-0fb8-4e6a-a6da-b57be71771b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:26.848140 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b7f76-0fb8-4e6a-a6da-b57be71771b3 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:26.848426 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b7f76-0fb8-4e6a-a6da-b57be71771b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:26.848703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b7f76-0fb8-4e6a-a6da-b57be71771b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:26.857118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:26.862150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b7f76-0fb8-4e6a-a6da-b57be71771b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:26.863639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b7f76-0fb8-4e6a-a6da-b57be71771b3 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:26.881932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-b25b7f76-0fb8-4e6a-a6da-b57be71771b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:26.881932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:26.881932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:26.881932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:26.881932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:26.881932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:26.881932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:26.881932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:26.881932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:26.881932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:26.881932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:26.881932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:26.881932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:41:26.881932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:41:26.881932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:26.883682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:26.886143 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:41:26.886143 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:41:26.886143 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:26.886143 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:26.890387 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 501/1025] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:26.890640 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938a8c3-7659-455c-a143-c24b252d04fd None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:26.917007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62f66-8dd6-4901-ae91-d1d35b058ab6 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:26.917277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62f66-8dd6-4901-ae91-d1d35b058ab6 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:26.917570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb62f66-8dd6-4901-ae91-d1d35b058ab6 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:26.919254 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 502/1026] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:26.925079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4e08e-a1e6-40c9-a29b-c477a9bdb864 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:26.925453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4e08e-a1e6-40c9-a29b-c477a9bdb864 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:26.925854 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4e08e-a1e6-40c9-a29b-c477a9bdb864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:26.945633 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-5df4e08e-a1e6-40c9-a29b-c477a9bdb864 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:26.947125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-5df4e08e-a1e6-40c9-a29b-c477a9bdb864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:27.004524 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938a8c3-7659-455c-a143-c24b252d04fd None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:27.032209 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:27.033630 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 503/1027] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:27.046138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aface79-51ca-4c5e-aafb-34f050e7cac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:27.047046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aface79-51ca-4c5e-aafb-34f050e7cac9 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:27.047458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aface79-51ca-4c5e-aafb-34f050e7cac9 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:27.047858 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aface79-51ca-4c5e-aafb-34f050e7cac9 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:27.048734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aface79-51ca-4c5e-aafb-34f050e7cac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:27.049163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aface79-51ca-4c5e-aafb-34f050e7cac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:27.050779 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aface79-51ca-4c5e-aafb-34f050e7cac9 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:27.059496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4e08e-a1e6-40c9-a29b-c477a9bdb864 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:27.066721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 525/1028] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:27.069534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aface79-51ca-4c5e-aafb-34f050e7cac9 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:27.201028 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4e08e-a1e6-40c9-a29b-c477a9bdb864 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:27.208148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aface79-51ca-4c5e-aafb-34f050e7cac9 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:27.234660 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:27.252332 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9d86e-63f9-47c8-854b-6235e9052a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:27.253331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9d86e-63f9-47c8-854b-6235e9052a1b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:27.253616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9d86e-63f9-47c8-854b-6235e9052a1b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:27.253973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9d86e-63f9-47c8-854b-6235e9052a1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:27.255122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9d86e-63f9-47c8-854b-6235e9052a1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:27.257166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9d86e-63f9-47c8-854b-6235e9052a1b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:27.258609 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9355d3a-9163-4a41-8f9a-a1a6d0e00d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:27.259534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355d3a-9163-4a41-8f9a-a1a6d0e00d00 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:27.259984 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355d3a-9163-4a41-8f9a-a1a6d0e00d00 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:27.260387 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9355d3a-9163-4a41-8f9a-a1a6d0e00d00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:27.263925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 504/1029] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:27.264686 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9d86e-63f9-47c8-854b-6235e9052a1b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:27.270172 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9355d3a-9163-4a41-8f9a-a1a6d0e00d00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:27.272378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9355d3a-9163-4a41-8f9a-a1a6d0e00d00 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-c9355d3a-9163-4a41-8f9a-a1a6d0e00d00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:41:27.289936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:27.291074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:27.297331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:27.297331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:27.297331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:41:27.297331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:41:27.297331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:41:27.297331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:41:27.297331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:41:27.297331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:41:27.297331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 19:41:27.297331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:27.297331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 526/1030] 10.222.0.15 () {56 vars in 1093 bytes} [Fri May 27 19:41:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:27.298896 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9355d3a-9163-4a41-8f9a-a1a6d0e00d00 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:27.368120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:27.404568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9d86e-63f9-47c8-854b-6235e9052a1b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:27.443513 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80512b-4f74-4c89-8959-991b33891c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:27.444221 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80512b-4f74-4c89-8959-991b33891c76 None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:27.444511 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80512b-4f74-4c89-8959-991b33891c76 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:27.444791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80512b-4f74-4c89-8959-991b33891c76 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:27.445508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80512b-4f74-4c89-8959-991b33891c76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:27.446055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9355d3a-9163-4a41-8f9a-a1a6d0e00d00 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:27.446994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80512b-4f74-4c89-8959-991b33891c76 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:27.494373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a3c7b-e5d2-4d2f-8e42-c96f5b639d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:27.495041 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a3c7b-e5d2-4d2f-8e42-c96f5b639d8b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:27.495326 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a3c7b-e5d2-4d2f-8e42-c96f5b639d8b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:27.495601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a3c7b-e5d2-4d2f-8e42-c96f5b639d8b None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:27.496448 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a3c7b-e5d2-4d2f-8e42-c96f5b639d8b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:27.496757 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a3c7b-e5d2-4d2f-8e42-c96f5b639d8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:27.498191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a3c7b-e5d2-4d2f-8e42-c96f5b639d8b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:27.517952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 527/1031] 10.222.0.15 () {56 vars in 1133 bytes} [Fri May 27 19:41:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:27.524289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a3c7b-e5d2-4d2f-8e42-c96f5b639d8b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:27.539222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 505/1032] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:41:27 2022] POST /identity/v3/users => generated 285 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 19:41:27.648111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:27.652206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a3c7b-e5d2-4d2f-8e42-c96f5b639d8b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:27.694216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37356487-2813-4f2f-9a93-28df3d86a36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:27.695215 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37356487-2813-4f2f-9a93-28df3d86a36b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:27.695376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37356487-2813-4f2f-9a93-28df3d86a36b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:27.695515 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37356487-2813-4f2f-9a93-28df3d86a36b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:27.779842 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37356487-2813-4f2f-9a93-28df3d86a36b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:27.781736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37356487-2813-4f2f-9a93-28df3d86a36b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:27.902529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:27.907647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 528/1033] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:41:27 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 19:41:27.913920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80512b-4f74-4c89-8959-991b33891c76 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:27.985976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:28.069277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80512b-4f74-4c89-8959-991b33891c76 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:28.120076 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2023a49-dfd6-46ee-ab6f-f5e642324ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:28.121284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2023a49-dfd6-46ee-ab6f-f5e642324ae9 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:28.121912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2023a49-dfd6-46ee-ab6f-f5e642324ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:28.122504 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2023a49-dfd6-46ee-ab6f-f5e642324ae9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:28.138648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2023a49-dfd6-46ee-ab6f-f5e642324ae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:28.140955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2023a49-dfd6-46ee-ab6f-f5e642324ae9 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:28.169827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-d2023a49-dfd6-46ee-ab6f-f5e642324ae9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:28.169827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:28.169827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:28.169827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:28.169827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:28.169827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:28.169827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:28.169827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:28.169827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:28.169827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:28.169827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:28.169827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:28.169827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:41:28.169827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:41:28.169827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:28.171299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:28.176834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:41:28.176834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:41:28.176834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:28.176834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:28.176834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 506/1034] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:28.179824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37356487-2813-4f2f-9a93-28df3d86a36b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:28.331616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37356487-2813-4f2f-9a93-28df3d86a36b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:28.382811 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3cc30-9ecf-406c-b615-18ced4ee5d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:28.383796 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3cc30-9ecf-406c-b615-18ced4ee5d5e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:28.384225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3cc30-9ecf-406c-b615-18ced4ee5d5e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:28.384644 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3cc30-9ecf-406c-b615-18ced4ee5d5e None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:28.385821 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3cc30-9ecf-406c-b615-18ced4ee5d5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:28.386288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3cc30-9ecf-406c-b615-18ced4ee5d5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:28.388495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3cc30-9ecf-406c-b615-18ced4ee5d5e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:28.410500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 529/1035] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:28.414240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2023a49-dfd6-46ee-ab6f-f5e642324ae9 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:28.447242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c91f6-7a3a-41f5-bb38-f34ceb773531 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:28.447512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c91f6-7a3a-41f5-bb38-f34ceb773531 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:28.447796 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c91f6-7a3a-41f5-bb38-f34ceb773531 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:28.449159 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 530/1036] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:28.457285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff49899-c45f-4518-826e-e5e9c2b31677 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:28.457765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff49899-c45f-4518-826e-e5e9c2b31677 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:28.458234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff49899-c45f-4518-826e-e5e9c2b31677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:28.489270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-bff49899-c45f-4518-826e-e5e9c2b31677 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:28.492121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-bff49899-c45f-4518-826e-e5e9c2b31677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:28.566471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:28.574812 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2023a49-dfd6-46ee-ab6f-f5e642324ae9 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:28.581544 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:28.602524 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 531/1037] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:28.623386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff49899-c45f-4518-826e-e5e9c2b31677 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:28.629674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9180df-7369-4ae1-ab57-6f2c581583cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:28.631043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9180df-7369-4ae1-ab57-6f2c581583cd None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:28.632164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9180df-7369-4ae1-ab57-6f2c581583cd None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:28.632664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9180df-7369-4ae1-ab57-6f2c581583cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:28.643595 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9180df-7369-4ae1-ab57-6f2c581583cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:28.646025 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9180df-7369-4ae1-ab57-6f2c581583cd None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:28.662007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-ae9180df-7369-4ae1-ab57-6f2c581583cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:28.662007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:28.662007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:28.662007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:28.662007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:28.662007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:28.662007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:28.662007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:28.662007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:28.662007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:28.662007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:28.662007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:28.662007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:41:28.662007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:41:28.662007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:28.663509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:28.665521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:41:28.665521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:41:28.665521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:41:28.665521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:41:28.665521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:41:28.665521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:41:28.665521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:28.665521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:28.665521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 507/1038] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:41:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:28.672088 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9180df-7369-4ae1-ab57-6f2c581583cd None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:28.751255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff49899-c45f-4518-826e-e5e9c2b31677 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:28.789450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29fdfd-3975-49e6-9fab-1a4ffa6109de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:28.790256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29fdfd-3975-49e6-9fab-1a4ffa6109de None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:28.790575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29fdfd-3975-49e6-9fab-1a4ffa6109de None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:28.790855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29fdfd-3975-49e6-9fab-1a4ffa6109de None admin] PATH_INFO: `/v3/services/image` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:28.791517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29fdfd-3975-49e6-9fab-1a4ffa6109de None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:28.792900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29fdfd-3975-49e6-9fab-1a4ffa6109de None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-3c29fdfd-3975-49e6-9fab-1a4ffa6109de None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:28.805449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:28.806816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:28.807648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:28.807648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:28.807648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:28.807648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:28.807648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:28.807648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:28.807648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:28.807648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:28.807648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:28.807648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:28.807648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:41:28.807648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:28.807648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 19:41:28.807648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:28.813741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 532/1039] 10.222.0.15 () {56 vars in 1105 bytes} [Fri May 27 19:41:28 2022] GET /identity/v3/services/image => generated 86 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:28.813741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29fdfd-3975-49e6-9fab-1a4ffa6109de None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:28.843988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9180df-7369-4ae1-ab57-6f2c581583cd None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:28.882788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:28.899031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3ac46-601e-40f0-ad9f-01e17c4d370a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:28.900019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3ac46-601e-40f0-ad9f-01e17c4d370a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:28.900519 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3ac46-601e-40f0-ad9f-01e17c4d370a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:28.900950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3ac46-601e-40f0-ad9f-01e17c4d370a None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:28.902226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3ac46-601e-40f0-ad9f-01e17c4d370a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:28.902922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3ac46-601e-40f0-ad9f-01e17c4d370a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:28.905211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3ac46-601e-40f0-ad9f-01e17c4d370a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:28.926107 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 508/1040] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:41:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:28.933382 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3ac46-601e-40f0-ad9f-01e17c4d370a None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:28.943061 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29fdfd-3975-49e6-9fab-1a4ffa6109de None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:28.956648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:28.996257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcf09a-ecaa-4735-8ff2-df2728bd5165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:28.997279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcf09a-ecaa-4735-8ff2-df2728bd5165 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:28.997731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcf09a-ecaa-4735-8ff2-df2728bd5165 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:28.998179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bcf09a-ecaa-4735-8ff2-df2728bd5165 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:28.999080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcf09a-ecaa-4735-8ff2-df2728bd5165 None admin] RBAC: Adding query filter params (name=image) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:28.999564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcf09a-ecaa-4735-8ff2-df2728bd5165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:29.001352 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bcf09a-ecaa-4735-8ff2-df2728bd5165 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:29.007376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 533/1041] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:29.013627 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcf09a-ecaa-4735-8ff2-df2728bd5165 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:29.081117 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3ac46-601e-40f0-ad9f-01e17c4d370a None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:29.125546 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9f9e9-c9b9-40e1-81cc-afb3b3bee0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:29.126667 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9f9e9-c9b9-40e1-81cc-afb3b3bee0ce None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:29.127156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9f9e9-c9b9-40e1-81cc-afb3b3bee0ce None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:29.127627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9f9e9-c9b9-40e1-81cc-afb3b3bee0ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:29.128610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9f9e9-c9b9-40e1-81cc-afb3b3bee0ce None admin] RBAC: Adding query filter params (role.id=3b05f783f43c417193b4c5198a955e79, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=105353b6b1a941ac81df7ad35567ba7c) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:29.129299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9f9e9-c9b9-40e1-81cc-afb3b3bee0ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:29.131798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9f9e9-c9b9-40e1-81cc-afb3b3bee0ce None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:29.139207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 509/1042] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:41:28 2022] GET /identity/v3/role_assignments?user.id=105353b6b1a941ac81df7ad35567ba7c&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=3b05f783f43c417193b4c5198a955e79 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:29.167765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bcf09a-ecaa-4735-8ff2-df2728bd5165 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:29.190363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:29.212851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6172776-9b22-45aa-a277-277bf8c40cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:29.213546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172776-9b22-45aa-a277-277bf8c40cbd None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:29.214006 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172776-9b22-45aa-a277-277bf8c40cbd None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:29.214307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6172776-9b22-45aa-a277-277bf8c40cbd None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:29.215074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6172776-9b22-45aa-a277-277bf8c40cbd None admin] RBAC: Adding query filter params (type=image) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:29.215501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6172776-9b22-45aa-a277-277bf8c40cbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:29.217006 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6172776-9b22-45aa-a277-277bf8c40cbd None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:29.223134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 534/1043] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:29.230285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9f9e9-c9b9-40e1-81cc-afb3b3bee0ce None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:29.372249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:29.394964 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9f9e9-c9b9-40e1-81cc-afb3b3bee0ce None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:29.434414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183d3e2-66d0-4562-9d52-a402e2c91dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:29.435114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183d3e2-66d0-4562-9d52-a402e2c91dd3 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:29.435376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183d3e2-66d0-4562-9d52-a402e2c91dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:29.435664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183d3e2-66d0-4562-9d52-a402e2c91dd3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:29.436452 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183d3e2-66d0-4562-9d52-a402e2c91dd3 None admin] RBAC: Adding query filter params (interface=public, service_id=c3ae04109c8f4b0c84e00c7224bac15f, region_id=RegionOne) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:29.436766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183d3e2-66d0-4562-9d52-a402e2c91dd3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:29.438137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a183d3e2-66d0-4562-9d52-a402e2c91dd3 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:29.444210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 510/1044] 10.222.0.15 () {56 vars in 1251 bytes} [Fri May 27 19:41:29 2022] GET /identity/v3/endpoints?service_id=c3ae04109c8f4b0c84e00c7224bac15f&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:29.450662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6172776-9b22-45aa-a277-277bf8c40cbd None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:29.579825 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6172776-9b22-45aa-a277-277bf8c40cbd None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:29.618572 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad5f8a-9788-49d8-ae38-642fc3f9507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:29.619432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad5f8a-9788-49d8-ae38-642fc3f9507d None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:29.619849 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad5f8a-9788-49d8-ae38-642fc3f9507d None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:29.620263 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad5f8a-9788-49d8-ae38-642fc3f9507d None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:29.621092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad5f8a-9788-49d8-ae38-642fc3f9507d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:29.622672 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad5f8a-9788-49d8-ae38-642fc3f9507d None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:29.630295 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 535/1045] 10.222.0.15 () {56 vars in 1087 bytes} [Fri May 27 19:41:29 2022] GET /identity/v3/services => generated 1957 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 19:41:29.872964 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb45a59-489e-4c4c-ad01-459ce5421d16 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:29.873258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb45a59-489e-4c4c-ad01-459ce5421d16 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:29.873591 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb45a59-489e-4c4c-ad01-459ce5421d16 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:29.875194 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 511/1046] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:41:29.882901 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4c5fa-a1a3-48d3-b2ac-a05cf7777ee1 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:29.883421 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4c5fa-a1a3-48d3-b2ac-a05cf7777ee1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:29.883850 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4c5fa-a1a3-48d3-b2ac-a05cf7777ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:29.908888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-4fe4c5fa-a1a3-48d3-b2ac-a05cf7777ee1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:29.910735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4fe4c5fa-a1a3-48d3-b2ac-a05cf7777ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:29.978721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:30.014735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 536/1047] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:30.041482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb45a59-489e-4c4c-ad01-459ce5421d16 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:30.165722 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb45a59-489e-4c4c-ad01-459ce5421d16 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:30.210349 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da00de-0729-4783-a9b9-1ea99347ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:30.211161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da00de-0729-4783-a9b9-1ea99347ce10 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:30.211508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da00de-0729-4783-a9b9-1ea99347ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:30.211793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da00de-0729-4783-a9b9-1ea99347ce10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:30.223015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da00de-0729-4783-a9b9-1ea99347ce10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-f0da00de-0729-4783-a9b9-1ea99347ce10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:41:30.230865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:30.232054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:30.233165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:30.233165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:30.233165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:30.233165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:30.233165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:41:30.233165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:41:30.233165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:41:30.233165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:41:30.233165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:41:30.233165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:41:30.233165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:41:30.233165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:30.234582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 512/1048] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:41:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:30.238049 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4c5fa-a1a3-48d3-b2ac-a05cf7777ee1 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:30.345339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4c5fa-a1a3-48d3-b2ac-a05cf7777ee1 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:30.384743 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41cd1c-eb06-4a54-9e25-6bc3e13b1d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:30.385454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41cd1c-eb06-4a54-9e25-6bc3e13b1d9d None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:30.385743 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41cd1c-eb06-4a54-9e25-6bc3e13b1d9d None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:30.386025 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41cd1c-eb06-4a54-9e25-6bc3e13b1d9d None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:30.386824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41cd1c-eb06-4a54-9e25-6bc3e13b1d9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:30.387278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41cd1c-eb06-4a54-9e25-6bc3e13b1d9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:30.388682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41cd1c-eb06-4a54-9e25-6bc3e13b1d9d None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:30.398171 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 537/1049] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:41:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:30.404406 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da00de-0729-4783-a9b9-1ea99347ce10 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:30.409778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:30.564143 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da00de-0729-4783-a9b9-1ea99347ce10 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:30.612800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdd003-85bc-4eba-8743-52f5223c3803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:30.614134 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdd003-85bc-4eba-8743-52f5223c3803 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:30.614601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdd003-85bc-4eba-8743-52f5223c3803 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:30.615020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdd003-85bc-4eba-8743-52f5223c3803 None admin] PATH_INFO: `/v3/users/9087de298b144438b410a4456aea87d9` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:30.636036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdd003-85bc-4eba-8743-52f5223c3803 None admin] RBAC: Authorizing `identity:get_user(user_id=9087de298b144438b410a4456aea87d9)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:30.638475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cdd003-85bc-4eba-8743-52f5223c3803 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:30.645563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 513/1050] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:41:30 2022] GET /identity/v3/users/9087de298b144438b410a4456aea87d9 => generated 285 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:30.646860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41cd1c-eb06-4a54-9e25-6bc3e13b1d9d None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:30.702576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:30.782206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41cd1c-eb06-4a54-9e25-6bc3e13b1d9d None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:30.823722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ed42c-5546-438c-b94a-f55379159824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:30.824485 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ed42c-5546-438c-b94a-f55379159824 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:30.824844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ed42c-5546-438c-b94a-f55379159824 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:30.825071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ed42c-5546-438c-b94a-f55379159824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:30.895876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ed42c-5546-438c-b94a-f55379159824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:30.897894 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ed42c-5546-438c-b94a-f55379159824 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:30.936328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:31.002389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 538/1051] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:41:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:41:31.004894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdd003-85bc-4eba-8743-52f5223c3803 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:31.069083 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:31.109788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdd003-85bc-4eba-8743-52f5223c3803 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:31.145142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78945744-783f-40b7-9f57-311f436438aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:31.146002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78945744-783f-40b7-9f57-311f436438aa None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:31.146286 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78945744-783f-40b7-9f57-311f436438aa None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:31.147225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78945744-783f-40b7-9f57-311f436438aa None admin] PATH_INFO: `/v3/projects/9331c123ea0743138332c3254211f6e1` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:31.148447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78945744-783f-40b7-9f57-311f436438aa None admin] RBAC: Authorizing `identity:get_project(project_id=9331c123ea0743138332c3254211f6e1)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:31.149839 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78945744-783f-40b7-9f57-311f436438aa None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:31.151728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 514/1052] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:41:31 2022] GET /identity/v3/projects/9331c123ea0743138332c3254211f6e1 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:31.157541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ed42c-5546-438c-b94a-f55379159824 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:31.260411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ed42c-5546-438c-b94a-f55379159824 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:31.296891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed47c8-2263-450d-97fe-f9bf71457a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:31.297577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed47c8-2263-450d-97fe-f9bf71457a60 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:31.297861 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed47c8-2263-450d-97fe-f9bf71457a60 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:31.298138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed47c8-2263-450d-97fe-f9bf71457a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:31.299042 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed47c8-2263-450d-97fe-f9bf71457a60 None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=9331c123ea0743138332c3254211f6e1, user.id=9087de298b144438b410a4456aea87d9) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:31.299359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed47c8-2263-450d-97fe-f9bf71457a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:31.300851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed47c8-2263-450d-97fe-f9bf71457a60 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:31.308076 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 539/1053] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:41:31 2022] GET /identity/v3/role_assignments?user.id=9087de298b144438b410a4456aea87d9&scope.project.id=9331c123ea0743138332c3254211f6e1&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:31.488919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb07e2-6b58-41fb-9eae-eb3102113c36 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:31.489240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb07e2-6b58-41fb-9eae-eb3102113c36 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:31.489482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb07e2-6b58-41fb-9eae-eb3102113c36 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:31.491610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 515/1054] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:31.497156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6e4f-24db-4435-9de4-99738b65ac40 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:31.497529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6e4f-24db-4435-9de4-99738b65ac40 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:31.497880 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6e4f-24db-4435-9de4-99738b65ac40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:31.503256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:31.516709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-92fb6e4f-24db-4435-9de4-99738b65ac40 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:31.520703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-92fb6e4f-24db-4435-9de4-99738b65ac40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:31.588760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 540/1055] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:31.611284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb07e2-6b58-41fb-9eae-eb3102113c36 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:31.719631 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb07e2-6b58-41fb-9eae-eb3102113c36 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:31.750742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:31.757195 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f3bc8-4ab2-4853-9086-a9e56dbd4935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:31.758017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3bc8-4ab2-4853-9086-a9e56dbd4935 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:31.758306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3bc8-4ab2-4853-9086-a9e56dbd4935 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:31.758619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f3bc8-4ab2-4853-9086-a9e56dbd4935 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:31.769386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96f3bc8-4ab2-4853-9086-a9e56dbd4935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-d96f3bc8-4ab2-4853-9086-a9e56dbd4935 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:41:31.777888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:31.778927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:31.779764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:31.779764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:31.779764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:31.779764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:31.779764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:41:31.779764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:41:31.779764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:41:31.779764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:41:31.779764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:41:31.779764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:41:31.779764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 19:41:31.779764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:31.782415 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 516/1056] 10.222.0.15 () {56 vars in 1120 bytes} [Fri May 27 19:41:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:31.785560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb6e4f-24db-4435-9de4-99738b65ac40 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:31.899550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb6e4f-24db-4435-9de4-99738b65ac40 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:31.929900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:31.935685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a83831-a136-4b41-85b6-bd566a5d1737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:31.936382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a83831-a136-4b41-85b6-bd566a5d1737 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:31.936672 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a83831-a136-4b41-85b6-bd566a5d1737 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:31.937098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a83831-a136-4b41-85b6-bd566a5d1737 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:31.937919 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a83831-a136-4b41-85b6-bd566a5d1737 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:31.938239 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a83831-a136-4b41-85b6-bd566a5d1737 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:31.939667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a83831-a136-4b41-85b6-bd566a5d1737 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:31.953870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 541/1057] 10.222.0.15 () {56 vars in 1115 bytes} [Fri May 27 19:41:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:31.955693 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f3bc8-4ab2-4853-9086-a9e56dbd4935 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:32.061934 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f3bc8-4ab2-4853-9086-a9e56dbd4935 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:32.096090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83499a1-134e-47a6-809f-29eaae8b8c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:32.096885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83499a1-134e-47a6-809f-29eaae8b8c48 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:32.097172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83499a1-134e-47a6-809f-29eaae8b8c48 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:32.097451 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83499a1-134e-47a6-809f-29eaae8b8c48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:32.109084 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83499a1-134e-47a6-809f-29eaae8b8c48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:32.110574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83499a1-134e-47a6-809f-29eaae8b8c48 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:32.127822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-f83499a1-134e-47a6-809f-29eaae8b8c48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:32.127822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:32.127822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:32.127822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:32.127822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:32.127822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:32.127822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:32.127822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:32.127822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:32.127822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:32.127822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:32.127822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:32.127822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:41:32.127822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:41:32.127822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:32.128794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:32.129728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:41:32.129728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:41:32.129728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:32.129728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:32.133677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 517/1058] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:32.134952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a83831-a136-4b41-85b6-bd566a5d1737 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:32.243333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a83831-a136-4b41-85b6-bd566a5d1737 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:32.279412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b224d-98a7-4de9-b185-4ad009f587fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:32.280094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b224d-98a7-4de9-b185-4ad009f587fc None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:32.280381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b224d-98a7-4de9-b185-4ad009f587fc None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:32.280664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b224d-98a7-4de9-b185-4ad009f587fc None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:32.281504 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b224d-98a7-4de9-b185-4ad009f587fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:32.281822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b224d-98a7-4de9-b185-4ad009f587fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:32.283238 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b224d-98a7-4de9-b185-4ad009f587fc None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:32.300904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 542/1059] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:32.303323 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83499a1-134e-47a6-809f-29eaae8b8c48 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:32.348814 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:32.409355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83499a1-134e-47a6-809f-29eaae8b8c48 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:32.447673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16fa34-722c-4b71-8785-5ebdd1240dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:32.448485 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16fa34-722c-4b71-8785-5ebdd1240dc1 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:32.448773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16fa34-722c-4b71-8785-5ebdd1240dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:32.449049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16fa34-722c-4b71-8785-5ebdd1240dc1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:32.457446 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16fa34-722c-4b71-8785-5ebdd1240dc1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:32.459533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16fa34-722c-4b71-8785-5ebdd1240dc1 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-bf16fa34-722c-4b71-8785-5ebdd1240dc1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:41:32.474548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:32.475723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:32.476714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:32.476714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:32.476714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:41:32.476714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:41:32.476714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:41:32.476714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:41:32.476714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:41:32.476714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:41:32.476714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 19:41:32.476714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:32.480390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 518/1060] 10.222.0.15 () {56 vars in 1093 bytes} [Fri May 27 19:41:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:32.481917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b224d-98a7-4de9-b185-4ad009f587fc None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:32.509370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e1fca-fcda-403d-9aba-d2d604a222f1 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:32.509801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e1fca-fcda-403d-9aba-d2d604a222f1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:32.510225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e1fca-fcda-403d-9aba-d2d604a222f1 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:32.512671 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 519/1061] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:32.519543 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8bf5f-d641-4a3c-81ce-ac809e0e319b None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:32.520072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8bf5f-d641-4a3c-81ce-ac809e0e319b None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:32.520369 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8bf5f-d641-4a3c-81ce-ac809e0e319b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:32.540570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b4e8bf5f-d641-4a3c-81ce-ac809e0e319b None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:32.541778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b4e8bf5f-d641-4a3c-81ce-ac809e0e319b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:32.546124 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:32.601517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b224d-98a7-4de9-b185-4ad009f587fc None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:32.638735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660711b-914b-451c-a5ec-a04d965fbf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:32.639415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660711b-914b-451c-a5ec-a04d965fbf2b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:32.639700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660711b-914b-451c-a5ec-a04d965fbf2b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:32.641122 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660711b-914b-451c-a5ec-a04d965fbf2b None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:32.641122 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660711b-914b-451c-a5ec-a04d965fbf2b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:32.641122 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660711b-914b-451c-a5ec-a04d965fbf2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:32.642674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 520/1062] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:32.642799 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5660711b-914b-451c-a5ec-a04d965fbf2b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:32.660947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 543/1063] 10.222.0.15 () {56 vars in 1133 bytes} [Fri May 27 19:41:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:32.667214 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8bf5f-d641-4a3c-81ce-ac809e0e319b None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:32.674960 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660711b-914b-451c-a5ec-a04d965fbf2b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:32.704893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:32.801086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8bf5f-d641-4a3c-81ce-ac809e0e319b None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:32.819404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660711b-914b-451c-a5ec-a04d965fbf2b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:32.834661 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:32.855010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59776004-17eb-4e1d-b287-7c130fd66e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:32.856463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59776004-17eb-4e1d-b287-7c130fd66e9d None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:32.856890 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59776004-17eb-4e1d-b287-7c130fd66e9d None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:32.857305 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59776004-17eb-4e1d-b287-7c130fd66e9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:32.858397 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bc148-5451-4ee4-b2a6-3f1103cd334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:32.859199 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bc148-5451-4ee4-b2a6-3f1103cd334e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:32.859485 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bc148-5451-4ee4-b2a6-3f1103cd334e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:32.859776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bc148-5451-4ee4-b2a6-3f1103cd334e None admin] PATH_INFO: `/v3/services/image` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:32.860438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bc148-5451-4ee4-b2a6-3f1103cd334e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:32.862194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6bc148-5451-4ee4-b2a6-3f1103cd334e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:32.874765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59776004-17eb-4e1d-b287-7c130fd66e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-ff6bc148-5451-4ee4-b2a6-3f1103cd334e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:32.875350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:32.877160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:32.878537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:32.878537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:32.878537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:32.878537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:32.878537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:32.878537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:32.878537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:32.878537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:32.878537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:32.878537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:32.878537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:41:32.878537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:41:32.878537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 19:41:32.878537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:32.878537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 544/1064] 10.222.0.15 () {56 vars in 1105 bytes} [Fri May 27 19:41:32 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:32.882568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59776004-17eb-4e1d-b287-7c130fd66e9d None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:32.883641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bc148-5451-4ee4-b2a6-3f1103cd334e None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:32.913903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-59776004-17eb-4e1d-b287-7c130fd66e9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:32.913903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:32.913903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:32.913903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:32.913903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:32.913903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:32.913903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:32.913903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:32.913903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:32.913903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:32.913903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:32.913903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:32.913903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:41:32.913903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:41:32.913903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:32.915130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:32.916168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:41:32.916168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:41:32.916168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:32.916168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:32.916168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 521/1065] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:32.921722 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59776004-17eb-4e1d-b287-7c130fd66e9d None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:33.009468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bc148-5451-4ee4-b2a6-3f1103cd334e None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:33.018685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:33.039571 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59776004-17eb-4e1d-b287-7c130fd66e9d None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:33.048791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60148a9-6139-47e3-bc40-79556f255d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:33.049471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60148a9-6139-47e3-bc40-79556f255d0b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:33.049854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60148a9-6139-47e3-bc40-79556f255d0b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:33.050089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60148a9-6139-47e3-bc40-79556f255d0b None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:33.050846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60148a9-6139-47e3-bc40-79556f255d0b None admin] RBAC: Adding query filter params (name=image) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:33.051161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60148a9-6139-47e3-bc40-79556f255d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:33.054050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60148a9-6139-47e3-bc40-79556f255d0b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:33.064457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 545/1066] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:33.065270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60148a9-6139-47e3-bc40-79556f255d0b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:33.094567 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80071460-30a6-44a1-9484-211874d1f6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:33.095251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80071460-30a6-44a1-9484-211874d1f6e7 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:33.095540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80071460-30a6-44a1-9484-211874d1f6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:33.095823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80071460-30a6-44a1-9484-211874d1f6e7 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:33.096557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80071460-30a6-44a1-9484-211874d1f6e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:33.097312 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80071460-30a6-44a1-9484-211874d1f6e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:33.098248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80071460-30a6-44a1-9484-211874d1f6e7 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:33.110324 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 522/1067] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:33.116436 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80071460-30a6-44a1-9484-211874d1f6e7 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:33.123682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:33.204464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60148a9-6139-47e3-bc40-79556f255d0b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:33.236404 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80071460-30a6-44a1-9484-211874d1f6e7 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:33.257261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e07a8-7627-44d5-9a5b-561a0b7f79b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:33.258723 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e07a8-7627-44d5-9a5b-561a0b7f79b7 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:33.259353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e07a8-7627-44d5-9a5b-561a0b7f79b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:33.259991 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e07a8-7627-44d5-9a5b-561a0b7f79b7 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:33.261312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e07a8-7627-44d5-9a5b-561a0b7f79b7 None admin] RBAC: Adding query filter params (type=image) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:33.261979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e07a8-7627-44d5-9a5b-561a0b7f79b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:33.264591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e07a8-7627-44d5-9a5b-561a0b7f79b7 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:33.271555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 546/1068] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:33.277197 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e07a8-7627-44d5-9a5b-561a0b7f79b7 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:33.279968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448a5f7-f49c-49a2-8cbf-e8be42500667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:33.280790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a5f7-f49c-49a2-8cbf-e8be42500667 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:33.281073 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a5f7-f49c-49a2-8cbf-e8be42500667 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:33.281352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448a5f7-f49c-49a2-8cbf-e8be42500667 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:33.289390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448a5f7-f49c-49a2-8cbf-e8be42500667 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:33.291047 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448a5f7-f49c-49a2-8cbf-e8be42500667 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:33.306965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-b448a5f7-f49c-49a2-8cbf-e8be42500667 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:33.306965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:33.306965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:33.306965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:33.306965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:33.306965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:33.306965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:33.306965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:33.306965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:33.306965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:33.306965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:33.306965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:33.306965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:41:33.306965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:41:33.306965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:33.308743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:33.310932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:41:33.310932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:41:33.310932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:41:33.310932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:41:33.310932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:41:33.310932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:41:33.310932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:33.310932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:33.313079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 523/1069] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:41:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:33.313971 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448a5f7-f49c-49a2-8cbf-e8be42500667 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:33.318981 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:33.413459 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e07a8-7627-44d5-9a5b-561a0b7f79b7 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:33.416348 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:33.436450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448a5f7-f49c-49a2-8cbf-e8be42500667 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:33.465652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3718a5b-edb7-421e-8e5d-07e081e18dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:33.466333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3718a5b-edb7-421e-8e5d-07e081e18dfc None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:33.466671 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3718a5b-edb7-421e-8e5d-07e081e18dfc None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:33.466950 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3718a5b-edb7-421e-8e5d-07e081e18dfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:33.467678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3718a5b-edb7-421e-8e5d-07e081e18dfc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:33.469063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3718a5b-edb7-421e-8e5d-07e081e18dfc None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:33.489671 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8235331-4f08-42a5-81a4-580df9c82a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:33.490465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8235331-4f08-42a5-81a4-580df9c82a3b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:33.490756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8235331-4f08-42a5-81a4-580df9c82a3b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:33.491037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8235331-4f08-42a5-81a4-580df9c82a3b None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:33.491831 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8235331-4f08-42a5-81a4-580df9c82a3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:33.492146 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8235331-4f08-42a5-81a4-580df9c82a3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:33.493625 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8235331-4f08-42a5-81a4-580df9c82a3b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:33.507433 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 524/1070] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:41:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:33.513513 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8235331-4f08-42a5-81a4-580df9c82a3b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:33.549943 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 547/1071] 10.222.0.15 () {60 vars in 1144 bytes} [Fri May 27 19:41:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 19:41:33.557327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad32d-bb20-4e90-aac9-352f1ab7e8d2 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:33.557632 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad32d-bb20-4e90-aac9-352f1ab7e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:33.557979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad32d-bb20-4e90-aac9-352f1ab7e8d2 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:33.560911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 548/1072] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:33.568372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055c1f9-8206-43a1-bf84-f59f0adcfa6b None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:33.568826 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055c1f9-8206-43a1-bf84-f59f0adcfa6b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:33.569736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055c1f9-8206-43a1-bf84-f59f0adcfa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:33.592411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:33.595670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e055c1f9-8206-43a1-bf84-f59f0adcfa6b None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:33.597098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e055c1f9-8206-43a1-bf84-f59f0adcfa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:33.648830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8235331-4f08-42a5-81a4-580df9c82a3b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:33.718322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 549/1073] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:33.718575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77296b-d98f-4aeb-b8fe-d6abcc65f776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:33.719578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77296b-d98f-4aeb-b8fe-d6abcc65f776 None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:33.720081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77296b-d98f-4aeb-b8fe-d6abcc65f776 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:33.720582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77296b-d98f-4aeb-b8fe-d6abcc65f776 None admin] PATH_INFO: `/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/105353b6b1a941ac81df7ad35567ba7c/roles/3b05f783f43c417193b4c5198a955e79` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:33.724662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77296b-d98f-4aeb-b8fe-d6abcc65f776 None admin] RBAC: Authorizing `identity:create_grant(project_id=400421f9ccc6478783fa6bbc822b0687, user_id=105353b6b1a941ac81df7ad35567ba7c, role_id=3b05f783f43c417193b4c5198a955e79)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:33.727427 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77296b-d98f-4aeb-b8fe-d6abcc65f776 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:33.750260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055c1f9-8206-43a1-bf84-f59f0adcfa6b None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:33.841404 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 525/1074] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:41:33 2022] PUT /identity/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/105353b6b1a941ac81df7ad35567ba7c/roles/3b05f783f43c417193b4c5198a955e79 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 19:41:33.841775 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:33.860321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055c1f9-8206-43a1-bf84-f59f0adcfa6b None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:33.905724 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d5c71-bf9c-4ce4-8f01-68a40aef5ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:33.907032 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d5c71-bf9c-4ce4-8f01-68a40aef5ace None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:33.907540 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d5c71-bf9c-4ce4-8f01-68a40aef5ace None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:33.908036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d5c71-bf9c-4ce4-8f01-68a40aef5ace None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:33.921879 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d5c71-bf9c-4ce4-8f01-68a40aef5ace None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-0f3d5c71-bf9c-4ce4-8f01-68a40aef5ace None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:41:33.931614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:33.932653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:33.933501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:33.933501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:33.933501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:33.933501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:33.933501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:41:33.933501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:41:33.933501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:41:33.933501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:41:33.933501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:41:33.933501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:41:33.933501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:41:33.933501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:33.938523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 550/1075] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:41:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:33.943503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77296b-d98f-4aeb-b8fe-d6abcc65f776 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:34.064008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77296b-d98f-4aeb-b8fe-d6abcc65f776 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:34.087012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:34.102215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c00777-7d9a-4a46-b13d-6202e1a44ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:34.103114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c00777-7d9a-4a46-b13d-6202e1a44ee2 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:34.103405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c00777-7d9a-4a46-b13d-6202e1a44ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:34.103685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c00777-7d9a-4a46-b13d-6202e1a44ee2 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:34.104446 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c00777-7d9a-4a46-b13d-6202e1a44ee2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:34.104758 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c00777-7d9a-4a46-b13d-6202e1a44ee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:34.106196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c00777-7d9a-4a46-b13d-6202e1a44ee2 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:34.116014 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 526/1076] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:41:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:34.124417 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d5c71-bf9c-4ce4-8f01-68a40aef5ace None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:34.284360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d5c71-bf9c-4ce4-8f01-68a40aef5ace None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:34.339529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe0127-efa5-4800-9dbd-811a02fd0ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:34.341025 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe0127-efa5-4800-9dbd-811a02fd0ba6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:34.341451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe0127-efa5-4800-9dbd-811a02fd0ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:34.341891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe0127-efa5-4800-9dbd-811a02fd0ba6 None admin] PATH_INFO: `/v3/users/9087de298b144438b410a4456aea87d9` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:34.343710 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe0127-efa5-4800-9dbd-811a02fd0ba6 None admin] RBAC: Authorizing `identity:get_user(user_id=9087de298b144438b410a4456aea87d9)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:34.346025 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe0127-efa5-4800-9dbd-811a02fd0ba6 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:34.353306 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 551/1077] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:41:34 2022] GET /identity/v3/users/9087de298b144438b410a4456aea87d9 => generated 285 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:34.355622 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c00777-7d9a-4a46-b13d-6202e1a44ee2 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:34.467365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c00777-7d9a-4a46-b13d-6202e1a44ee2 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:34.511466 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a23bc3-d0e6-4235-a43f-a98f57a3d71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:34.512333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a23bc3-d0e6-4235-a43f-a98f57a3d71f None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:34.512619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a23bc3-d0e6-4235-a43f-a98f57a3d71f None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:34.512896 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a23bc3-d0e6-4235-a43f-a98f57a3d71f None admin] PATH_INFO: `/v3/projects/9331c123ea0743138332c3254211f6e1` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:34.514105 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a23bc3-d0e6-4235-a43f-a98f57a3d71f None admin] RBAC: Authorizing `identity:get_project(project_id=9331c123ea0743138332c3254211f6e1)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:34.515588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a23bc3-d0e6-4235-a43f-a98f57a3d71f None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:34.525178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 527/1078] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:41:34 2022] GET /identity/v3/projects/9331c123ea0743138332c3254211f6e1 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:34.526123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe0127-efa5-4800-9dbd-811a02fd0ba6 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:34.544805 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:34.638297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe0127-efa5-4800-9dbd-811a02fd0ba6 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:34.676055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b18557-fffc-4697-b7dd-cba883a34b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:34.676955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b18557-fffc-4697-b7dd-cba883a34b11 None admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:34.677241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b18557-fffc-4697-b7dd-cba883a34b11 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:34.677714 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b18557-fffc-4697-b7dd-cba883a34b11 None admin] PATH_INFO: `/v3/projects/9331c123ea0743138332c3254211f6e1/users/9087de298b144438b410a4456aea87d9/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:34.679785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b18557-fffc-4697-b7dd-cba883a34b11 None admin] RBAC: Authorizing `identity:create_grant(project_id=9331c123ea0743138332c3254211f6e1, user_id=9087de298b144438b410a4456aea87d9, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:34.681240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b18557-fffc-4697-b7dd-cba883a34b11 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:34.778372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 552/1079] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:41:34 2022] PUT /identity/v3/projects/9331c123ea0743138332c3254211f6e1/users/9087de298b144438b410a4456aea87d9/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 19:41:35.804715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be1d4c-6075-4bf6-8063-6cc17f548bb1 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:35.805471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be1d4c-6075-4bf6-8063-6cc17f548bb1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:35.805471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be1d4c-6075-4bf6-8063-6cc17f548bb1 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:35.806672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 528/1080] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:41:35.812360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780601d-61e6-47a3-bc21-2197e6696cda None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:35.812985 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780601d-61e6-47a3-bc21-2197e6696cda None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:35.812985 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780601d-61e6-47a3-bc21-2197e6696cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:35.830438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-d780601d-61e6-47a3-bc21-2197e6696cda None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:35.831608 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d780601d-61e6-47a3-bc21-2197e6696cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:35.909278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 553/1081] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:35.932109 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be1d4c-6075-4bf6-8063-6cc17f548bb1 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:35.991676 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:36.049447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be1d4c-6075-4bf6-8063-6cc17f548bb1 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:36.088961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299abca3-aa28-4453-9698-de2d44403314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:36.089531 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299abca3-aa28-4453-9698-de2d44403314 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:36.089922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299abca3-aa28-4453-9698-de2d44403314 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:36.090208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299abca3-aa28-4453-9698-de2d44403314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:36.133094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab6153-e7d1-4feb-b832-09558d6d32cc None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:36.133538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab6153-e7d1-4feb-b832-09558d6d32cc None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:36.133956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab6153-e7d1-4feb-b832-09558d6d32cc None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:36.135981 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 554/1082] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:41:36.142194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d74bf-54da-4fc8-99c6-7dd219a9cead None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:36.142705 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d74bf-54da-4fc8-99c6-7dd219a9cead None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:36.143136 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d74bf-54da-4fc8-99c6-7dd219a9cead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:36.150599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:36.164947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-fc5d74bf-54da-4fc8-99c6-7dd219a9cead None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:36.166606 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-fc5d74bf-54da-4fc8-99c6-7dd219a9cead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:36.169629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299abca3-aa28-4453-9698-de2d44403314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:36.171460 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299abca3-aa28-4453-9698-de2d44403314 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:36.228284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:36.259471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 555/1083] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:36.282721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d74bf-54da-4fc8-99c6-7dd219a9cead None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:36.286395 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 529/1084] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:41:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:41:36.293108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299abca3-aa28-4453-9698-de2d44403314 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:36.410310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d74bf-54da-4fc8-99c6-7dd219a9cead None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:36.410538 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299abca3-aa28-4453-9698-de2d44403314 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:36.451570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c999d-0698-440e-968a-e56d9f2b47cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:36.452801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c999d-0698-440e-968a-e56d9f2b47cc None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:36.453326 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c999d-0698-440e-968a-e56d9f2b47cc None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:36.453751 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c999d-0698-440e-968a-e56d9f2b47cc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:36.454842 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fe70a-1ff1-414b-ab8a-a64cea0d4b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:36.455640 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fe70a-1ff1-414b-ab8a-a64cea0d4b2e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:36.455927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fe70a-1ff1-414b-ab8a-a64cea0d4b2e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:36.456212 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fe70a-1ff1-414b-ab8a-a64cea0d4b2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:36.458276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:36.466967 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fe70a-1ff1-414b-ab8a-a64cea0d4b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:36.468429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fe70a-1ff1-414b-ab8a-a64cea0d4b2e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:36.470538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c999d-0698-440e-968a-e56d9f2b47cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-042c999d-0698-440e-968a-e56d9f2b47cc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:41:36.485835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:36.486813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:36.487696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:36.487696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:36.487696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:36.487696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:36.487696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:41:36.487696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:41:36.487696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:41:36.487696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:41:36.487696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:41:36.487696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:41:36.487696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 19:41:36.487696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:36.488381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 556/1085] 10.222.0.15 () {56 vars in 1120 bytes} [Fri May 27 19:41:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:36.491753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-e48fe70a-1ff1-414b-ab8a-a64cea0d4b2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:36.491753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:36.491753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:36.491753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:36.491753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:36.491753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:36.491753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:36.491753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:36.491753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:36.491753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:36.491753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:36.491753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:36.491753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:41:36.491753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:41:36.491753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:36.493161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:36.494672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:41:36.494672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:41:36.494672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:36.494672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:36.494672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 530/1086] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:36.495153 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c999d-0698-440e-968a-e56d9f2b47cc None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:36.499431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fe70a-1ff1-414b-ab8a-a64cea0d4b2e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:36.502581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:36.620810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fe70a-1ff1-414b-ab8a-a64cea0d4b2e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:36.641259 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c999d-0698-440e-968a-e56d9f2b47cc None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:36.659806 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a7d9e-26fc-47c7-bc90-84dd436dc850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:36.660534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a7d9e-26fc-47c7-bc90-84dd436dc850 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:36.660763 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a7d9e-26fc-47c7-bc90-84dd436dc850 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:36.661045 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a7d9e-26fc-47c7-bc90-84dd436dc850 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:36.662389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a7d9e-26fc-47c7-bc90-84dd436dc850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:36.662709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a7d9e-26fc-47c7-bc90-84dd436dc850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:36.664124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a7d9e-26fc-47c7-bc90-84dd436dc850 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:36.686372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 531/1087] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:36.705966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cd98d-3b7e-4c55-9a56-b59ac80fc3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:36.706978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cd98d-3b7e-4c55-9a56-b59ac80fc3b2 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:36.711903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cd98d-3b7e-4c55-9a56-b59ac80fc3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:36.711903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cd98d-3b7e-4c55-9a56-b59ac80fc3b2 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:36.711903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cd98d-3b7e-4c55-9a56-b59ac80fc3b2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:36.711903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cd98d-3b7e-4c55-9a56-b59ac80fc3b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:36.712369 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cd98d-3b7e-4c55-9a56-b59ac80fc3b2 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:36.731939 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 557/1088] 10.222.0.15 () {56 vars in 1115 bytes} [Fri May 27 19:41:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:36.733866 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a7d9e-26fc-47c7-bc90-84dd436dc850 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:36.811840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:36.862836 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a7d9e-26fc-47c7-bc90-84dd436dc850 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:36.900278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a562139b-57a0-43e5-82d7-c31df62d8e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:36.901088 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562139b-57a0-43e5-82d7-c31df62d8e57 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:36.901378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562139b-57a0-43e5-82d7-c31df62d8e57 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:36.901659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562139b-57a0-43e5-82d7-c31df62d8e57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:36.913892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562139b-57a0-43e5-82d7-c31df62d8e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:36.915303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a562139b-57a0-43e5-82d7-c31df62d8e57 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:36.933769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-a562139b-57a0-43e5-82d7-c31df62d8e57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:36.933769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:36.933769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:36.933769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:36.933769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:36.933769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:36.933769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:36.933769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:36.933769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:36.933769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:36.933769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:36.933769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:36.933769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:41:36.933769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:41:36.933769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:36.934774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:36.935687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:41:36.935687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:41:36.935687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:36.935687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:36.935687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 532/1089] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:36.941469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cd98d-3b7e-4c55-9a56-b59ac80fc3b2 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:37.006106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:37.009785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d3831-1098-4bc1-a573-4dfec414d986 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:37.010284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d3831-1098-4bc1-a573-4dfec414d986 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:37.010750 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d3831-1098-4bc1-a573-4dfec414d986 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:37.013126 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 533/1090] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:37.018719 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c32f7-4e92-422b-9092-a8be991ea08e None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:37.019011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c32f7-4e92-422b-9092-a8be991ea08e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:37.019290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c32f7-4e92-422b-9092-a8be991ea08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:37.039991 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-199c32f7-4e92-422b-9092-a8be991ea08e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:37.041453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-199c32f7-4e92-422b-9092-a8be991ea08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:37.063708 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cd98d-3b7e-4c55-9a56-b59ac80fc3b2 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:37.102998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c246a8d-fc21-4ed1-aa90-8b7cdf70c283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:37.103669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c246a8d-fc21-4ed1-aa90-8b7cdf70c283 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:37.103962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c246a8d-fc21-4ed1-aa90-8b7cdf70c283 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:37.104254 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c246a8d-fc21-4ed1-aa90-8b7cdf70c283 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:37.104974 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c246a8d-fc21-4ed1-aa90-8b7cdf70c283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:37.105289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c246a8d-fc21-4ed1-aa90-8b7cdf70c283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:37.106700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c246a8d-fc21-4ed1-aa90-8b7cdf70c283 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:37.112556 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 534/1091] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 19:41:37.123823 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 558/1092] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:37.125036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c32f7-4e92-422b-9092-a8be991ea08e None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:37.137048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c246a8d-fc21-4ed1-aa90-8b7cdf70c283 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:37.174934 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:37.232778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c32f7-4e92-422b-9092-a8be991ea08e None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:37.241211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c246a8d-fc21-4ed1-aa90-8b7cdf70c283 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:37.259011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:37.269348 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59603c57-4028-4068-94d5-e1a5d8e43f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:37.270150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59603c57-4028-4068-94d5-e1a5d8e43f03 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:37.270467 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59603c57-4028-4068-94d5-e1a5d8e43f03 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:37.270748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59603c57-4028-4068-94d5-e1a5d8e43f03 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:37.276613 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7d60e-96ee-403d-9906-35bd6fb417f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:37.277426 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7d60e-96ee-403d-9906-35bd6fb417f5 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:37.277714 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7d60e-96ee-403d-9906-35bd6fb417f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:37.277995 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7d60e-96ee-403d-9906-35bd6fb417f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:37.278632 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59603c57-4028-4068-94d5-e1a5d8e43f03 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:37.280163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59603c57-4028-4068-94d5-e1a5d8e43f03 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:37.289409 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7d60e-96ee-403d-9906-35bd6fb417f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-59603c57-4028-4068-94d5-e1a5d8e43f03 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:41:37.295445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:37.296997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:37.298334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:37.298334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:37.298334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:41:37.298334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:41:37.298334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:41:37.298334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:41:37.298334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:41:37.298334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:41:37.298334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 19:41:37.298334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:37.298334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 535/1093] 10.222.0.15 () {56 vars in 1093 bytes} [Fri May 27 19:41:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-7be7d60e-96ee-403d-9906-35bd6fb417f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:41:37.300009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:37.301703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:37.303837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:37.303837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:37.303837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:37.303837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:37.303837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:41:37.303837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:41:37.303837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:41:37.303837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:41:37.303837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:41:37.303837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:41:37.303837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:41:37.303837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:37.303837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 559/1094] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:41:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:37.307387 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59603c57-4028-4068-94d5-e1a5d8e43f03 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:37.308061 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7d60e-96ee-403d-9906-35bd6fb417f5 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:37.412323 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59603c57-4028-4068-94d5-e1a5d8e43f03 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:37.414714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:37.416781 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7d60e-96ee-403d-9906-35bd6fb417f5 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:37.450803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92948a5e-5033-463c-81b4-9acf8876f48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:37.451571 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948a5e-5033-463c-81b4-9acf8876f48c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:37.451936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948a5e-5033-463c-81b4-9acf8876f48c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:37.452283 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92948a5e-5033-463c-81b4-9acf8876f48c None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:37.453346 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92948a5e-5033-463c-81b4-9acf8876f48c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:37.453452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808de51a-2d6b-48f5-8dd9-fbb4d1f1a7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:37.453767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92948a5e-5033-463c-81b4-9acf8876f48c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:37.454009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808de51a-2d6b-48f5-8dd9-fbb4d1f1a7f4 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:37.454293 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808de51a-2d6b-48f5-8dd9-fbb4d1f1a7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:37.454600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808de51a-2d6b-48f5-8dd9-fbb4d1f1a7f4 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:37.455349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808de51a-2d6b-48f5-8dd9-fbb4d1f1a7f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:37.455474 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92948a5e-5033-463c-81b4-9acf8876f48c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:37.455656 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808de51a-2d6b-48f5-8dd9-fbb4d1f1a7f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:37.457004 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808de51a-2d6b-48f5-8dd9-fbb4d1f1a7f4 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:37.469335 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 560/1095] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:41:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:37.477184 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808de51a-2d6b-48f5-8dd9-fbb4d1f1a7f4 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:37.482394 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 536/1096] 10.222.0.15 () {56 vars in 1133 bytes} [Fri May 27 19:41:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:37.484286 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92948a5e-5033-463c-81b4-9acf8876f48c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:37.519994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:37.582485 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808de51a-2d6b-48f5-8dd9-fbb4d1f1a7f4 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:37.586763 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92948a5e-5033-463c-81b4-9acf8876f48c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:37.617250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223bbbc-b6e2-4b17-bc9b-81cfcec22c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:37.618139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223bbbc-b6e2-4b17-bc9b-81cfcec22c65 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:37.618454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223bbbc-b6e2-4b17-bc9b-81cfcec22c65 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:37.618740 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223bbbc-b6e2-4b17-bc9b-81cfcec22c65 None admin] PATH_INFO: `/v3/users/9087de298b144438b410a4456aea87d9` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:37.619948 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223bbbc-b6e2-4b17-bc9b-81cfcec22c65 None admin] RBAC: Authorizing `identity:get_user(user_id=9087de298b144438b410a4456aea87d9)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:37.621403 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223bbbc-b6e2-4b17-bc9b-81cfcec22c65 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:37.621560 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e14cc-2602-482b-b143-ca7b7e197166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:37.622115 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e14cc-2602-482b-b143-ca7b7e197166 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:37.622430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e14cc-2602-482b-b143-ca7b7e197166 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:37.622744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e14cc-2602-482b-b143-ca7b7e197166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:37.627989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 561/1097] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:41:37 2022] GET /identity/v3/users/9087de298b144438b410a4456aea87d9 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:37.629012 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223bbbc-b6e2-4b17-bc9b-81cfcec22c65 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:37.653901 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:37.693441 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e14cc-2602-482b-b143-ca7b7e197166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:37.694946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e14cc-2602-482b-b143-ca7b7e197166 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:37.735407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223bbbc-b6e2-4b17-bc9b-81cfcec22c65 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:37.775026 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:37.805128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85703074-7caf-4bb2-89e0-f76215c49b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:37.805938 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85703074-7caf-4bb2-89e0-f76215c49b3b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:37.806410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85703074-7caf-4bb2-89e0-f76215c49b3b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:37.806798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85703074-7caf-4bb2-89e0-f76215c49b3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:37.839533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 537/1098] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:41:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 19:41:37.845177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e14cc-2602-482b-b143-ca7b7e197166 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:37.882024 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85703074-7caf-4bb2-89e0-f76215c49b3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:37.883530 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85703074-7caf-4bb2-89e0-f76215c49b3b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:37.913327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:37.953960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e14cc-2602-482b-b143-ca7b7e197166 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:37.991034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cdd47-65a3-4cd4-8bce-1f74c2dfcd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:37.996617 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 562/1099] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:41:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:41:37.997082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cdd47-65a3-4cd4-8bce-1f74c2dfcd8b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:37.997082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cdd47-65a3-4cd4-8bce-1f74c2dfcd8b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:37.997082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cdd47-65a3-4cd4-8bce-1f74c2dfcd8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:37.997638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85703074-7caf-4bb2-89e0-f76215c49b3b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:38.004187 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cdd47-65a3-4cd4-8bce-1f74c2dfcd8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:38.006182 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cdd47-65a3-4cd4-8bce-1f74c2dfcd8b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:38.007191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:38.025321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-fc5cdd47-65a3-4cd4-8bce-1f74c2dfcd8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:38.025321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:38.025321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:38.025321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:38.025321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:38.025321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:38.025321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:38.025321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:38.025321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:38.025321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:38.025321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:38.025321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:38.025321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:41:38.025321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:41:38.025321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:38.026898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:38.028080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:41:38.028080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:41:38.028080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:41:38.028080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:38.028080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 538/1100] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:41:38.032091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cdd47-65a3-4cd4-8bce-1f74c2dfcd8b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:38.117101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85703074-7caf-4bb2-89e0-f76215c49b3b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:38.140087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cdd47-65a3-4cd4-8bce-1f74c2dfcd8b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:38.154723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:38.159746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d4215-2305-4a36-89eb-43eb8e420617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:38.160602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d4215-2305-4a36-89eb-43eb8e420617 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:38.160964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d4215-2305-4a36-89eb-43eb8e420617 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:38.161244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d4215-2305-4a36-89eb-43eb8e420617 None admin] PATH_INFO: `/v3/projects/9331c123ea0743138332c3254211f6e1` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:38.169000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d4215-2305-4a36-89eb-43eb8e420617 None admin] RBAC: Authorizing `identity:get_project(project_id=9331c123ea0743138332c3254211f6e1)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:38.169000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d4215-2305-4a36-89eb-43eb8e420617 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:38.169000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 563/1101] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:41:37 2022] GET /identity/v3/projects/9331c123ea0743138332c3254211f6e1 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:38.171796 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d4215-2305-4a36-89eb-43eb8e420617 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:38.177686 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd72c5-5783-4c38-9a6e-16c7548aff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:38.178785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd72c5-5783-4c38-9a6e-16c7548aff48 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:38.179246 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd72c5-5783-4c38-9a6e-16c7548aff48 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:38.179703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd72c5-5783-4c38-9a6e-16c7548aff48 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:38.180948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd72c5-5783-4c38-9a6e-16c7548aff48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:38.181475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd72c5-5783-4c38-9a6e-16c7548aff48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:38.183774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd72c5-5783-4c38-9a6e-16c7548aff48 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:38.208148 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 539/1102] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:38.211317 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd72c5-5783-4c38-9a6e-16c7548aff48 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:38.260331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:38.284132 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d4215-2305-4a36-89eb-43eb8e420617 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:38.320060 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd72c5-5783-4c38-9a6e-16c7548aff48 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:38.322483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131090e-02be-4899-995e-9c94fb22c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:38.323174 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131090e-02be-4899-995e-9c94fb22c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:38.323464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131090e-02be-4899-995e-9c94fb22c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:38.323742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131090e-02be-4899-995e-9c94fb22c3b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:38.324593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131090e-02be-4899-995e-9c94fb22c3b2 None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=9331c123ea0743138332c3254211f6e1, user.id=9087de298b144438b410a4456aea87d9) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:38.324911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131090e-02be-4899-995e-9c94fb22c3b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:38.326404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131090e-02be-4899-995e-9c94fb22c3b2 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:38.332892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 564/1103] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:41:38 2022] GET /identity/v3/role_assignments?user.id=9087de298b144438b410a4456aea87d9&scope.project.id=9331c123ea0743138332c3254211f6e1&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:38.358355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fd35a-5432-46cb-a748-65a025c8dc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:38.359190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fd35a-5432-46cb-a748-65a025c8dc53 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:38.359482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fd35a-5432-46cb-a748-65a025c8dc53 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:38.359761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fd35a-5432-46cb-a748-65a025c8dc53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:38.368272 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fd35a-5432-46cb-a748-65a025c8dc53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:38.369752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fd35a-5432-46cb-a748-65a025c8dc53 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:38.385243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-017fd35a-5432-46cb-a748-65a025c8dc53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:38.385243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:38.385243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:38.385243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:38.385243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:38.385243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:38.385243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:38.385243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:38.385243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:38.385243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:38.385243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:38.385243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:38.385243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:41:38.385243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:41:38.385243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:38.386429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:38.387856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:41:38.387856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:41:38.387856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:41:38.387856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:41:38.387856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:41:38.387856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:41:38.387856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:41:38.387856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:41:38.387856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 540/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:41:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:38.392693 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131090e-02be-4899-995e-9c94fb22c3b2 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:38.501671 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131090e-02be-4899-995e-9c94fb22c3b2 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:38.538259 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082b87a-5d45-4498-b6a0-1a7b21a76552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:38.538968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082b87a-5d45-4498-b6a0-1a7b21a76552 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:38.539251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082b87a-5d45-4498-b6a0-1a7b21a76552 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:38.539530 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082b87a-5d45-4498-b6a0-1a7b21a76552 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:38.540335 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082b87a-5d45-4498-b6a0-1a7b21a76552 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:38.540649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082b87a-5d45-4498-b6a0-1a7b21a76552 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:38.542089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082b87a-5d45-4498-b6a0-1a7b21a76552 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:38.549300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:38.555620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 565/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:41:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:38.561832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fd35a-5432-46cb-a748-65a025c8dc53 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:38.598110 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:38.666481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fd35a-5432-46cb-a748-65a025c8dc53 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:38.701369 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b0366-e082-4c76-b3c7-fce0c8e73cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:38.702039 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b0366-e082-4c76-b3c7-fce0c8e73cb2 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:38.702322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b0366-e082-4c76-b3c7-fce0c8e73cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:38.702626 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b0366-e082-4c76-b3c7-fce0c8e73cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:38.707472 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b0366-e082-4c76-b3c7-fce0c8e73cb2 None admin] RBAC: Adding query filter params (role.id=3b05f783f43c417193b4c5198a955e79, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=105353b6b1a941ac81df7ad35567ba7c) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:38.707472 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b0366-e082-4c76-b3c7-fce0c8e73cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:38.707472 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b0366-e082-4c76-b3c7-fce0c8e73cb2 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:38.711963 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 541/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:41:38 2022] GET /identity/v3/role_assignments?user.id=105353b6b1a941ac81df7ad35567ba7c&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=3b05f783f43c417193b4c5198a955e79 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:40.587860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd68cb8-d58b-43ce-8e59-1270bfe7a718 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:40.588378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd68cb8-d58b-43ce-8e59-1270bfe7a718 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:40.588465 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd68cb8-d58b-43ce-8e59-1270bfe7a718 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:40.589776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 566/1107] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:40.595250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5b48b-2995-464c-bcb5-a5b2cfddf831 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:40.595663 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5b48b-2995-464c-bcb5-a5b2cfddf831 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:40.595826 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5b48b-2995-464c-bcb5-a5b2cfddf831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:40.613021 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-a4a5b48b-2995-464c-bcb5-a5b2cfddf831 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:40.614223 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-a4a5b48b-2995-464c-bcb5-a5b2cfddf831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:40.685461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 542/1108] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:40.710021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd68cb8-d58b-43ce-8e59-1270bfe7a718 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:40.813175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd68cb8-d58b-43ce-8e59-1270bfe7a718 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:40.845303 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908d048-b262-44a6-b9ea-912d0f05b713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:40.846080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908d048-b262-44a6-b9ea-912d0f05b713 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:40.846384 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908d048-b262-44a6-b9ea-912d0f05b713 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:40.846663 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908d048-b262-44a6-b9ea-912d0f05b713 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:40.847812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908d048-b262-44a6-b9ea-912d0f05b713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:40.849810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908d048-b262-44a6-b9ea-912d0f05b713 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:40.851442 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 567/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:40.857438 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5b48b-2995-464c-bcb5-a5b2cfddf831 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:40.886628 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:40.956581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5b48b-2995-464c-bcb5-a5b2cfddf831 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:40.990193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9aaa0-8f0a-4c38-9b75-450a25372ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:40.990879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9aaa0-8f0a-4c38-9b75-450a25372ecf None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:40.991162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9aaa0-8f0a-4c38-9b75-450a25372ecf None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:40.991439 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9aaa0-8f0a-4c38-9b75-450a25372ecf None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:40.992139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9aaa0-8f0a-4c38-9b75-450a25372ecf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:40.993606 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9aaa0-8f0a-4c38-9b75-450a25372ecf None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:41.095672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 543/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:41:40 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:41:43.319221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb736afe-f3c9-4f4e-9366-d0b115fdff7c None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:43.319786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb736afe-f3c9-4f4e-9366-d0b115fdff7c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:43.319892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb736afe-f3c9-4f4e-9366-d0b115fdff7c None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:43.321183 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 568/1111] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:43.326773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08c0ea-9cda-4c46-ac67-76ab45ce5766 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:43.327200 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08c0ea-9cda-4c46-ac67-76ab45ce5766 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:43.327340 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08c0ea-9cda-4c46-ac67-76ab45ce5766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:43.344451 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-cb08c0ea-9cda-4c46-ac67-76ab45ce5766 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:43.345638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cb08c0ea-9cda-4c46-ac67-76ab45ce5766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:43.411901 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 544/1112] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:43.436176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb736afe-f3c9-4f4e-9366-d0b115fdff7c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:43.503689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:43.539139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb736afe-f3c9-4f4e-9366-d0b115fdff7c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:43.573768 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695655f4-ab0f-4a86-a187-e8c04428199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:43.574582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695655f4-ab0f-4a86-a187-e8c04428199d None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:43.574925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695655f4-ab0f-4a86-a187-e8c04428199d None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:43.575203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695655f4-ab0f-4a86-a187-e8c04428199d None admin] PATH_INFO: `/v3/roles/cba310daca814298b574fb2259749836` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:43.576687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695655f4-ab0f-4a86-a187-e8c04428199d None admin] RBAC: Authorizing `identity:get_role(role_id=cba310daca814298b574fb2259749836)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:43.578082 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695655f4-ab0f-4a86-a187-e8c04428199d None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:43.579478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 569/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:41:43 2022] GET /identity/v3/roles/cba310daca814298b574fb2259749836 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:43.585345 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08c0ea-9cda-4c46-ac67-76ab45ce5766 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:43.600401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:43.687705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08c0ea-9cda-4c46-ac67-76ab45ce5766 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:43.721160 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d24182-e6ee-4364-af80-75ad75e7c1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:43.722040 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d24182-e6ee-4364-af80-75ad75e7c1e3 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:43.722326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d24182-e6ee-4364-af80-75ad75e7c1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:43.722636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d24182-e6ee-4364-af80-75ad75e7c1e3 None admin] PATH_INFO: `/v3/users/dd7d123d33da4a38b97181e7a83a8ebb` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:43.736355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d24182-e6ee-4364-af80-75ad75e7c1e3 None admin] RBAC: Authorizing `identity:get_user(user_id=dd7d123d33da4a38b97181e7a83a8ebb)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:43.737802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d24182-e6ee-4364-af80-75ad75e7c1e3 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:43.740177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 545/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:41:43 2022] GET /identity/v3/users/dd7d123d33da4a38b97181e7a83a8ebb => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:43.746092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695655f4-ab0f-4a86-a187-e8c04428199d None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:43.846433 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695655f4-ab0f-4a86-a187-e8c04428199d None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:43.880742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602baed-cf46-42b6-9fff-21151978db9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:43.881387 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602baed-cf46-42b6-9fff-21151978db9f None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:43.881676 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602baed-cf46-42b6-9fff-21151978db9f None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:43.881956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602baed-cf46-42b6-9fff-21151978db9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:43.884731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:43.950034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602baed-cf46-42b6-9fff-21151978db9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:43.951638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602baed-cf46-42b6-9fff-21151978db9f None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:44.122414 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 570/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:41:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:41:44.128341 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d24182-e6ee-4364-af80-75ad75e7c1e3 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:44.201858 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:44.231002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d24182-e6ee-4364-af80-75ad75e7c1e3 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:44.264764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1f185-f543-4ae1-a71c-74b8a3317910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:44.265623 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1f185-f543-4ae1-a71c-74b8a3317910 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:44.265905 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1f185-f543-4ae1-a71c-74b8a3317910 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:44.266181 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1f185-f543-4ae1-a71c-74b8a3317910 None admin] PATH_INFO: `/v3/projects/9331c123ea0743138332c3254211f6e1` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:44.267383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1f185-f543-4ae1-a71c-74b8a3317910 None admin] RBAC: Authorizing `identity:get_project(project_id=9331c123ea0743138332c3254211f6e1)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:44.268809 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1f185-f543-4ae1-a71c-74b8a3317910 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:44.270584 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 546/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:41:44 2022] GET /identity/v3/projects/9331c123ea0743138332c3254211f6e1 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:44.276680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602baed-cf46-42b6-9fff-21151978db9f None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:44.309423 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:44.374852 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602baed-cf46-42b6-9fff-21151978db9f None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:44.408280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd012112-0a0f-4f8b-9475-0d74d2299c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:44.408930 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd012112-0a0f-4f8b-9475-0d74d2299c50 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:44.409219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd012112-0a0f-4f8b-9475-0d74d2299c50 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:44.409500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd012112-0a0f-4f8b-9475-0d74d2299c50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:44.410331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd012112-0a0f-4f8b-9475-0d74d2299c50 None admin] RBAC: Adding query filter params (role.id=cba310daca814298b574fb2259749836, scope.project.id=9331c123ea0743138332c3254211f6e1, user.id=dd7d123d33da4a38b97181e7a83a8ebb) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:44.410678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd012112-0a0f-4f8b-9475-0d74d2299c50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:44.412677 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd012112-0a0f-4f8b-9475-0d74d2299c50 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:44.418019 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 571/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:41:44 2022] GET /identity/v3/role_assignments?user.id=dd7d123d33da4a38b97181e7a83a8ebb&scope.project.id=9331c123ea0743138332c3254211f6e1&role.id=cba310daca814298b574fb2259749836 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:46.603212 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f790f24-cb50-4ed9-b6e6-21b23c531741 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:46.603763 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f790f24-cb50-4ed9-b6e6-21b23c531741 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:46.603763 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f790f24-cb50-4ed9-b6e6-21b23c531741 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:46.605137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 547/1118] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:46.610732 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a19331-7a03-4d37-8432-f23cfd446efa None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:46.611164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a19331-7a03-4d37-8432-f23cfd446efa None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:46.611432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a19331-7a03-4d37-8432-f23cfd446efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:46.632426 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-77a19331-7a03-4d37-8432-f23cfd446efa None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:46.633979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-77a19331-7a03-4d37-8432-f23cfd446efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:46.706783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 572/1119] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:46.729702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f790f24-cb50-4ed9-b6e6-21b23c531741 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:46.832217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f790f24-cb50-4ed9-b6e6-21b23c531741 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:46.870231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532f0ee-e50a-406e-a135-9094d7d3d846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:46.871113 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532f0ee-e50a-406e-a135-9094d7d3d846 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:46.871401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532f0ee-e50a-406e-a135-9094d7d3d846 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:46.871680 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532f0ee-e50a-406e-a135-9094d7d3d846 None admin] PATH_INFO: `/v3/roles/cba310daca814298b574fb2259749836` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:46.873155 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532f0ee-e50a-406e-a135-9094d7d3d846 None admin] RBAC: Authorizing `identity:get_role(role_id=cba310daca814298b574fb2259749836)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:46.874550 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532f0ee-e50a-406e-a135-9094d7d3d846 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:46.875918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 548/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:41:46 2022] GET /identity/v3/roles/cba310daca814298b574fb2259749836 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:46.881778 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a19331-7a03-4d37-8432-f23cfd446efa None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:46.908299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:46.978298 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a19331-7a03-4d37-8432-f23cfd446efa None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:47.011487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ced2c-e51d-482b-8af5-bee8385b5944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:47.012293 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ced2c-e51d-482b-8af5-bee8385b5944 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:47.012599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ced2c-e51d-482b-8af5-bee8385b5944 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:47.012879 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ced2c-e51d-482b-8af5-bee8385b5944 None admin] PATH_INFO: `/v3/users/dd7d123d33da4a38b97181e7a83a8ebb` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:47.014103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ced2c-e51d-482b-8af5-bee8385b5944 None admin] RBAC: Authorizing `identity:get_user(user_id=dd7d123d33da4a38b97181e7a83a8ebb)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:47.015606 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ced2c-e51d-482b-8af5-bee8385b5944 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:47.017232 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 573/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:41:46 2022] GET /identity/v3/users/dd7d123d33da4a38b97181e7a83a8ebb => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:47.023518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532f0ee-e50a-406e-a135-9094d7d3d846 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:47.034329 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:47.121587 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532f0ee-e50a-406e-a135-9094d7d3d846 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:47.154540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f200c-90e7-49da-98e7-f37aed697627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:47.155383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f200c-90e7-49da-98e7-f37aed697627 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:47.155644 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f200c-90e7-49da-98e7-f37aed697627 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:47.155925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f200c-90e7-49da-98e7-f37aed697627 None admin] PATH_INFO: `/v3/projects/9331c123ea0743138332c3254211f6e1` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:47.157078 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f200c-90e7-49da-98e7-f37aed697627 None admin] RBAC: Authorizing `identity:get_project(project_id=9331c123ea0743138332c3254211f6e1)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:47.158526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f200c-90e7-49da-98e7-f37aed697627 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:47.160184 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 549/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:41:47 2022] GET /identity/v3/projects/9331c123ea0743138332c3254211f6e1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:47.166238 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ced2c-e51d-482b-8af5-bee8385b5944 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:47.258133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:47.269167 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ced2c-e51d-482b-8af5-bee8385b5944 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:47.296025 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603b85c-dd01-4a3e-bf0c-31c24150f84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:47.296905 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603b85c-dd01-4a3e-bf0c-31c24150f84f None admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:47.297192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603b85c-dd01-4a3e-bf0c-31c24150f84f None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:47.297470 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603b85c-dd01-4a3e-bf0c-31c24150f84f None admin] PATH_INFO: `/v3/projects/9331c123ea0743138332c3254211f6e1/users/dd7d123d33da4a38b97181e7a83a8ebb/roles/cba310daca814298b574fb2259749836` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:47.299679 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603b85c-dd01-4a3e-bf0c-31c24150f84f None admin] RBAC: Authorizing `identity:create_grant(project_id=9331c123ea0743138332c3254211f6e1, user_id=dd7d123d33da4a38b97181e7a83a8ebb, role_id=cba310daca814298b574fb2259749836)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:47.301121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9603b85c-dd01-4a3e-bf0c-31c24150f84f None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:47.373685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 574/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:41:47 2022] PUT /identity/v3/projects/9331c123ea0743138332c3254211f6e1/users/dd7d123d33da4a38b97181e7a83a8ebb/roles/cba310daca814298b574fb2259749836 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:41:49.555805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dad858-b5ee-4dc6-b13c-8ca651f2dfd2 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:49.556314 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dad858-b5ee-4dc6-b13c-8ca651f2dfd2 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:49.556427 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dad858-b5ee-4dc6-b13c-8ca651f2dfd2 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:49.557724 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 550/1124] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:49.562958 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c6c78-8761-4605-9baa-aba6b82cd231 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:49.563323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c6c78-8761-4605-9baa-aba6b82cd231 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:49.563538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c6c78-8761-4605-9baa-aba6b82cd231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:49.580184 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-833c6c78-8761-4605-9baa-aba6b82cd231 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:49.581376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-833c6c78-8761-4605-9baa-aba6b82cd231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:49.647210 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 575/1125] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:49.670639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dad858-b5ee-4dc6-b13c-8ca651f2dfd2 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:49.747104 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:49.771055 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dad858-b5ee-4dc6-b13c-8ca651f2dfd2 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:49.805142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98519bd2-df1e-4af4-aefd-364a246ca84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:49.805981 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98519bd2-df1e-4af4-aefd-364a246ca84a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:49.806266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98519bd2-df1e-4af4-aefd-364a246ca84a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:49.806570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98519bd2-df1e-4af4-aefd-364a246ca84a None admin] PATH_INFO: `/v3/roles/cba310daca814298b574fb2259749836` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:49.808029 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98519bd2-df1e-4af4-aefd-364a246ca84a None admin] RBAC: Authorizing `identity:get_role(role_id=cba310daca814298b574fb2259749836)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:49.809389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98519bd2-df1e-4af4-aefd-364a246ca84a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:49.810798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 551/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:41:49 2022] GET /identity/v3/roles/cba310daca814298b574fb2259749836 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:49.817353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c6c78-8761-4605-9baa-aba6b82cd231 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:49.903901 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:49.919729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c6c78-8761-4605-9baa-aba6b82cd231 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:49.955696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310f55b-2083-4192-9cee-babf0f1f922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:49.956572 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310f55b-2083-4192-9cee-babf0f1f922c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:49.956910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310f55b-2083-4192-9cee-babf0f1f922c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:49.957192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310f55b-2083-4192-9cee-babf0f1f922c None admin] PATH_INFO: `/v3/users/dd7d123d33da4a38b97181e7a83a8ebb` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:49.958435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310f55b-2083-4192-9cee-babf0f1f922c None admin] RBAC: Authorizing `identity:get_user(user_id=dd7d123d33da4a38b97181e7a83a8ebb)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:49.959889 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310f55b-2083-4192-9cee-babf0f1f922c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:49.961630 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 576/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:41:49 2022] GET /identity/v3/users/dd7d123d33da4a38b97181e7a83a8ebb => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:49.969727 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98519bd2-df1e-4af4-aefd-364a246ca84a None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:50.091804 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98519bd2-df1e-4af4-aefd-364a246ca84a None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:50.133400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a613a1-9568-4059-b7c4-953c76e98572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:50.134056 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a613a1-9568-4059-b7c4-953c76e98572 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:50.134358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a613a1-9568-4059-b7c4-953c76e98572 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:50.134656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a613a1-9568-4059-b7c4-953c76e98572 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:50.150036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:50.204237 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a613a1-9568-4059-b7c4-953c76e98572 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:50.205700 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a613a1-9568-4059-b7c4-953c76e98572 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:50.301502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 552/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:41:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:41:50.308443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310f55b-2083-4192-9cee-babf0f1f922c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:50.409900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310f55b-2083-4192-9cee-babf0f1f922c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:50.443805 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af699565-51e0-4f98-bb55-21377ec49575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:50.444654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af699565-51e0-4f98-bb55-21377ec49575 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:50.444935 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af699565-51e0-4f98-bb55-21377ec49575 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:50.445209 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af699565-51e0-4f98-bb55-21377ec49575 None admin] PATH_INFO: `/v3/projects/9331c123ea0743138332c3254211f6e1` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:50.446400 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af699565-51e0-4f98-bb55-21377ec49575 None admin] RBAC: Authorizing `identity:get_project(project_id=9331c123ea0743138332c3254211f6e1)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:50.447836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af699565-51e0-4f98-bb55-21377ec49575 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:50.449528 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 577/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:41:50 2022] GET /identity/v3/projects/9331c123ea0743138332c3254211f6e1 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:50.455814 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a613a1-9568-4059-b7c4-953c76e98572 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:50.507865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:50.560994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a613a1-9568-4059-b7c4-953c76e98572 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:50.594812 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee664f10-b48f-4920-9cc4-8d4029ba7b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:50.595463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee664f10-b48f-4920-9cc4-8d4029ba7b4d None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:50.595750 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee664f10-b48f-4920-9cc4-8d4029ba7b4d None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:50.596031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee664f10-b48f-4920-9cc4-8d4029ba7b4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:50.596861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee664f10-b48f-4920-9cc4-8d4029ba7b4d None admin] RBAC: Adding query filter params (role.id=cba310daca814298b574fb2259749836, scope.project.id=9331c123ea0743138332c3254211f6e1, user.id=dd7d123d33da4a38b97181e7a83a8ebb) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:50.597178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee664f10-b48f-4920-9cc4-8d4029ba7b4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:50.598683 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee664f10-b48f-4920-9cc4-8d4029ba7b4d None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:50.604527 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 553/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:41:50 2022] GET /identity/v3/role_assignments?user.id=dd7d123d33da4a38b97181e7a83a8ebb&scope.project.id=9331c123ea0743138332c3254211f6e1&role.id=cba310daca814298b574fb2259749836 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:52.814299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a49ed4-aac4-4730-bbb7-09e469a0e96d None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:52.814876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a49ed4-aac4-4730-bbb7-09e469a0e96d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:52.814972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a49ed4-aac4-4730-bbb7-09e469a0e96d None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:52.816253 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 578/1131] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:52.821616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b2783-a469-4c4f-a0e8-8db989188fa5 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:52.821988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b2783-a469-4c4f-a0e8-8db989188fa5 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:52.822195 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b2783-a469-4c4f-a0e8-8db989188fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:52.839075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-cf5b2783-a469-4c4f-a0e8-8db989188fa5 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:52.840398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cf5b2783-a469-4c4f-a0e8-8db989188fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:52.909895 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 554/1132] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:52.934724 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a49ed4-aac4-4730-bbb7-09e469a0e96d None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:52.959856 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:53.034088 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a49ed4-aac4-4730-bbb7-09e469a0e96d None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:53.067608 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21308b2b-0f69-4a7b-8c0c-67cab01f7e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:53.068328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21308b2b-0f69-4a7b-8c0c-67cab01f7e2f None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:53.068614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21308b2b-0f69-4a7b-8c0c-67cab01f7e2f None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:53.068895 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21308b2b-0f69-4a7b-8c0c-67cab01f7e2f None admin] PATH_INFO: `/v3/domains/default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:53.070078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21308b2b-0f69-4a7b-8c0c-67cab01f7e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:53.071545 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21308b2b-0f69-4a7b-8c0c-67cab01f7e2f None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:53.073151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 579/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:53.079032 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b2783-a469-4c4f-a0e8-8db989188fa5 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:53.118148 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:53.176923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b2783-a469-4c4f-a0e8-8db989188fa5 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:53.210144 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82a5e1-50fa-49a1-9cb1-7749249284da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:53.210970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82a5e1-50fa-49a1-9cb1-7749249284da None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:53.211258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82a5e1-50fa-49a1-9cb1-7749249284da None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:53.211538 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82a5e1-50fa-49a1-9cb1-7749249284da None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:53.212239 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82a5e1-50fa-49a1-9cb1-7749249284da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:53.213658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82a5e1-50fa-49a1-9cb1-7749249284da None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:53.291868 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 555/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Fri May 27 19:41:53 2022] POST /identity/v3/projects => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:41:55.525708 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be23c3-8b88-4dfe-95f7-963b0ea6e9eb None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:55.526241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be23c3-8b88-4dfe-95f7-963b0ea6e9eb None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:55.526241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55be23c3-8b88-4dfe-95f7-963b0ea6e9eb None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:55.527647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 580/1135] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:55.533208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec195ed-178d-415a-926b-c31e9fd71f9a None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:55.533701 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec195ed-178d-415a-926b-c31e9fd71f9a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:55.533803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec195ed-178d-415a-926b-c31e9fd71f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:55.552025 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-4ec195ed-178d-415a-926b-c31e9fd71f9a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:55.553244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4ec195ed-178d-415a-926b-c31e9fd71f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:55.624119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 556/1136] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:55.650055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be23c3-8b88-4dfe-95f7-963b0ea6e9eb None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:55.740611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:55.750643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55be23c3-8b88-4dfe-95f7-963b0ea6e9eb None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:55.786245 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2c883-1501-454e-96e6-a7d945e6b5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:55.787068 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2c883-1501-454e-96e6-a7d945e6b5a3 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:55.787356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2c883-1501-454e-96e6-a7d945e6b5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:55.787634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2c883-1501-454e-96e6-a7d945e6b5a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:55.788807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2c883-1501-454e-96e6-a7d945e6b5a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:55.790249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2c883-1501-454e-96e6-a7d945e6b5a3 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:55.791933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 581/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:41:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:55.798004 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec195ed-178d-415a-926b-c31e9fd71f9a None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:55.818988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:55.896599 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec195ed-178d-415a-926b-c31e9fd71f9a None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:55.929728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d934e4-c7e7-4905-80b5-a1fac8bca16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:55.930418 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d934e4-c7e7-4905-80b5-a1fac8bca16a None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:55.930707 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d934e4-c7e7-4905-80b5-a1fac8bca16a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:55.930986 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d934e4-c7e7-4905-80b5-a1fac8bca16a None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:55.931689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d934e4-c7e7-4905-80b5-a1fac8bca16a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:55.933110 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d934e4-c7e7-4905-80b5-a1fac8bca16a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:56.061145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 557/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:41:55 2022] POST /identity/v3/users => generated 286 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:41:58.301102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd38e-b752-417f-a250-542abec94b27 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:58.301649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd38e-b752-417f-a250-542abec94b27 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:58.301649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd38e-b752-417f-a250-542abec94b27 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:58.303128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 582/1139] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:41:58.308436 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf160869-87f4-447c-871b-af66bc5e649a None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:58.308861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf160869-87f4-447c-871b-af66bc5e649a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:58.309012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf160869-87f4-447c-871b-af66bc5e649a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:58.326164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-cf160869-87f4-447c-871b-af66bc5e649a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:41:58.327395 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cf160869-87f4-447c-871b-af66bc5e649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:41:58.397084 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 558/1140] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:41:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:41:58.420959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcd38e-b752-417f-a250-542abec94b27 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:58.520835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcd38e-b752-417f-a250-542abec94b27 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:58.555772 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59e693-81f0-4918-bb79-2353f8397dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:58.556486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e693-81f0-4918-bb79-2353f8397dc7 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:58.556770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e693-81f0-4918-bb79-2353f8397dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:58.557046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e693-81f0-4918-bb79-2353f8397dc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:58.566993 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59e693-81f0-4918-bb79-2353f8397dc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-fa59e693-81f0-4918-bb79-2353f8397dc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:41:58.574486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:41:58.575669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:41:58.576711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:41:58.576711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:41:58.576711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:41:58.576711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:41:58.576711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:41:58.576711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:41:58.576711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:41:58.576711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:41:58.576711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:41:58.576711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:41:58.576711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:41:58.576711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:41:58.576711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 583/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:41:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:41:58.582414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf160869-87f4-447c-871b-af66bc5e649a None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:58.590506 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:58.683773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf160869-87f4-447c-871b-af66bc5e649a None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:58.718524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc227fa9-064e-4e59-a5d1-a71ad8ae2ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:58.719190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227fa9-064e-4e59-a5d1-a71ad8ae2ecf None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:58.719473 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227fa9-064e-4e59-a5d1-a71ad8ae2ecf None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:58.719749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227fa9-064e-4e59-a5d1-a71ad8ae2ecf None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:58.720576 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc227fa9-064e-4e59-a5d1-a71ad8ae2ecf None admin] RBAC: Adding query filter params (name=admin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:58.720879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc227fa9-064e-4e59-a5d1-a71ad8ae2ecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:58.722289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc227fa9-064e-4e59-a5d1-a71ad8ae2ecf None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:58.730489 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 559/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:41:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:58.736539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59e693-81f0-4918-bb79-2353f8397dc7 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:58.756439 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:58.837872 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59e693-81f0-4918-bb79-2353f8397dc7 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:58.872161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b00d71-01c3-41da-9cc2-23dc6d6ced38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:58.873110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b00d71-01c3-41da-9cc2-23dc6d6ced38 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:58.873396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b00d71-01c3-41da-9cc2-23dc6d6ced38 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:58.873673 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b00d71-01c3-41da-9cc2-23dc6d6ced38 None admin] PATH_INFO: `/v3/users/3fb54f1dc7564e408c9e5ae7645af3fa` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:58.888158 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b00d71-01c3-41da-9cc2-23dc6d6ced38 None admin] RBAC: Authorizing `identity:get_user(user_id=3fb54f1dc7564e408c9e5ae7645af3fa)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:58.889621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b00d71-01c3-41da-9cc2-23dc6d6ced38 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:58.891359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 584/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:41:58 2022] GET /identity/v3/users/3fb54f1dc7564e408c9e5ae7645af3fa => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:41:58.898031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc227fa9-064e-4e59-a5d1-a71ad8ae2ecf None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:58.967012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:58.999366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc227fa9-064e-4e59-a5d1-a71ad8ae2ecf None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:59.034064 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45b29f-928a-4514-8368-7a4edfe7f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:59.034782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45b29f-928a-4514-8368-7a4edfe7f295 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:59.035078 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45b29f-928a-4514-8368-7a4edfe7f295 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:59.035358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45b29f-928a-4514-8368-7a4edfe7f295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:59.110765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45b29f-928a-4514-8368-7a4edfe7f295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:59.112124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45b29f-928a-4514-8368-7a4edfe7f295 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:59.180042 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:59.214128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 560/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:41:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:41:59.219474 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b00d71-01c3-41da-9cc2-23dc6d6ced38 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:59.298548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:41:59.320820 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b00d71-01c3-41da-9cc2-23dc6d6ced38 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:59.352888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba74120-9e99-4625-8591-3785e3ae3194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:59.353738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba74120-9e99-4625-8591-3785e3ae3194 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:59.354020 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba74120-9e99-4625-8591-3785e3ae3194 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:59.354296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba74120-9e99-4625-8591-3785e3ae3194 None admin] PATH_INFO: `/v3/projects/769b351fb26342ef90a4951f349761c8` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:59.355488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba74120-9e99-4625-8591-3785e3ae3194 None admin] RBAC: Authorizing `identity:get_project(project_id=769b351fb26342ef90a4951f349761c8)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:59.356912 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba74120-9e99-4625-8591-3785e3ae3194 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:59.358620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 585/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:41:59 2022] GET /identity/v3/projects/769b351fb26342ef90a4951f349761c8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:41:59.365350 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45b29f-928a-4514-8368-7a4edfe7f295 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:41:59.461021 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45b29f-928a-4514-8368-7a4edfe7f295 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:41:59.496181 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73abe90-10e2-422f-baab-b513d2a14a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:41:59.496840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73abe90-10e2-422f-baab-b513d2a14a57 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:41:59.497128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73abe90-10e2-422f-baab-b513d2a14a57 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:41:59.497407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73abe90-10e2-422f-baab-b513d2a14a57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:41:59.498228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73abe90-10e2-422f-baab-b513d2a14a57 None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=769b351fb26342ef90a4951f349761c8, user.id=3fb54f1dc7564e408c9e5ae7645af3fa) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:41:59.498594 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73abe90-10e2-422f-baab-b513d2a14a57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:41:59.500049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73abe90-10e2-422f-baab-b513d2a14a57 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:41:59.505456 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 561/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:41:59 2022] GET /identity/v3/role_assignments?user.id=3fb54f1dc7564e408c9e5ae7645af3fa&scope.project.id=769b351fb26342ef90a4951f349761c8&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:01.675749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade2114-1701-40c6-9bfe-6c88d234d4b5 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:01.676340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade2114-1701-40c6-9bfe-6c88d234d4b5 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:01.676340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade2114-1701-40c6-9bfe-6c88d234d4b5 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:01.677662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 586/1147] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:42:01.683008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8acfe5-cee4-4331-bc59-242aa478988a None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:01.683451 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8acfe5-cee4-4331-bc59-242aa478988a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:01.683579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8acfe5-cee4-4331-bc59-242aa478988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:01.700579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-8a8acfe5-cee4-4331-bc59-242aa478988a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:42:01.701768 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-8a8acfe5-cee4-4331-bc59-242aa478988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:42:01.727379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:01.767302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 562/1148] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:42:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:42:01.790204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade2114-1701-40c6-9bfe-6c88d234d4b5 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:01.890080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade2114-1701-40c6-9bfe-6c88d234d4b5 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:01.923656 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fa304-5858-437c-9885-31bc875a2257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:01.924446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fa304-5858-437c-9885-31bc875a2257 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:01.924734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fa304-5858-437c-9885-31bc875a2257 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:01.925065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fa304-5858-437c-9885-31bc875a2257 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:01.935148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fa304-5858-437c-9885-31bc875a2257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-f73fa304-5858-437c-9885-31bc875a2257 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:42:01.943289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:42:01.944458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:42:01.945406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:42:01.945406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:42:01.945406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:42:01.945406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:42:01.945406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:42:01.945406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:42:01.945406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:42:01.945406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:42:01.945406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:42:01.945406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:42:01.945406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:42:01.945406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:42:01.945406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 587/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:42:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:42:01.950447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8acfe5-cee4-4331-bc59-242aa478988a None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:02.048307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8acfe5-cee4-4331-bc59-242aa478988a None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:02.082207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013afe2a-68a4-47a4-8621-6fee1b47b5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:02.082900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013afe2a-68a4-47a4-8621-6fee1b47b5f0 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:02.083188 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013afe2a-68a4-47a4-8621-6fee1b47b5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:02.083463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013afe2a-68a4-47a4-8621-6fee1b47b5f0 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:02.084211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013afe2a-68a4-47a4-8621-6fee1b47b5f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:42:02.084523 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013afe2a-68a4-47a4-8621-6fee1b47b5f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:02.085896 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013afe2a-68a4-47a4-8621-6fee1b47b5f0 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:02.093892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 563/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:42:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:02.100432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fa304-5858-437c-9885-31bc875a2257 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:02.104211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:02.198178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fa304-5858-437c-9885-31bc875a2257 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:02.231142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88a4d9-60bc-4a1c-abdc-3c4b252ef712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:02.232002 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88a4d9-60bc-4a1c-abdc-3c4b252ef712 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:02.232285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88a4d9-60bc-4a1c-abdc-3c4b252ef712 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:02.232563 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88a4d9-60bc-4a1c-abdc-3c4b252ef712 None admin] PATH_INFO: `/v3/users/3fb54f1dc7564e408c9e5ae7645af3fa` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:02.233760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88a4d9-60bc-4a1c-abdc-3c4b252ef712 None admin] RBAC: Authorizing `identity:get_user(user_id=3fb54f1dc7564e408c9e5ae7645af3fa)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:02.235228 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88a4d9-60bc-4a1c-abdc-3c4b252ef712 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:02.236876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 588/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:42:02 2022] GET /identity/v3/users/3fb54f1dc7564e408c9e5ae7645af3fa => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:02.242636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013afe2a-68a4-47a4-8621-6fee1b47b5f0 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:02.267625 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:02.339796 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013afe2a-68a4-47a4-8621-6fee1b47b5f0 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:02.372307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7cc4e-601b-4a24-8b0c-c5e42e3e57c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:02.373153 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7cc4e-601b-4a24-8b0c-c5e42e3e57c0 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:02.373442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7cc4e-601b-4a24-8b0c-c5e42e3e57c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:02.373712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7cc4e-601b-4a24-8b0c-c5e42e3e57c0 None admin] PATH_INFO: `/v3/projects/769b351fb26342ef90a4951f349761c8` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:02.374899 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7cc4e-601b-4a24-8b0c-c5e42e3e57c0 None admin] RBAC: Authorizing `identity:get_project(project_id=769b351fb26342ef90a4951f349761c8)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:02.376319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7cc4e-601b-4a24-8b0c-c5e42e3e57c0 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:02.378027 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 564/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:42:02 2022] GET /identity/v3/projects/769b351fb26342ef90a4951f349761c8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:02.384497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88a4d9-60bc-4a1c-abdc-3c4b252ef712 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:02.451524 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:02.481172 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88a4d9-60bc-4a1c-abdc-3c4b252ef712 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:02.513963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8ea76-a61a-46f6-9e0d-374e0c617d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:02.514861 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8ea76-a61a-46f6-9e0d-374e0c617d31 None admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:02.515149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8ea76-a61a-46f6-9e0d-374e0c617d31 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:02.515425 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8ea76-a61a-46f6-9e0d-374e0c617d31 None admin] PATH_INFO: `/v3/projects/769b351fb26342ef90a4951f349761c8/users/3fb54f1dc7564e408c9e5ae7645af3fa/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:02.517341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8ea76-a61a-46f6-9e0d-374e0c617d31 None admin] RBAC: Authorizing `identity:create_grant(project_id=769b351fb26342ef90a4951f349761c8, user_id=3fb54f1dc7564e408c9e5ae7645af3fa, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:02.519358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8ea76-a61a-46f6-9e0d-374e0c617d31 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:02.578364 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 589/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:42:02 2022] PUT /identity/v3/projects/769b351fb26342ef90a4951f349761c8/users/3fb54f1dc7564e408c9e5ae7645af3fa/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:42:04.730068 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34edc82-47bc-490d-b848-4117646ffe24 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:04.730638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34edc82-47bc-490d-b848-4117646ffe24 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:04.730638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34edc82-47bc-490d-b848-4117646ffe24 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:04.732013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 565/1154] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:42:04.737267 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fc094-fdcd-4df7-b645-786e9c66885c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:04.737760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fc094-fdcd-4df7-b645-786e9c66885c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:04.737928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fc094-fdcd-4df7-b645-786e9c66885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:04.754857 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-ef7fc094-fdcd-4df7-b645-786e9c66885c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:42:04.756028 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ef7fc094-fdcd-4df7-b645-786e9c66885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:42:04.820759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 590/1155] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:42:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:42:04.843727 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34edc82-47bc-490d-b848-4117646ffe24 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:04.935348 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:04.944525 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34edc82-47bc-490d-b848-4117646ffe24 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:04.977274 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3478b0e-2d95-4214-b27b-7e5f016586c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:04.978072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3478b0e-2d95-4214-b27b-7e5f016586c8 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:04.978381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3478b0e-2d95-4214-b27b-7e5f016586c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:04.978669 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3478b0e-2d95-4214-b27b-7e5f016586c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:04.989138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3478b0e-2d95-4214-b27b-7e5f016586c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-d3478b0e-2d95-4214-b27b-7e5f016586c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:42:04.996679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:42:04.997794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:42:04.998865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:42:04.998865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:42:04.998865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:42:04.998865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:42:04.998865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:42:04.998865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:42:04.998865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:42:04.998865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:42:04.998865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:42:04.998865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:42:04.998865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:42:04.998865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:42:04.998865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 566/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:42:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:42:05.004097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fc094-fdcd-4df7-b645-786e9c66885c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:05.062750 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:05.099680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fc094-fdcd-4df7-b645-786e9c66885c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:05.133335 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8feff-4046-4fda-a352-012635875b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:05.136582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8feff-4046-4fda-a352-012635875b0e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:05.136582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8feff-4046-4fda-a352-012635875b0e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:05.136582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8feff-4046-4fda-a352-012635875b0e None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:05.136582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8feff-4046-4fda-a352-012635875b0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:42:05.136582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8feff-4046-4fda-a352-012635875b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:05.137117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8feff-4046-4fda-a352-012635875b0e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:05.144853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 591/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:42:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:05.150823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3478b0e-2d95-4214-b27b-7e5f016586c8 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:05.248529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3478b0e-2d95-4214-b27b-7e5f016586c8 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:05.280795 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1355210-0cc4-44f5-b879-105ba3cd858e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:05.281668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1355210-0cc4-44f5-b879-105ba3cd858e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:05.281957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1355210-0cc4-44f5-b879-105ba3cd858e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:05.282240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1355210-0cc4-44f5-b879-105ba3cd858e None admin] PATH_INFO: `/v3/users/3fb54f1dc7564e408c9e5ae7645af3fa` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:05.283447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1355210-0cc4-44f5-b879-105ba3cd858e None admin] RBAC: Authorizing `identity:get_user(user_id=3fb54f1dc7564e408c9e5ae7645af3fa)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:05.284906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1355210-0cc4-44f5-b879-105ba3cd858e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:05.286573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 567/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:42:05 2022] GET /identity/v3/users/3fb54f1dc7564e408c9e5ae7645af3fa => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:05.292323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8feff-4046-4fda-a352-012635875b0e None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:05.390029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8feff-4046-4fda-a352-012635875b0e None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:05.412655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:05.423174 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620800de-aa91-4cb5-b520-f7d8fe5b6bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:05.423821 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620800de-aa91-4cb5-b520-f7d8fe5b6bde None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:05.428151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620800de-aa91-4cb5-b520-f7d8fe5b6bde None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:05.428151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620800de-aa91-4cb5-b520-f7d8fe5b6bde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:05.490946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620800de-aa91-4cb5-b520-f7d8fe5b6bde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:05.492401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620800de-aa91-4cb5-b520-f7d8fe5b6bde None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:05.586024 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 592/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:42:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:42:05.591865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1355210-0cc4-44f5-b879-105ba3cd858e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:05.615592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:05.691261 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1355210-0cc4-44f5-b879-105ba3cd858e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:05.723911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0434078-0438-4825-b8dd-ba4895108f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:05.724757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0434078-0438-4825-b8dd-ba4895108f65 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:05.725041 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0434078-0438-4825-b8dd-ba4895108f65 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:05.725318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0434078-0438-4825-b8dd-ba4895108f65 None admin] PATH_INFO: `/v3/projects/769b351fb26342ef90a4951f349761c8` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:05.726530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0434078-0438-4825-b8dd-ba4895108f65 None admin] RBAC: Authorizing `identity:get_project(project_id=769b351fb26342ef90a4951f349761c8)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:05.727947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0434078-0438-4825-b8dd-ba4895108f65 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:05.729632 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 568/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:42:05 2022] GET /identity/v3/projects/769b351fb26342ef90a4951f349761c8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:05.735632 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620800de-aa91-4cb5-b520-f7d8fe5b6bde None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:05.760205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:05.834914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620800de-aa91-4cb5-b520-f7d8fe5b6bde None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:05.868697 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a98bde-2596-4f34-9738-7984833effec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:05.869278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98bde-2596-4f34-9738-7984833effec None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:05.869561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98bde-2596-4f34-9738-7984833effec None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:05.869837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a98bde-2596-4f34-9738-7984833effec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:05.870689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a98bde-2596-4f34-9738-7984833effec None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=769b351fb26342ef90a4951f349761c8, user.id=3fb54f1dc7564e408c9e5ae7645af3fa) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:42:05.871001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a98bde-2596-4f34-9738-7984833effec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:05.872420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a98bde-2596-4f34-9738-7984833effec None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:05.878063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 593/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:42:05 2022] GET /identity/v3/role_assignments?user.id=3fb54f1dc7564e408c9e5ae7645af3fa&scope.project.id=769b351fb26342ef90a4951f349761c8&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:08.057842 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52622d48-371a-4438-b0d6-66ff9429628e None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:08.058430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52622d48-371a-4438-b0d6-66ff9429628e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:08.058430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52622d48-371a-4438-b0d6-66ff9429628e None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:08.059807 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 569/1162] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:42:08.065018 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f252db5-a6de-4f71-9b1a-ce9c8696ce15 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:08.065981 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f252db5-a6de-4f71-9b1a-ce9c8696ce15 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:08.066157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f252db5-a6de-4f71-9b1a-ce9c8696ce15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:08.082897 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-8f252db5-a6de-4f71-9b1a-ce9c8696ce15 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:42:08.084056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8f252db5-a6de-4f71-9b1a-ce9c8696ce15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:42:08.148579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 594/1163] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:42:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:42:08.170883 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52622d48-371a-4438-b0d6-66ff9429628e None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:08.260716 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:08.273154 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52622d48-371a-4438-b0d6-66ff9429628e None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:08.306891 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fee0d0-327a-4ee3-9373-08950bd56263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:08.307533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fee0d0-327a-4ee3-9373-08950bd56263 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:08.307822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fee0d0-327a-4ee3-9373-08950bd56263 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:08.308152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fee0d0-327a-4ee3-9373-08950bd56263 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:08.372647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fee0d0-327a-4ee3-9373-08950bd56263 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:08.374077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fee0d0-327a-4ee3-9373-08950bd56263 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:08.457477 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:08.469558 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 570/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:42:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:42:08.476300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f252db5-a6de-4f71-9b1a-ce9c8696ce15 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:08.494649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:08.572056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f252db5-a6de-4f71-9b1a-ce9c8696ce15 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:08.604988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8edf6f-823a-4424-ae49-36d7616e6819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:08.605793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8edf6f-823a-4424-ae49-36d7616e6819 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:08.606081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8edf6f-823a-4424-ae49-36d7616e6819 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:08.606385 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8edf6f-823a-4424-ae49-36d7616e6819 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:08.613467 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8edf6f-823a-4424-ae49-36d7616e6819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:08.614947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8edf6f-823a-4424-ae49-36d7616e6819 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-4b8edf6f-823a-4424-ae49-36d7616e6819 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:42:08.628634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:42:08.629797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:42:08.631123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:42:08.631123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:42:08.631123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:42:08.631123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:42:08.631123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:42:08.631123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:42:08.631123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:42:08.631123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:42:08.631123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:42:08.631123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:42:08.631123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 27 19:42:08.631123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:42:08.631123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 19:42:08.631123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:42:08.631123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 595/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Fri May 27 19:42:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:42:08.635723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fee0d0-327a-4ee3-9373-08950bd56263 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:08.731575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fee0d0-327a-4ee3-9373-08950bd56263 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:08.765067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0030155-4a50-478c-8a1a-dd87231eed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:08.765717 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0030155-4a50-478c-8a1a-dd87231eed84 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:08.766005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0030155-4a50-478c-8a1a-dd87231eed84 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:08.766288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0030155-4a50-478c-8a1a-dd87231eed84 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:08.767030 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0030155-4a50-478c-8a1a-dd87231eed84 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:42:08.767341 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0030155-4a50-478c-8a1a-dd87231eed84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:08.769248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0030155-4a50-478c-8a1a-dd87231eed84 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:08.776199 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 571/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Fri May 27 19:42:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:10.922729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0716d4b-070a-4fb7-8ff5-66a898dadfc8 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:10.923291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0716d4b-070a-4fb7-8ff5-66a898dadfc8 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:10.923291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0716d4b-070a-4fb7-8ff5-66a898dadfc8 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:10.924684 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 596/1167] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:42:10.929911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc324b2-01df-4a7d-8354-9e6288e3ad07 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:10.930288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc324b2-01df-4a7d-8354-9e6288e3ad07 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:10.930512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc324b2-01df-4a7d-8354-9e6288e3ad07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:10.947360 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-cbc324b2-01df-4a7d-8354-9e6288e3ad07 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:42:10.948533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cbc324b2-01df-4a7d-8354-9e6288e3ad07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:42:10.994141 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:11.013353 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 572/1168] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:42:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:42:11.036092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0716d4b-070a-4fb7-8ff5-66a898dadfc8 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:11.114665 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:11.136017 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0716d4b-070a-4fb7-8ff5-66a898dadfc8 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:11.168986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d213445-5e89-4742-bc8f-b3e7b695b8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:11.169637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d213445-5e89-4742-bc8f-b3e7b695b8ee None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:11.169924 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d213445-5e89-4742-bc8f-b3e7b695b8ee None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:11.170207 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d213445-5e89-4742-bc8f-b3e7b695b8ee None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:11.170986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d213445-5e89-4742-bc8f-b3e7b695b8ee None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:11.172364 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d213445-5e89-4742-bc8f-b3e7b695b8ee None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:11.243618 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 597/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Fri May 27 19:42:11 2022] POST /identity/v3/domains => generated 267 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:42:13.432168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe05849-8a7f-455a-835f-e93642fae827 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:13.432703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe05849-8a7f-455a-835f-e93642fae827 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:13.432792 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe05849-8a7f-455a-835f-e93642fae827 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:13.434118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 573/1170] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:42:13.439242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011acb5-d99e-48db-9788-6d81a6227a96 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:13.440236 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011acb5-d99e-48db-9788-6d81a6227a96 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:13.440453 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011acb5-d99e-48db-9788-6d81a6227a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:13.457260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-8011acb5-d99e-48db-9788-6d81a6227a96 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:42:13.458463 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8011acb5-d99e-48db-9788-6d81a6227a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:42:13.524193 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 598/1171] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:42:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:42:13.547949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe05849-8a7f-455a-835f-e93642fae827 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:13.646560 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe05849-8a7f-455a-835f-e93642fae827 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:13.679182 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8270c8-5d1f-4098-8334-4a8aff54e661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:13.680038 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8270c8-5d1f-4098-8334-4a8aff54e661 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:13.680327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8270c8-5d1f-4098-8334-4a8aff54e661 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:13.680608 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8270c8-5d1f-4098-8334-4a8aff54e661 None admin] PATH_INFO: `/v3/domains/3556179d023441a3ab4762fe5d5e9b4e` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:13.691275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8270c8-5d1f-4098-8334-4a8aff54e661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3556179d023441a3ab4762fe5d5e9b4e)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:13.692665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8270c8-5d1f-4098-8334-4a8aff54e661 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:13.694286 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 574/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Fri May 27 19:42:13 2022] GET /identity/v3/domains/3556179d023441a3ab4762fe5d5e9b4e => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:13.700065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011acb5-d99e-48db-9788-6d81a6227a96 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:13.762893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:13.794549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011acb5-d99e-48db-9788-6d81a6227a96 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:13.827129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee90808-62f0-4914-bcde-8a7eda5d76e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:13.827780 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee90808-62f0-4914-bcde-8a7eda5d76e4 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:13.828067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee90808-62f0-4914-bcde-8a7eda5d76e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:13.828349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee90808-62f0-4914-bcde-8a7eda5d76e4 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:13.829049 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee90808-62f0-4914-bcde-8a7eda5d76e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:13.830587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee90808-62f0-4914-bcde-8a7eda5d76e4 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:13.912065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 599/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Fri May 27 19:42:13 2022] POST /identity/v3/projects => generated 361 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:42:16.115412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab016185-27d2-45c1-961f-89104f000300 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:16.115942 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab016185-27d2-45c1-961f-89104f000300 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:16.116054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab016185-27d2-45c1-961f-89104f000300 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:16.117349 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 575/1174] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:42:16.122652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a91be-37d9-483e-89f0-d53fcf56a1bb None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:16.123055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a91be-37d9-483e-89f0-d53fcf56a1bb None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:16.123219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a91be-37d9-483e-89f0-d53fcf56a1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:16.140106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c55a91be-37d9-483e-89f0-d53fcf56a1bb None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:42:16.141278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c55a91be-37d9-483e-89f0-d53fcf56a1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:42:16.206272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 600/1175] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:42:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:42:16.230574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab016185-27d2-45c1-961f-89104f000300 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:16.274581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:16.330502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab016185-27d2-45c1-961f-89104f000300 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:16.362442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b8bc83-8e01-4d90-a538-e3e8f68eaa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:16.363288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8bc83-8e01-4d90-a538-e3e8f68eaa4d None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:16.363573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8bc83-8e01-4d90-a538-e3e8f68eaa4d None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:16.363846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b8bc83-8e01-4d90-a538-e3e8f68eaa4d None admin] PATH_INFO: `/v3/domains/3556179d023441a3ab4762fe5d5e9b4e` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:16.365019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8bc83-8e01-4d90-a538-e3e8f68eaa4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=3556179d023441a3ab4762fe5d5e9b4e)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:16.366529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b8bc83-8e01-4d90-a538-e3e8f68eaa4d None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:16.368080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 576/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Fri May 27 19:42:16 2022] GET /identity/v3/domains/3556179d023441a3ab4762fe5d5e9b4e => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:16.373753 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a91be-37d9-483e-89f0-d53fcf56a1bb None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:16.420835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:16.467827 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a91be-37d9-483e-89f0-d53fcf56a1bb None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:16.501094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e315abad-ff23-4467-a21a-37e54afb934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:16.501760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315abad-ff23-4467-a21a-37e54afb934e None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:16.502623 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315abad-ff23-4467-a21a-37e54afb934e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:16.502907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e315abad-ff23-4467-a21a-37e54afb934e None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:16.503606 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315abad-ff23-4467-a21a-37e54afb934e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:16.505028 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e315abad-ff23-4467-a21a-37e54afb934e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:16.578922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 601/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:42:16 2022] POST /identity/v3/users => generated 311 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:42:18.816277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492fea1-8c5c-45bf-98a8-379230a29bd5 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:18.816849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492fea1-8c5c-45bf-98a8-379230a29bd5 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:18.816961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492fea1-8c5c-45bf-98a8-379230a29bd5 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:18.818254 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 577/1178] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:42:18.823562 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0b0a0-2368-4062-bbe2-9eb23312d65d None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:18.823967 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0b0a0-2368-4062-bbe2-9eb23312d65d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:18.824124 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0b0a0-2368-4062-bbe2-9eb23312d65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:18.841053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c3a0b0a0-2368-4062-bbe2-9eb23312d65d None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:42:18.842232 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c3a0b0a0-2368-4062-bbe2-9eb23312d65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:42:18.907232 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 602/1179] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:42:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:42:18.930327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492fea1-8c5c-45bf-98a8-379230a29bd5 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:19.031058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492fea1-8c5c-45bf-98a8-379230a29bd5 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:19.041251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:19.063361 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19f4e0-1e60-492a-b3c4-f22855994fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:19.064666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19f4e0-1e60-492a-b3c4-f22855994fe5 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:19.064950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19f4e0-1e60-492a-b3c4-f22855994fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:19.065228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19f4e0-1e60-492a-b3c4-f22855994fe5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:19.075462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19f4e0-1e60-492a-b3c4-f22855994fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-de19f4e0-1e60-492a-b3c4-f22855994fe5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:42:19.084296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:42:19.085391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:42:19.086248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:42:19.086248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:42:19.086248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:42:19.086248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:42:19.086248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:42:19.086248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:42:19.086248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:42:19.086248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:42:19.086248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:42:19.086248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:42:19.086248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:42:19.086248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:42:19.086248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 578/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:42:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:42:19.091331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0b0a0-2368-4062-bbe2-9eb23312d65d None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:19.125351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:19.189217 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0b0a0-2368-4062-bbe2-9eb23312d65d None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:19.221963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455ad06-e1db-46f9-bed5-2ee7f0bfc3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:19.222652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455ad06-e1db-46f9-bed5-2ee7f0bfc3ae None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:19.222942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455ad06-e1db-46f9-bed5-2ee7f0bfc3ae None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:19.223223 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6455ad06-e1db-46f9-bed5-2ee7f0bfc3ae None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:19.223972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455ad06-e1db-46f9-bed5-2ee7f0bfc3ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:42:19.224284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455ad06-e1db-46f9-bed5-2ee7f0bfc3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:19.225761 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6455ad06-e1db-46f9-bed5-2ee7f0bfc3ae None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:19.233568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 603/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:42:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:19.239522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19f4e0-1e60-492a-b3c4-f22855994fe5 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:19.336755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19f4e0-1e60-492a-b3c4-f22855994fe5 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:19.368670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7cda5-6a9a-4441-8e32-6ad1abafcdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:19.369527 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7cda5-6a9a-4441-8e32-6ad1abafcdaa None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:19.369809 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7cda5-6a9a-4441-8e32-6ad1abafcdaa None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:19.370084 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7cda5-6a9a-4441-8e32-6ad1abafcdaa None admin] PATH_INFO: `/v3/users/4d337db34f7d41d6818313dde0b723c4` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:19.382666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7cda5-6a9a-4441-8e32-6ad1abafcdaa None admin] RBAC: Authorizing `identity:get_user(user_id=4d337db34f7d41d6818313dde0b723c4)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:19.384092 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7cda5-6a9a-4441-8e32-6ad1abafcdaa None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:19.385685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 579/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:42:19 2022] GET /identity/v3/users/4d337db34f7d41d6818313dde0b723c4 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:19.391331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455ad06-e1db-46f9-bed5-2ee7f0bfc3ae None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:19.486008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:19.489769 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6455ad06-e1db-46f9-bed5-2ee7f0bfc3ae None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:19.523318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0334499-82f8-43c4-9a48-478af4e38275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:19.523959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0334499-82f8-43c4-9a48-478af4e38275 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:19.524242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0334499-82f8-43c4-9a48-478af4e38275 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:19.524521 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0334499-82f8-43c4-9a48-478af4e38275 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:19.589105 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0334499-82f8-43c4-9a48-478af4e38275 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:19.590507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0334499-82f8-43c4-9a48-478af4e38275 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:19.680731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:19.685096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 604/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:42:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:42:19.691645 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7cda5-6a9a-4441-8e32-6ad1abafcdaa None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:19.718733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:19.787299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7cda5-6a9a-4441-8e32-6ad1abafcdaa None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:19.820143 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a33cd8-938b-4d7d-bb29-7cbf781291d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:19.820990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a33cd8-938b-4d7d-bb29-7cbf781291d5 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:19.821280 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a33cd8-938b-4d7d-bb29-7cbf781291d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:19.821562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a33cd8-938b-4d7d-bb29-7cbf781291d5 None admin] PATH_INFO: `/v3/projects/014cd6e58fd0401bb70a6e590e48e4ee` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:19.822769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a33cd8-938b-4d7d-bb29-7cbf781291d5 None admin] RBAC: Authorizing `identity:get_project(project_id=014cd6e58fd0401bb70a6e590e48e4ee)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:19.824207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a33cd8-938b-4d7d-bb29-7cbf781291d5 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:19.825900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 580/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:42:19 2022] GET /identity/v3/projects/014cd6e58fd0401bb70a6e590e48e4ee => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:19.832131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0334499-82f8-43c4-9a48-478af4e38275 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:19.928266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0334499-82f8-43c4-9a48-478af4e38275 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:19.960445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926fa931-87eb-4cd0-9a41-4f14b463e4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:19.961092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fa931-87eb-4cd0-9a41-4f14b463e4f1 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:19.961381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fa931-87eb-4cd0-9a41-4f14b463e4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:19.961664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926fa931-87eb-4cd0-9a41-4f14b463e4f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:19.962528 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fa931-87eb-4cd0-9a41-4f14b463e4f1 None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=014cd6e58fd0401bb70a6e590e48e4ee, user.id=4d337db34f7d41d6818313dde0b723c4) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:42:19.962847 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fa931-87eb-4cd0-9a41-4f14b463e4f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:19.964281 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926fa931-87eb-4cd0-9a41-4f14b463e4f1 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:19.969572 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 605/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:42:19 2022] GET /identity/v3/role_assignments?user.id=4d337db34f7d41d6818313dde0b723c4&scope.project.id=014cd6e58fd0401bb70a6e590e48e4ee&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:22.124882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c47718-3c0b-4f5c-9d55-771c395ec32c None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:22.125413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c47718-3c0b-4f5c-9d55-771c395ec32c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:22.125530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c47718-3c0b-4f5c-9d55-771c395ec32c None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:22.127379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 581/1186] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:42:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:42:22.132574 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b4b00-3bc6-4b43-b75c-486a6ab7fa06 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:22.133011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b4b00-3bc6-4b43-b75c-486a6ab7fa06 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:22.133146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b4b00-3bc6-4b43-b75c-486a6ab7fa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:22.150074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-ab5b4b00-3bc6-4b43-b75c-486a6ab7fa06 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:42:22.151311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ab5b4b00-3bc6-4b43-b75c-486a6ab7fa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:42:22.206086 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:22.215944 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 606/1187] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:42:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:42:22.238227 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c47718-3c0b-4f5c-9d55-771c395ec32c None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:22.341721 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:22.348222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c47718-3c0b-4f5c-9d55-771c395ec32c None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:22.381703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd461fb0-de15-45a9-9f92-21d57a8dfb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:22.382452 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd461fb0-de15-45a9-9f92-21d57a8dfb25 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:22.382742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd461fb0-de15-45a9-9f92-21d57a8dfb25 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:22.383022 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd461fb0-de15-45a9-9f92-21d57a8dfb25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:22.393295 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd461fb0-de15-45a9-9f92-21d57a8dfb25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-dd461fb0-de15-45a9-9f92-21d57a8dfb25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:42:22.400817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:42:22.401933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:42:22.403059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:42:22.403059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:42:22.403059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:42:22.403059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:42:22.403059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:42:22.403059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:42:22.403059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:42:22.403059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:42:22.403059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:42:22.403059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:42:22.403059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:42:22.403059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:42:22.403059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 582/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:42:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:42:22.408531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b4b00-3bc6-4b43-b75c-486a6ab7fa06 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:22.505040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b4b00-3bc6-4b43-b75c-486a6ab7fa06 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:22.537929 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3b338-6be8-439d-a782-86fd79357ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:22.538640 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3b338-6be8-439d-a782-86fd79357ce5 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:22.538921 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3b338-6be8-439d-a782-86fd79357ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:22.539196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3b338-6be8-439d-a782-86fd79357ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:22.539944 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3b338-6be8-439d-a782-86fd79357ce5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:42:22.540251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3b338-6be8-439d-a782-86fd79357ce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:22.541873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3b338-6be8-439d-a782-86fd79357ce5 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:22.549647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 607/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:42:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:22.555499 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd461fb0-de15-45a9-9f92-21d57a8dfb25 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:22.652732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd461fb0-de15-45a9-9f92-21d57a8dfb25 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:22.686406 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb4dc2-1be5-4aae-9e0a-e0701cd37ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:22.687255 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb4dc2-1be5-4aae-9e0a-e0701cd37ac8 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:22.687538 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb4dc2-1be5-4aae-9e0a-e0701cd37ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:22.687814 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb4dc2-1be5-4aae-9e0a-e0701cd37ac8 None admin] PATH_INFO: `/v3/users/4d337db34f7d41d6818313dde0b723c4` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:22.688998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb4dc2-1be5-4aae-9e0a-e0701cd37ac8 None admin] RBAC: Authorizing `identity:get_user(user_id=4d337db34f7d41d6818313dde0b723c4)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:22.690434 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb4dc2-1be5-4aae-9e0a-e0701cd37ac8 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:22.692026 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 583/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:42:22 2022] GET /identity/v3/users/4d337db34f7d41d6818313dde0b723c4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:22.697675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3b338-6be8-439d-a782-86fd79357ce5 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:22.750877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:22.793441 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3b338-6be8-439d-a782-86fd79357ce5 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:22.826099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a669525-03b2-486c-9bb0-7433b259883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:22.826975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a669525-03b2-486c-9bb0-7433b259883b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:22.827259 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a669525-03b2-486c-9bb0-7433b259883b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:22.827535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a669525-03b2-486c-9bb0-7433b259883b None admin] PATH_INFO: `/v3/projects/014cd6e58fd0401bb70a6e590e48e4ee` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:22.828690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a669525-03b2-486c-9bb0-7433b259883b None admin] RBAC: Authorizing `identity:get_project(project_id=014cd6e58fd0401bb70a6e590e48e4ee)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:22.830183 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a669525-03b2-486c-9bb0-7433b259883b None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:22.831874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 608/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:42:22 2022] GET /identity/v3/projects/014cd6e58fd0401bb70a6e590e48e4ee => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:22.837739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb4dc2-1be5-4aae-9e0a-e0701cd37ac8 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:22.863775 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:22.935658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb4dc2-1be5-4aae-9e0a-e0701cd37ac8 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:22.968744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea9fc5-80ec-4bdd-9e97-57e790b0ffcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:22.969618 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9fc5-80ec-4bdd-9e97-57e790b0ffcf None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:22.969902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9fc5-80ec-4bdd-9e97-57e790b0ffcf None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:22.970203 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea9fc5-80ec-4bdd-9e97-57e790b0ffcf None admin] PATH_INFO: `/v3/projects/014cd6e58fd0401bb70a6e590e48e4ee/users/4d337db34f7d41d6818313dde0b723c4/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:22.972154 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea9fc5-80ec-4bdd-9e97-57e790b0ffcf None admin] RBAC: Authorizing `identity:create_grant(project_id=014cd6e58fd0401bb70a6e590e48e4ee, user_id=4d337db34f7d41d6818313dde0b723c4, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:22.973567 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea9fc5-80ec-4bdd-9e97-57e790b0ffcf None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:23.052585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 584/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:42:22 2022] PUT /identity/v3/projects/014cd6e58fd0401bb70a6e590e48e4ee/users/4d337db34f7d41d6818313dde0b723c4/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:42:25.192016 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edb425-1dfc-4fd1-84b5-de0def76626f None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:25.192547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edb425-1dfc-4fd1-84b5-de0def76626f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:25.192641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edb425-1dfc-4fd1-84b5-de0def76626f None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:25.193930 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 609/1193] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:42:25.199166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62e0f0-e5be-4bd6-a62a-3e7e973a5604 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:25.199549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62e0f0-e5be-4bd6-a62a-3e7e973a5604 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:25.199724 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62e0f0-e5be-4bd6-a62a-3e7e973a5604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:25.216499 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-cf62e0f0-e5be-4bd6-a62a-3e7e973a5604 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:42:25.217655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cf62e0f0-e5be-4bd6-a62a-3e7e973a5604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:42:25.281126 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 585/1194] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:42:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:42:25.304444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edb425-1dfc-4fd1-84b5-de0def76626f None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:25.403260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edb425-1dfc-4fd1-84b5-de0def76626f None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:25.425745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:25.436644 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97b060-6ac4-42a6-ab2d-09a9ad83f337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:25.437432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97b060-6ac4-42a6-ab2d-09a9ad83f337 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:25.437712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97b060-6ac4-42a6-ab2d-09a9ad83f337 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:25.442423 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97b060-6ac4-42a6-ab2d-09a9ad83f337 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:25.448249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed97b060-6ac4-42a6-ab2d-09a9ad83f337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-ed97b060-6ac4-42a6-ab2d-09a9ad83f337 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:42:25.455881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:42:25.457003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:42:25.458021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:42:25.458021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:42:25.458021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:42:25.458021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:42:25.458021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:42:25.458021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:42:25.458021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:42:25.458021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:42:25.458021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:42:25.458021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:42:25.458021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:42:25.458021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:42:25.458021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 610/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:42:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:42:25.463185 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62e0f0-e5be-4bd6-a62a-3e7e973a5604 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:25.478263 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:25.561237 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62e0f0-e5be-4bd6-a62a-3e7e973a5604 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:25.594780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9fd17-c1e5-4ff3-80b3-95a86215ec6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:25.595439 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9fd17-c1e5-4ff3-80b3-95a86215ec6f None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:25.595723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9fd17-c1e5-4ff3-80b3-95a86215ec6f None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:25.596000 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9fd17-c1e5-4ff3-80b3-95a86215ec6f None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:25.596738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9fd17-c1e5-4ff3-80b3-95a86215ec6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:42:25.597055 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9fd17-c1e5-4ff3-80b3-95a86215ec6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:25.598428 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9fd17-c1e5-4ff3-80b3-95a86215ec6f None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:25.606233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 586/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:42:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:25.612711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97b060-6ac4-42a6-ab2d-09a9ad83f337 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:25.711213 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97b060-6ac4-42a6-ab2d-09a9ad83f337 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:25.743680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f231dda-934d-4285-8ca9-ed5f7e822c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:25.744540 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f231dda-934d-4285-8ca9-ed5f7e822c53 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:25.744886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f231dda-934d-4285-8ca9-ed5f7e822c53 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:25.745165 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f231dda-934d-4285-8ca9-ed5f7e822c53 None admin] PATH_INFO: `/v3/users/4d337db34f7d41d6818313dde0b723c4` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:25.746407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f231dda-934d-4285-8ca9-ed5f7e822c53 None admin] RBAC: Authorizing `identity:get_user(user_id=4d337db34f7d41d6818313dde0b723c4)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:25.747830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f231dda-934d-4285-8ca9-ed5f7e822c53 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:25.749443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 611/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Fri May 27 19:42:25 2022] GET /identity/v3/users/4d337db34f7d41d6818313dde0b723c4 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:25.755209 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9fd17-c1e5-4ff3-80b3-95a86215ec6f None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:25.830738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:25.852829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9fd17-c1e5-4ff3-80b3-95a86215ec6f None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:25.886503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c9bd3-80d6-45e3-af78-522d421c36e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:25.887153 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c9bd3-80d6-45e3-af78-522d421c36e4 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:25.887443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c9bd3-80d6-45e3-af78-522d421c36e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:25.887725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c9bd3-80d6-45e3-af78-522d421c36e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:25.952963 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c9bd3-80d6-45e3-af78-522d421c36e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:25.954468 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c9bd3-80d6-45e3-af78-522d421c36e4 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:26.033708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:26.058946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 587/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:42:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:42:26.064644 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f231dda-934d-4285-8ca9-ed5f7e822c53 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:26.115310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:26.166655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f231dda-934d-4285-8ca9-ed5f7e822c53 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:26.200643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37c73e-b63a-46a8-9c6c-c8a3080fb6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:26.201521 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c73e-b63a-46a8-9c6c-c8a3080fb6c6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:26.201813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c73e-b63a-46a8-9c6c-c8a3080fb6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:26.202096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c73e-b63a-46a8-9c6c-c8a3080fb6c6 None admin] PATH_INFO: `/v3/projects/014cd6e58fd0401bb70a6e590e48e4ee` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:26.203318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37c73e-b63a-46a8-9c6c-c8a3080fb6c6 None admin] RBAC: Authorizing `identity:get_project(project_id=014cd6e58fd0401bb70a6e590e48e4ee)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:26.204772 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37c73e-b63a-46a8-9c6c-c8a3080fb6c6 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:26.206740 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 612/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Fri May 27 19:42:26 2022] GET /identity/v3/projects/014cd6e58fd0401bb70a6e590e48e4ee => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:26.212556 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c9bd3-80d6-45e3-af78-522d421c36e4 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:42:26.311602 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c9bd3-80d6-45e3-af78-522d421c36e4 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:42:26.344403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a3d74-3b40-4a97-8d9c-f7883684a16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:42:26.345077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3d74-3b40-4a97-8d9c-f7883684a16a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:42:26.345365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3d74-3b40-4a97-8d9c-f7883684a16a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:42:26.345645 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3d74-3b40-4a97-8d9c-f7883684a16a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:42:26.346501 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a3d74-3b40-4a97-8d9c-f7883684a16a None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=014cd6e58fd0401bb70a6e590e48e4ee, user.id=4d337db34f7d41d6818313dde0b723c4) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:42:26.346818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a3d74-3b40-4a97-8d9c-f7883684a16a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:42:26.348240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a3d74-3b40-4a97-8d9c-f7883684a16a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:42:26.353959 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 588/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:42:26 2022] GET /identity/v3/role_assignments?user.id=4d337db34f7d41d6818313dde0b723c4&scope.project.id=014cd6e58fd0401bb70a6e590e48e4ee&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:42:36.196259 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=41 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:42:36.351343 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=80 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:42.413822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080bc63-d2de-4479-841a-fee67897d72d None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:42.414443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080bc63-d2de-4479-841a-fee67897d72d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:42.414443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080bc63-d2de-4479-841a-fee67897d72d None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:42.415790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 613/1201] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:43:42.421485 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15eaec-e701-4b61-9ef8-f9a1a4318cf1 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:42.421945 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15eaec-e701-4b61-9ef8-f9a1a4318cf1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:42.422045 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d15eaec-e701-4b61-9ef8-f9a1a4318cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:42.438985 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-7d15eaec-e701-4b61-9ef8-f9a1a4318cf1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:43:42.440152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-7d15eaec-e701-4b61-9ef8-f9a1a4318cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:43:42.512249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 589/1202] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:43:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:43:42.537093 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080bc63-d2de-4479-841a-fee67897d72d None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:42.643587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080bc63-d2de-4479-841a-fee67897d72d None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:42.677139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5996058-7ae6-44ff-9a73-14aaaf413efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:42.677866 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5996058-7ae6-44ff-9a73-14aaaf413efa None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:42.678152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5996058-7ae6-44ff-9a73-14aaaf413efa None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:42.678460 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5996058-7ae6-44ff-9a73-14aaaf413efa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:42.688741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5996058-7ae6-44ff-9a73-14aaaf413efa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:42.690360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5996058-7ae6-44ff-9a73-14aaaf413efa None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:42.720893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-e5996058-7ae6-44ff-9a73-14aaaf413efa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:42.720893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:42.720893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:42.720893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:42.720893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:42.720893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:42.720893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:42.720893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:42.720893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:42.720893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:42.720893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:42.720893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:42.720893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:43:42.720893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:43:42.720893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:42.722141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:42.723595 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:43:42.723595 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:43:42.723595 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:42.723595 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:43:42.723595 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 614/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:42.728277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15eaec-e701-4b61-9ef8-f9a1a4318cf1 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:42.829644 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d15eaec-e701-4b61-9ef8-f9a1a4318cf1 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:42.860216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:42.865868 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b068556f-4596-410f-9f31-e2190f34b38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:42.866582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068556f-4596-410f-9f31-e2190f34b38f None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:42.866869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068556f-4596-410f-9f31-e2190f34b38f None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:42.867143 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b068556f-4596-410f-9f31-e2190f34b38f None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:42.867857 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068556f-4596-410f-9f31-e2190f34b38f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:42.868164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068556f-4596-410f-9f31-e2190f34b38f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:42.869515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b068556f-4596-410f-9f31-e2190f34b38f None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:42.881072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 590/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:42.887361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5996058-7ae6-44ff-9a73-14aaaf413efa None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:42.940585 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:42.986795 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5996058-7ae6-44ff-9a73-14aaaf413efa None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:43.020374 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c07793-90bd-4a21-b012-fbdb15e2ab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:43.021039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c07793-90bd-4a21-b012-fbdb15e2ab35 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:43.021320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c07793-90bd-4a21-b012-fbdb15e2ab35 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:43.021595 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c07793-90bd-4a21-b012-fbdb15e2ab35 None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:43.022292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c07793-90bd-4a21-b012-fbdb15e2ab35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:43.023755 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c07793-90bd-4a21-b012-fbdb15e2ab35 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:43.102914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 615/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Fri May 27 19:43:42 2022] POST /identity/v3/users => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:43:45.344139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ea689-152d-4fb2-9068-7919f2e16524 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:45.344726 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ea689-152d-4fb2-9068-7919f2e16524 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:45.344726 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ea689-152d-4fb2-9068-7919f2e16524 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:45.346091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 591/1206] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:43:45.351209 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8db7b9-2d2a-4bfc-840f-72df9176a955 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:45.356704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8db7b9-2d2a-4bfc-840f-72df9176a955 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:45.356704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8db7b9-2d2a-4bfc-840f-72df9176a955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:45.369039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-de8db7b9-2d2a-4bfc-840f-72df9176a955 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:43:45.370205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-de8db7b9-2d2a-4bfc-840f-72df9176a955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:43:45.438311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 616/1207] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:43:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:43:45.461958 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ea689-152d-4fb2-9068-7919f2e16524 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:45.565818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ea689-152d-4fb2-9068-7919f2e16524 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:45.601121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc38db3-905a-48b2-beed-e1fe780be449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:45.601840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc38db3-905a-48b2-beed-e1fe780be449 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:45.602124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc38db3-905a-48b2-beed-e1fe780be449 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:45.602438 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc38db3-905a-48b2-beed-e1fe780be449 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:45.612928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc38db3-905a-48b2-beed-e1fe780be449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-6fc38db3-905a-48b2-beed-e1fe780be449 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:43:45.622392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:45.627493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:45.628638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:45.628638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:45.628638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:45.628638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:45.628638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:43:45.628638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:43:45.628638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:43:45.628638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:43:45.628638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:43:45.628638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:43:45.628638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:43:45.628638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:43:45.628638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 592/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:43:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:45.629851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8db7b9-2d2a-4bfc-840f-72df9176a955 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:45.669400 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:45.727841 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8db7b9-2d2a-4bfc-840f-72df9176a955 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:45.765828 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57059224-6ddb-4642-bc69-e3cc94671d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:45.766523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57059224-6ddb-4642-bc69-e3cc94671d5c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:45.766832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57059224-6ddb-4642-bc69-e3cc94671d5c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:45.767107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57059224-6ddb-4642-bc69-e3cc94671d5c None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:45.767851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57059224-6ddb-4642-bc69-e3cc94671d5c None admin] RBAC: Adding query filter params (name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:45.768157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57059224-6ddb-4642-bc69-e3cc94671d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:45.769519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57059224-6ddb-4642-bc69-e3cc94671d5c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:45.777883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 617/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:43:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:45.783576 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc38db3-905a-48b2-beed-e1fe780be449 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:45.835095 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:45.884030 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc38db3-905a-48b2-beed-e1fe780be449 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:45.918362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd7381-7ba6-4917-bd35-4d25e3f40538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:45.919440 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd7381-7ba6-4917-bd35-4d25e3f40538 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:45.919777 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd7381-7ba6-4917-bd35-4d25e3f40538 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:45.920172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd7381-7ba6-4917-bd35-4d25e3f40538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:45.932186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd7381-7ba6-4917-bd35-4d25e3f40538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:45.934191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dd7381-7ba6-4917-bd35-4d25e3f40538 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:45.951541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-a4dd7381-7ba6-4917-bd35-4d25e3f40538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:45.951541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:45.951541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:45.951541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:45.951541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:45.951541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:45.951541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:45.951541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:45.951541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:45.951541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:45.951541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:45.951541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:45.951541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:43:45.951541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:43:45.951541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:45.956262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:45.957384 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:43:45.957384 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:43:45.957384 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:45.957384 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:43:45.957384 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 593/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:45.958925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57059224-6ddb-4642-bc69-e3cc94671d5c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:46.055468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:46.058386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57059224-6ddb-4642-bc69-e3cc94671d5c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:46.091840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd63e8-ca6b-425e-b7e7-7896b7fda514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:46.092498 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd63e8-ca6b-425e-b7e7-7896b7fda514 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:46.092784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd63e8-ca6b-425e-b7e7-7896b7fda514 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:46.093064 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd63e8-ca6b-425e-b7e7-7896b7fda514 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:46.093779 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd63e8-ca6b-425e-b7e7-7896b7fda514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:46.094085 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd63e8-ca6b-425e-b7e7-7896b7fda514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:46.095618 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd63e8-ca6b-425e-b7e7-7896b7fda514 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:46.108400 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 618/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:46.114290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd7381-7ba6-4917-bd35-4d25e3f40538 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:46.213130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd7381-7ba6-4917-bd35-4d25e3f40538 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:46.215165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:46.250168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1eec5-1116-458a-b9c8-e18e8e91239c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:46.250994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1eec5-1116-458a-b9c8-e18e8e91239c None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:46.251282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1eec5-1116-458a-b9c8-e18e8e91239c None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:46.251559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1eec5-1116-458a-b9c8-e18e8e91239c None admin] PATH_INFO: `/v3/users/placement` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:46.258552 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1eec5-1116-458a-b9c8-e18e8e91239c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:46.259988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1eec5-1116-458a-b9c8-e18e8e91239c None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-9ab1eec5-1116-458a-b9c8-e18e8e91239c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:43:46.274783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:46.275908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:46.277797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:46.277797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:46.277797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:43:46.277797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:43:46.277797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:43:46.277797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:43:46.277797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:43:46.277797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:43:46.277797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 19:43:46.277797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:43:46.277797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 594/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:43:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:46.282498 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd63e8-ca6b-425e-b7e7-7896b7fda514 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:46.383612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd63e8-ca6b-425e-b7e7-7896b7fda514 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:46.415983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b705266-c814-422f-99a5-3d4c39788ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:46.416662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b705266-c814-422f-99a5-3d4c39788ab5 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:46.416919 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b705266-c814-422f-99a5-3d4c39788ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:46.417198 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b705266-c814-422f-99a5-3d4c39788ab5 None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:46.418578 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b705266-c814-422f-99a5-3d4c39788ab5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:46.418889 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b705266-c814-422f-99a5-3d4c39788ab5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:46.420322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b705266-c814-422f-99a5-3d4c39788ab5 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:46.437353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 619/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Fri May 27 19:43:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:46.443163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1eec5-1116-458a-b9c8-e18e8e91239c None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:46.543777 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1eec5-1116-458a-b9c8-e18e8e91239c None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:46.578334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410295b-17da-4505-8041-afa2b904c09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:46.579019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410295b-17da-4505-8041-afa2b904c09e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:46.579303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410295b-17da-4505-8041-afa2b904c09e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:46.579580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410295b-17da-4505-8041-afa2b904c09e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:46.613466 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:46.651495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410295b-17da-4505-8041-afa2b904c09e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:46.652994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410295b-17da-4505-8041-afa2b904c09e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:46.749741 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 595/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:43:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:43:46.755575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b705266-c814-422f-99a5-3d4c39788ab5 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:46.774784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:46.852870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b705266-c814-422f-99a5-3d4c39788ab5 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:46.885794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cfb00-081b-4886-88e0-9ef745b882c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:46.887172 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cfb00-081b-4886-88e0-9ef745b882c6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:46.887460 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cfb00-081b-4886-88e0-9ef745b882c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:46.887739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cfb00-081b-4886-88e0-9ef745b882c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:46.897518 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cfb00-081b-4886-88e0-9ef745b882c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:46.898988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cfb00-081b-4886-88e0-9ef745b882c6 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:46.916065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-1a7cfb00-081b-4886-88e0-9ef745b882c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:46.916065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:46.916065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:46.916065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:46.916065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:46.916065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:46.916065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:46.916065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:46.916065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:46.916065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:46.916065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:46.916065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:46.916065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:43:46.916065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:43:46.916065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:46.920146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:46.921276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:43:46.921276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:43:46.921276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:46.921276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:43:46.921276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 620/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:46.923086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410295b-17da-4505-8041-afa2b904c09e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:46.984150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:47.023705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410295b-17da-4505-8041-afa2b904c09e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:47.057715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ce060-9dcc-4964-a90b-d5a4340816ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:47.058414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ce060-9dcc-4964-a90b-d5a4340816ef None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:47.058706 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ce060-9dcc-4964-a90b-d5a4340816ef None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:47.058987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ce060-9dcc-4964-a90b-d5a4340816ef None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:47.059708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ce060-9dcc-4964-a90b-d5a4340816ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:47.060017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ce060-9dcc-4964-a90b-d5a4340816ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:47.061449 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ce060-9dcc-4964-a90b-d5a4340816ef None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:47.074534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 596/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:47.080291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cfb00-081b-4886-88e0-9ef745b882c6 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:47.149451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:47.179151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cfb00-081b-4886-88e0-9ef745b882c6 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:47.212252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfa0a0-38d0-481d-b7b5-ae19833079d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:47.213047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfa0a0-38d0-481d-b7b5-ae19833079d7 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:47.213331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfa0a0-38d0-481d-b7b5-ae19833079d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:47.213609 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcfa0a0-38d0-481d-b7b5-ae19833079d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:47.220039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfa0a0-38d0-481d-b7b5-ae19833079d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:47.221476 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcfa0a0-38d0-481d-b7b5-ae19833079d7 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:47.236039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-bdcfa0a0-38d0-481d-b7b5-ae19833079d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:43:47.236039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:47.236039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:47.236039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:47.236039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:47.236039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:47.236039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:47.236039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:47.236039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:47.236039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:47.236039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:47.236039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:47.236039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:43:47.236039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:43:47.236039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:47.237147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:47.238251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:43:47.238251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:43:47.238251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:43:47.238251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:43:47.238251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:43:47.238251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:43:47.238251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:43:47.238251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:43:47.238251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 621/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:47.243292 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ce060-9dcc-4964-a90b-d5a4340816ef None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:47.343042 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ce060-9dcc-4964-a90b-d5a4340816ef None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:47.365722 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:47.376620 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a056214-5258-4b8c-80ea-ea6d89aa39aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:47.377275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a056214-5258-4b8c-80ea-ea6d89aa39aa None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:47.377558 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a056214-5258-4b8c-80ea-ea6d89aa39aa None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:47.377835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a056214-5258-4b8c-80ea-ea6d89aa39aa None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:47.378656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a056214-5258-4b8c-80ea-ea6d89aa39aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:47.378964 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a056214-5258-4b8c-80ea-ea6d89aa39aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:47.380375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a056214-5258-4b8c-80ea-ea6d89aa39aa None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:47.391582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 597/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:43:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:47.398271 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfa0a0-38d0-481d-b7b5-ae19833079d7 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:47.498093 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcfa0a0-38d0-481d-b7b5-ae19833079d7 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:47.525156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:47.531126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a062b46-534a-4a63-8b7b-3ec3d80b0906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:47.531776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a062b46-534a-4a63-8b7b-3ec3d80b0906 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:47.532058 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a062b46-534a-4a63-8b7b-3ec3d80b0906 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:47.532333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a062b46-534a-4a63-8b7b-3ec3d80b0906 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:47.533156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a062b46-534a-4a63-8b7b-3ec3d80b0906 None admin] RBAC: Adding query filter params (role.id=30112fca4d6549a790f2eadf20635343, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=394b43cef91f4990b4707cb7a6798068) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:47.533468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a062b46-534a-4a63-8b7b-3ec3d80b0906 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:47.535213 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a062b46-534a-4a63-8b7b-3ec3d80b0906 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:47.540617 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 622/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:43:47 2022] GET /identity/v3/role_assignments?user.id=394b43cef91f4990b4707cb7a6798068&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=30112fca4d6549a790f2eadf20635343 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:49.703402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92f699-e9b7-4090-b7fa-415426bf6afb None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:49.703964 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92f699-e9b7-4090-b7fa-415426bf6afb None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:49.703964 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92f699-e9b7-4090-b7fa-415426bf6afb None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:49.705345 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 598/1220] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:43:49.710541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c855b5f-0204-41eb-941f-c646d94d2b39 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:49.710967 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c855b5f-0204-41eb-941f-c646d94d2b39 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:49.711096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c855b5f-0204-41eb-941f-c646d94d2b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:49.728015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-3c855b5f-0204-41eb-941f-c646d94d2b39 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:43:49.729114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-3c855b5f-0204-41eb-941f-c646d94d2b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:43:49.795972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 623/1221] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:43:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:43:49.821960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92f699-e9b7-4090-b7fa-415426bf6afb None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:49.923081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92f699-e9b7-4090-b7fa-415426bf6afb None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:49.955960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0de7dc-b5d5-41b9-a957-ce436c8fc5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:49.956719 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0de7dc-b5d5-41b9-a957-ce436c8fc5f8 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:49.957004 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0de7dc-b5d5-41b9-a957-ce436c8fc5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:49.957282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0de7dc-b5d5-41b9-a957-ce436c8fc5f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:49.967729 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0de7dc-b5d5-41b9-a957-ce436c8fc5f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-9a0de7dc-b5d5-41b9-a957-ce436c8fc5f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:43:49.975377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:49.977864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:49.979122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:49.979122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:49.979122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:49.979122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:49.979122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:43:49.979122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:43:49.979122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:43:49.979122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:43:49.979122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:43:49.979122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:43:49.979122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:43:49.979122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:43:49.979122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 599/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:43:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:49.983280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c855b5f-0204-41eb-941f-c646d94d2b39 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:50.081882 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c855b5f-0204-41eb-941f-c646d94d2b39 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:50.106180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:50.116697 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df1640-884f-4772-b3b0-21967bcf98bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:50.117365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df1640-884f-4772-b3b0-21967bcf98bf None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:50.117651 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df1640-884f-4772-b3b0-21967bcf98bf None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:50.117928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df1640-884f-4772-b3b0-21967bcf98bf None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:50.118732 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df1640-884f-4772-b3b0-21967bcf98bf None admin] RBAC: Adding query filter params (name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:50.119043 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df1640-884f-4772-b3b0-21967bcf98bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:50.120419 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df1640-884f-4772-b3b0-21967bcf98bf None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:50.128130 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 624/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:43:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:50.133903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0de7dc-b5d5-41b9-a957-ce436c8fc5f8 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:50.177736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:50.233801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0de7dc-b5d5-41b9-a957-ce436c8fc5f8 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:50.267592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061d4a9-6947-4f2f-8528-78ac91a6884a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:50.268390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061d4a9-6947-4f2f-8528-78ac91a6884a None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:50.268681 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061d4a9-6947-4f2f-8528-78ac91a6884a None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:50.268962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061d4a9-6947-4f2f-8528-78ac91a6884a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:50.280050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061d4a9-6947-4f2f-8528-78ac91a6884a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:50.281492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061d4a9-6947-4f2f-8528-78ac91a6884a None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:50.298757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-c061d4a9-6947-4f2f-8528-78ac91a6884a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:50.298757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:50.298757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:50.298757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:50.298757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:50.298757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:50.298757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:50.298757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:50.298757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:50.298757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:50.298757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:50.298757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:50.298757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:43:50.298757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:43:50.298757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:50.299818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:50.300974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:43:50.300974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:43:50.300974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:50.300974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:43:50.300974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 600/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:50.305720 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df1640-884f-4772-b3b0-21967bcf98bf None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:50.405870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df1640-884f-4772-b3b0-21967bcf98bf None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:50.439155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d951f6c-0f8f-49fe-ac14-a276b45586f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:50.439825 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d951f6c-0f8f-49fe-ac14-a276b45586f6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:50.440112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d951f6c-0f8f-49fe-ac14-a276b45586f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:50.440391 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d951f6c-0f8f-49fe-ac14-a276b45586f6 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:50.441109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d951f6c-0f8f-49fe-ac14-a276b45586f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:50.441416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d951f6c-0f8f-49fe-ac14-a276b45586f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:50.442802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d951f6c-0f8f-49fe-ac14-a276b45586f6 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:50.454321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 625/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:50.460191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061d4a9-6947-4f2f-8528-78ac91a6884a None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:50.555419 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:50.562100 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061d4a9-6947-4f2f-8528-78ac91a6884a None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:50.595773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946b24e-85ba-490a-a1a0-a36681afac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:50.596599 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946b24e-85ba-490a-a1a0-a36681afac31 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:50.596890 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946b24e-85ba-490a-a1a0-a36681afac31 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:50.597165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946b24e-85ba-490a-a1a0-a36681afac31 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:50.604020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946b24e-85ba-490a-a1a0-a36681afac31 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:50.606012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946b24e-85ba-490a-a1a0-a36681afac31 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-9946b24e-85ba-490a-a1a0-a36681afac31 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:43:50.621782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:50.622962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:50.624138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:50.624138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:50.624138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:43:50.624138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:43:50.624138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:43:50.624138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:43:50.624138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:43:50.624138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:43:50.624138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 19:43:50.624138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:43:50.624138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 601/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:43:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:50.628754 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d951f6c-0f8f-49fe-ac14-a276b45586f6 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:50.676413 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:50.727327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d951f6c-0f8f-49fe-ac14-a276b45586f6 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:50.762447 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81fbe3-853e-4170-8565-2286d2e58a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:50.763117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81fbe3-853e-4170-8565-2286d2e58a27 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:50.763400 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81fbe3-853e-4170-8565-2286d2e58a27 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:50.763675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b81fbe3-853e-4170-8565-2286d2e58a27 None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:50.764502 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81fbe3-853e-4170-8565-2286d2e58a27 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:50.764813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81fbe3-853e-4170-8565-2286d2e58a27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:50.766255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b81fbe3-853e-4170-8565-2286d2e58a27 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:50.783586 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 626/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Fri May 27 19:43:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:50.789466 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946b24e-85ba-490a-a1a0-a36681afac31 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:50.888535 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946b24e-85ba-490a-a1a0-a36681afac31 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:50.921779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524633c-126f-4ac3-b1ba-a4825261f4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:50.922595 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524633c-126f-4ac3-b1ba-a4825261f4ac None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:50.922879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524633c-126f-4ac3-b1ba-a4825261f4ac None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:50.923161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524633c-126f-4ac3-b1ba-a4825261f4ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:50.933593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524633c-126f-4ac3-b1ba-a4825261f4ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:50.935061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524633c-126f-4ac3-b1ba-a4825261f4ac None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:50.952764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-e524633c-126f-4ac3-b1ba-a4825261f4ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:50.952764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:50.952764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:50.952764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:50.952764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:50.952764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:50.952764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:50.952764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:50.952764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:50.952764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:50.952764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:50.952764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:50.952764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:43:50.952764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:43:50.952764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:50.953650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:50.954621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:43:50.954621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:43:50.954621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:50.954621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:43:50.954621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 602/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:50.959685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81fbe3-853e-4170-8565-2286d2e58a27 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:51.059659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b81fbe3-853e-4170-8565-2286d2e58a27 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:51.061944 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:51.094117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508c54a-3f8a-4760-8775-fe7abd9a96e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:51.094805 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508c54a-3f8a-4760-8775-fe7abd9a96e4 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:51.095087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508c54a-3f8a-4760-8775-fe7abd9a96e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:51.095363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508c54a-3f8a-4760-8775-fe7abd9a96e4 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:51.096082 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508c54a-3f8a-4760-8775-fe7abd9a96e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:51.096390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508c54a-3f8a-4760-8775-fe7abd9a96e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:51.097750 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508c54a-3f8a-4760-8775-fe7abd9a96e4 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:51.108635 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 627/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:51.114419 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524633c-126f-4ac3-b1ba-a4825261f4ac None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:51.123836 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:51.214273 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524633c-126f-4ac3-b1ba-a4825261f4ac None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:51.247471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e67d5-74f9-4a19-bac4-ade783c5806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:51.248256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e67d5-74f9-4a19-bac4-ade783c5806e None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:51.248542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e67d5-74f9-4a19-bac4-ade783c5806e None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:51.248819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e67d5-74f9-4a19-bac4-ade783c5806e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:51.256898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e67d5-74f9-4a19-bac4-ade783c5806e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:51.259619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e67d5-74f9-4a19-bac4-ade783c5806e None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:51.273374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-4c8e67d5-74f9-4a19-bac4-ade783c5806e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:43:51.273374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:51.273374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:51.273374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:51.273374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:51.273374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:51.273374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:51.273374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:51.273374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:51.273374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:51.273374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:51.273374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:51.273374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:43:51.273374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:43:51.273374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:51.274371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:51.275570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:43:51.275570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:43:51.275570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:43:51.275570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:43:51.275570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:43:51.275570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:43:51.275570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:43:51.275570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:43:51.275570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 603/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:51.281049 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508c54a-3f8a-4760-8775-fe7abd9a96e4 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:51.381057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508c54a-3f8a-4760-8775-fe7abd9a96e4 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:51.414966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8382db5-b5cc-475e-91b6-06e72079ef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:51.415632 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8382db5-b5cc-475e-91b6-06e72079ef42 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:51.415918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8382db5-b5cc-475e-91b6-06e72079ef42 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:51.416201 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8382db5-b5cc-475e-91b6-06e72079ef42 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:51.416988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8382db5-b5cc-475e-91b6-06e72079ef42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:51.417831 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8382db5-b5cc-475e-91b6-06e72079ef42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:51.419293 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8382db5-b5cc-475e-91b6-06e72079ef42 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:51.431509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 628/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:43:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:51.437800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e67d5-74f9-4a19-bac4-ade783c5806e None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:51.506947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:51.542111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e67d5-74f9-4a19-bac4-ade783c5806e None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:51.577996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8a721-c0ac-4288-8b4c-55556a6b220f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:51.578926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8a721-c0ac-4288-8b4c-55556a6b220f None admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:51.579195 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8a721-c0ac-4288-8b4c-55556a6b220f None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:51.579475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8a721-c0ac-4288-8b4c-55556a6b220f None admin] PATH_INFO: `/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/394b43cef91f4990b4707cb7a6798068/roles/30112fca4d6549a790f2eadf20635343` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:51.594889 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8a721-c0ac-4288-8b4c-55556a6b220f None admin] RBAC: Authorizing `identity:create_grant(project_id=400421f9ccc6478783fa6bbc822b0687, user_id=394b43cef91f4990b4707cb7a6798068, role_id=30112fca4d6549a790f2eadf20635343)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:51.596317 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8a721-c0ac-4288-8b4c-55556a6b220f None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:51.656119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 604/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:43:51 2022] PUT /identity/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/394b43cef91f4990b4707cb7a6798068/roles/30112fca4d6549a790f2eadf20635343 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:43:53.867190 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b323bc5-ad5b-4cec-8193-59a27570c003 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:53.867742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b323bc5-ad5b-4cec-8193-59a27570c003 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:53.867742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b323bc5-ad5b-4cec-8193-59a27570c003 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:53.869089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 629/1233] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:43:53.874881 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f7cc7-bd8b-495d-aafb-3da3bd256ea5 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:53.878942 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f7cc7-bd8b-495d-aafb-3da3bd256ea5 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:53.878942 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f7cc7-bd8b-495d-aafb-3da3bd256ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:53.892384 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-6f5f7cc7-bd8b-495d-aafb-3da3bd256ea5 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:43:53.893563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-6f5f7cc7-bd8b-495d-aafb-3da3bd256ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:43:53.959822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 605/1234] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:43:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:43:53.983634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b323bc5-ad5b-4cec-8193-59a27570c003 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:54.008522 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:54.084262 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b323bc5-ad5b-4cec-8193-59a27570c003 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:54.117545 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560812a9-7a90-4e4b-95ad-0a0147445ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:54.118272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560812a9-7a90-4e4b-95ad-0a0147445ed2 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:54.118600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560812a9-7a90-4e4b-95ad-0a0147445ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:54.118882 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560812a9-7a90-4e4b-95ad-0a0147445ed2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:54.129202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560812a9-7a90-4e4b-95ad-0a0147445ed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-560812a9-7a90-4e4b-95ad-0a0147445ed2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:43:54.137321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:54.147204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:54.148249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:54.148249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:54.148249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:54.148249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:54.148249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:43:54.148249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:43:54.148249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:43:54.148249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:43:54.148249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:43:54.148249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:43:54.148249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 19:43:54.148249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:43:54.148249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 630/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Fri May 27 19:43:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:54.149139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f7cc7-bd8b-495d-aafb-3da3bd256ea5 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:54.193447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:54.244338 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f7cc7-bd8b-495d-aafb-3da3bd256ea5 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:54.278607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedf2e2-b0c3-479e-af71-b3eaf21dfb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:54.279271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedf2e2-b0c3-479e-af71-b3eaf21dfb03 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:54.279555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedf2e2-b0c3-479e-af71-b3eaf21dfb03 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:54.279829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cedf2e2-b0c3-479e-af71-b3eaf21dfb03 None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:54.280567 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedf2e2-b0c3-479e-af71-b3eaf21dfb03 None admin] RBAC: Adding query filter params (name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:54.280902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedf2e2-b0c3-479e-af71-b3eaf21dfb03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:54.282359 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cedf2e2-b0c3-479e-af71-b3eaf21dfb03 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:54.290612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 606/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Fri May 27 19:43:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:54.296726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560812a9-7a90-4e4b-95ad-0a0147445ed2 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:54.381132 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:54.396801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560812a9-7a90-4e4b-95ad-0a0147445ed2 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:54.430206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d90e1-1c57-4e21-8afd-a3255785e896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:54.431032 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d90e1-1c57-4e21-8afd-a3255785e896 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:54.431322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d90e1-1c57-4e21-8afd-a3255785e896 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:54.431605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d90e1-1c57-4e21-8afd-a3255785e896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:54.441292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d90e1-1c57-4e21-8afd-a3255785e896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:54.442779 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9d90e1-1c57-4e21-8afd-a3255785e896 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:54.460307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-7d9d90e1-1c57-4e21-8afd-a3255785e896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:54.460307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:54.460307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:54.460307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:54.460307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:54.460307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:54.460307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:54.460307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:54.460307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:54.460307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:54.460307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:54.460307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:54.460307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:43:54.460307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:43:54.460307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:54.470990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:54.471909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:43:54.471909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:43:54.471909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:54.471909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:43:54.471909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 631/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:54.472204 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedf2e2-b0c3-479e-af71-b3eaf21dfb03 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:54.569801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cedf2e2-b0c3-479e-af71-b3eaf21dfb03 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:54.578958 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:54.603261 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf37fbf-e0fa-4493-b616-041a829399d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:54.603927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf37fbf-e0fa-4493-b616-041a829399d8 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:54.604214 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf37fbf-e0fa-4493-b616-041a829399d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:54.604512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf37fbf-e0fa-4493-b616-041a829399d8 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:54.605230 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf37fbf-e0fa-4493-b616-041a829399d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:54.605536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf37fbf-e0fa-4493-b616-041a829399d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:54.606921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf37fbf-e0fa-4493-b616-041a829399d8 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:54.618575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 607/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:54.624479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d90e1-1c57-4e21-8afd-a3255785e896 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:54.723374 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d90e1-1c57-4e21-8afd-a3255785e896 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:54.758989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cecb59-dc72-4082-9069-d5a44f5739c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:54.759794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cecb59-dc72-4082-9069-d5a44f5739c5 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:54.760075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cecb59-dc72-4082-9069-d5a44f5739c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:54.760348 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cecb59-dc72-4082-9069-d5a44f5739c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:54.763186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:54.768211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cecb59-dc72-4082-9069-d5a44f5739c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:54.769794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cecb59-dc72-4082-9069-d5a44f5739c5 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-39cecb59-dc72-4082-9069-d5a44f5739c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:43:54.785071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:54.786252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:54.787568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:54.787568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:54.787568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:43:54.787568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:43:54.787568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:43:54.787568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:43:54.787568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:43:54.787568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:43:54.787568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 19:43:54.787568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:43:54.787568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 632/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:43:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:54.793011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf37fbf-e0fa-4493-b616-041a829399d8 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:54.893407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf37fbf-e0fa-4493-b616-041a829399d8 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:54.928201 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f9ad7-6ec5-4d68-aab9-b26815019c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:54.928878 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f9ad7-6ec5-4d68-aab9-b26815019c60 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:54.929162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f9ad7-6ec5-4d68-aab9-b26815019c60 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:54.929444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f9ad7-6ec5-4d68-aab9-b26815019c60 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:54.930277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f9ad7-6ec5-4d68-aab9-b26815019c60 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:54.930623 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f9ad7-6ec5-4d68-aab9-b26815019c60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:54.932042 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f9ad7-6ec5-4d68-aab9-b26815019c60 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:54.948876 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 608/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Fri May 27 19:43:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:43:54.954701 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cecb59-dc72-4082-9069-d5a44f5739c5 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:55.053275 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cecb59-dc72-4082-9069-d5a44f5739c5 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:55.086847 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfba462-8a96-48e7-a082-af664cc1edfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:55.087502 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfba462-8a96-48e7-a082-af664cc1edfc None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:55.087791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfba462-8a96-48e7-a082-af664cc1edfc None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:55.088071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfba462-8a96-48e7-a082-af664cc1edfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:55.149330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:55.156347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfba462-8a96-48e7-a082-af664cc1edfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:55.157806 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfba462-8a96-48e7-a082-af664cc1edfc None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:55.254513 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 633/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:43:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:43:55.260403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f9ad7-6ec5-4d68-aab9-b26815019c60 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:55.287456 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:55.360570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f9ad7-6ec5-4d68-aab9-b26815019c60 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:55.394574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69be7cd-f1a8-4d8a-8e1a-4b68883bd10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:55.395399 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69be7cd-f1a8-4d8a-8e1a-4b68883bd10f None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:55.395688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69be7cd-f1a8-4d8a-8e1a-4b68883bd10f None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:55.395974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69be7cd-f1a8-4d8a-8e1a-4b68883bd10f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:55.407528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69be7cd-f1a8-4d8a-8e1a-4b68883bd10f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:55.409245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69be7cd-f1a8-4d8a-8e1a-4b68883bd10f None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:55.426735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-f69be7cd-f1a8-4d8a-8e1a-4b68883bd10f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:55.426735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:55.426735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:55.426735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:55.426735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:55.426735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:55.426735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:55.426735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:55.426735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:55.426735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:55.426735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:55.426735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:55.426735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:43:55.426735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:43:55.426735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:55.429075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:55.430194 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:43:55.430194 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:43:55.430194 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:55.430194 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:43:55.430194 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 609/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:55.433678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfba462-8a96-48e7-a082-af664cc1edfc None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:55.528076 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:55.533963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfba462-8a96-48e7-a082-af664cc1edfc None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:55.567413 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7702f4f-1699-4620-8966-37a4089a2165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:55.568074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7702f4f-1699-4620-8966-37a4089a2165 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:55.568362 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7702f4f-1699-4620-8966-37a4089a2165 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:55.568725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7702f4f-1699-4620-8966-37a4089a2165 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:55.569455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7702f4f-1699-4620-8966-37a4089a2165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:55.569771 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7702f4f-1699-4620-8966-37a4089a2165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:55.571193 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7702f4f-1699-4620-8966-37a4089a2165 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:55.582196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 634/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:55.588062 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69be7cd-f1a8-4d8a-8e1a-4b68883bd10f None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:55.667528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:55.688748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69be7cd-f1a8-4d8a-8e1a-4b68883bd10f None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:55.721888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa567f1d-6de3-4ff9-8a44-b7b51e227045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:55.722721 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa567f1d-6de3-4ff9-8a44-b7b51e227045 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:55.723015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa567f1d-6de3-4ff9-8a44-b7b51e227045 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:55.723293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa567f1d-6de3-4ff9-8a44-b7b51e227045 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:55.730133 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa567f1d-6de3-4ff9-8a44-b7b51e227045 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:55.734723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa567f1d-6de3-4ff9-8a44-b7b51e227045 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:55.745578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-fa567f1d-6de3-4ff9-8a44-b7b51e227045 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:43:55.745578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:55.745578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:55.745578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:55.745578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:55.745578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:55.745578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:55.745578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:55.745578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:55.745578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:55.745578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:55.745578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:55.745578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:43:55.745578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:43:55.745578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:55.746665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:55.747784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:43:55.747784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:43:55.747784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:43:55.747784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:43:55.747784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:43:55.747784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:43:55.747784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:43:55.747784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:43:55.747784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 610/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:43:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:55.752741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7702f4f-1699-4620-8966-37a4089a2165 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:55.852757 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7702f4f-1699-4620-8966-37a4089a2165 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:55.890634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989f22e-1d2d-4100-a7cf-2a825ddc45da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:55.891289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989f22e-1d2d-4100-a7cf-2a825ddc45da None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:55.891579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989f22e-1d2d-4100-a7cf-2a825ddc45da None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:55.891859 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989f22e-1d2d-4100-a7cf-2a825ddc45da None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:55.892646 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989f22e-1d2d-4100-a7cf-2a825ddc45da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:55.892959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989f22e-1d2d-4100-a7cf-2a825ddc45da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:55.894415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989f22e-1d2d-4100-a7cf-2a825ddc45da None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:55.906177 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 635/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:55.912833 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa567f1d-6de3-4ff9-8a44-b7b51e227045 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:56.018447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa567f1d-6de3-4ff9-8a44-b7b51e227045 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:56.051412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d414b-a14c-4c66-a81a-c1e3629b8112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:56.052059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d414b-a14c-4c66-a81a-c1e3629b8112 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:56.052341 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d414b-a14c-4c66-a81a-c1e3629b8112 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:56.052614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d414b-a14c-4c66-a81a-c1e3629b8112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:56.053427 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d414b-a14c-4c66-a81a-c1e3629b8112 None admin] RBAC: Adding query filter params (role.id=30112fca4d6549a790f2eadf20635343, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=394b43cef91f4990b4707cb7a6798068) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:56.053738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d414b-a14c-4c66-a81a-c1e3629b8112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:56.055210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d414b-a14c-4c66-a81a-c1e3629b8112 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:56.061961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 611/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:43:55 2022] GET /identity/v3/role_assignments?user.id=394b43cef91f4990b4707cb7a6798068&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=30112fca4d6549a790f2eadf20635343 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:58.363120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1df991-cfa8-4d3f-bca8-d34e9a17129d None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:58.363699 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1df991-cfa8-4d3f-bca8-d34e9a17129d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:58.363699 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1df991-cfa8-4d3f-bca8-d34e9a17129d None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:58.365031 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 636/1247] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:43:58.370997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a46ac-d86b-4b6d-b9a6-2e17a6f1a427 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:58.371416 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a46ac-d86b-4b6d-b9a6-2e17a6f1a427 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:58.371587 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a46ac-d86b-4b6d-b9a6-2e17a6f1a427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:58.376635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:58.388960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-8f8a46ac-d86b-4b6d-b9a6-2e17a6f1a427 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:43:58.390364 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-8f8a46ac-d86b-4b6d-b9a6-2e17a6f1a427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:43:58.455876 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 612/1248] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:43:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:43:58.480314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1df991-cfa8-4d3f-bca8-d34e9a17129d None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:58.498558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:58.580897 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1df991-cfa8-4d3f-bca8-d34e9a17129d None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:58.615696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294887e7-b9c2-4042-b2de-a5a3a5a4004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:58.616415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294887e7-b9c2-4042-b2de-a5a3a5a4004f None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:58.616702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294887e7-b9c2-4042-b2de-a5a3a5a4004f None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:58.616997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294887e7-b9c2-4042-b2de-a5a3a5a4004f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:58.627116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294887e7-b9c2-4042-b2de-a5a3a5a4004f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-294887e7-b9c2-4042-b2de-a5a3a5a4004f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:43:58.634730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:58.635886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:58.637094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:58.637094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:58.637094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:58.637094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:58.637094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:43:58.637094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:43:58.637094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:43:58.637094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:43:58.637094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:43:58.637094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:43:58.637094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:43:58.637094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:43:58.637094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 637/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:43:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:58.641965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a46ac-d86b-4b6d-b9a6-2e17a6f1a427 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:58.739926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a46ac-d86b-4b6d-b9a6-2e17a6f1a427 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:58.768179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:58.773015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796f35c-9fcf-418d-97a8-d04cc64df9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:58.773687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796f35c-9fcf-418d-97a8-d04cc64df9ff None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:58.773974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796f35c-9fcf-418d-97a8-d04cc64df9ff None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:58.774253 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796f35c-9fcf-418d-97a8-d04cc64df9ff None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:58.775032 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796f35c-9fcf-418d-97a8-d04cc64df9ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:58.775344 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796f35c-9fcf-418d-97a8-d04cc64df9ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:58.777210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796f35c-9fcf-418d-97a8-d04cc64df9ff None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:58.785324 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 613/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:43:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:58.791294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294887e7-b9c2-4042-b2de-a5a3a5a4004f None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:58.875961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:58.899251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294887e7-b9c2-4042-b2de-a5a3a5a4004f None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:58.932804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ad817-8e1c-4db7-a511-6a2a16433be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:58.933674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad817-8e1c-4db7-a511-6a2a16433be2 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:58.933928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad817-8e1c-4db7-a511-6a2a16433be2 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:58.934206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ad817-8e1c-4db7-a511-6a2a16433be2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:58.944558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ad817-8e1c-4db7-a511-6a2a16433be2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:58.945999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ad817-8e1c-4db7-a511-6a2a16433be2 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:58.965680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-4a0ad817-8e1c-4db7-a511-6a2a16433be2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:58.965680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:58.965680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:58.965680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:58.965680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:58.965680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:58.965680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:58.965680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:58.965680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:58.965680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:58.965680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:58.965680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:58.965680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:43:58.965680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:43:58.965680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:58.966923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:58.967983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:43:58.967983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:43:58.967983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:58.967983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:43:58.970497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 638/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:58.972885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796f35c-9fcf-418d-97a8-d04cc64df9ff None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:59.075506 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796f35c-9fcf-418d-97a8-d04cc64df9ff None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:59.110265 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01902ed4-6de7-4fc1-a8c8-fc11f89f1787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:59.111100 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902ed4-6de7-4fc1-a8c8-fc11f89f1787 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:59.111391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902ed4-6de7-4fc1-a8c8-fc11f89f1787 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:59.111678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902ed4-6de7-4fc1-a8c8-fc11f89f1787 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:59.112402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01902ed4-6de7-4fc1-a8c8-fc11f89f1787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:59.112716 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01902ed4-6de7-4fc1-a8c8-fc11f89f1787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:59.114089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01902ed4-6de7-4fc1-a8c8-fc11f89f1787 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:59.125638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 614/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:59.131464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ad817-8e1c-4db7-a511-6a2a16433be2 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:59.231445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ad817-8e1c-4db7-a511-6a2a16433be2 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:59.256112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:59.263992 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a38a4-cfcd-4e16-a20d-0dd4ff020e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:59.264784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a38a4-cfcd-4e16-a20d-0dd4ff020e3e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:59.265071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a38a4-cfcd-4e16-a20d-0dd4ff020e3e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:59.265352 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a38a4-cfcd-4e16-a20d-0dd4ff020e3e None admin] PATH_INFO: `/v3/users/placement` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:59.273109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a38a4-cfcd-4e16-a20d-0dd4ff020e3e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:59.274591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a38a4-cfcd-4e16-a20d-0dd4ff020e3e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-683a38a4-cfcd-4e16-a20d-0dd4ff020e3e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:43:59.289405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:59.290486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:59.291810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:59.291810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:59.291810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:43:59.291810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:43:59.291810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:43:59.291810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:43:59.291810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:43:59.291810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:43:59.291810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 19:43:59.291810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:43:59.291810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 639/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:43:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 19:43:59.296600 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01902ed4-6de7-4fc1-a8c8-fc11f89f1787 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:59.351325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:59.395647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01902ed4-6de7-4fc1-a8c8-fc11f89f1787 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:59.430294 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb5d87-2753-4f85-a6ce-7310b685e752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:59.431032 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb5d87-2753-4f85-a6ce-7310b685e752 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:59.431354 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb5d87-2753-4f85-a6ce-7310b685e752 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:59.431779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb5d87-2753-4f85-a6ce-7310b685e752 None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:59.433121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb5d87-2753-4f85-a6ce-7310b685e752 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:43:59.433432 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb5d87-2753-4f85-a6ce-7310b685e752 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:59.434932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb5d87-2753-4f85-a6ce-7310b685e752 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:59.452200 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 615/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Fri May 27 19:43:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:43:59.458094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a38a4-cfcd-4e16-a20d-0dd4ff020e3e None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:59.559381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a38a4-cfcd-4e16-a20d-0dd4ff020e3e None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:59.593783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46835632-f534-4f0a-bda2-393a4ab5fa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:59.594464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46835632-f534-4f0a-bda2-393a4ab5fa60 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:59.594752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46835632-f534-4f0a-bda2-393a4ab5fa60 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:59.595029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46835632-f534-4f0a-bda2-393a4ab5fa60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:59.650228 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:59.662731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46835632-f534-4f0a-bda2-393a4ab5fa60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:59.664178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46835632-f534-4f0a-bda2-393a4ab5fa60 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:59.758281 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 640/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:43:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:43:59.764843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb5d87-2753-4f85-a6ce-7310b685e752 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:43:59.863694 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb5d87-2753-4f85-a6ce-7310b685e752 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:43:59.876524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:43:59.897489 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494c5f7-45cf-4efc-9ed3-aa4fdf0f1721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:43:59.898278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494c5f7-45cf-4efc-9ed3-aa4fdf0f1721 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:43:59.898595 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494c5f7-45cf-4efc-9ed3-aa4fdf0f1721 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:43:59.898877 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494c5f7-45cf-4efc-9ed3-aa4fdf0f1721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:43:59.911757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494c5f7-45cf-4efc-9ed3-aa4fdf0f1721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:43:59.911757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494c5f7-45cf-4efc-9ed3-aa4fdf0f1721 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:43:59.928561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-7494c5f7-45cf-4efc-9ed3-aa4fdf0f1721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:59.928561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:43:59.928561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:43:59.928561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:43:59.928561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:43:59.928561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:43:59.928561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:43:59.928561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:43:59.928561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:43:59.928561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:43:59.928561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:43:59.928561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:43:59.928561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:43:59.928561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:43:59.928561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:43:59.929636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:43:59.936342 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:43:59.936342 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:43:59.936342 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:43:59.936342 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:43:59.936342 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 616/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:43:59.936736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46835632-f534-4f0a-bda2-393a4ab5fa60 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:00.024918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:00.036585 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46835632-f534-4f0a-bda2-393a4ab5fa60 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:00.070384 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d373ee-51b0-4376-a38b-fc6512d4558e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:00.071007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d373ee-51b0-4376-a38b-fc6512d4558e None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:00.071288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d373ee-51b0-4376-a38b-fc6512d4558e None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:00.071563 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d373ee-51b0-4376-a38b-fc6512d4558e None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:00.072279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d373ee-51b0-4376-a38b-fc6512d4558e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:00.073122 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d373ee-51b0-4376-a38b-fc6512d4558e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:00.074626 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d373ee-51b0-4376-a38b-fc6512d4558e None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:00.086395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 641/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:00.092815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494c5f7-45cf-4efc-9ed3-aa4fdf0f1721 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:00.194076 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494c5f7-45cf-4efc-9ed3-aa4fdf0f1721 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:00.227549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a37c47-6b48-4f8a-b5be-9f655d00950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:00.228339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a37c47-6b48-4f8a-b5be-9f655d00950b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:00.228628 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a37c47-6b48-4f8a-b5be-9f655d00950b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:00.229492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a37c47-6b48-4f8a-b5be-9f655d00950b None admin] PATH_INFO: `/v3/projects/service` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:00.236061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a37c47-6b48-4f8a-b5be-9f655d00950b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:00.237521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a37c47-6b48-4f8a-b5be-9f655d00950b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:00.251765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-a8a37c47-6b48-4f8a-b5be-9f655d00950b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:44:00.251765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:00.251765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:44:00.251765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:44:00.251765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:44:00.251765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:44:00.251765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:44:00.251765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:44:00.251765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:44:00.251765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:44:00.251765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:44:00.251765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:44:00.251765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:44:00.251765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:44:00.251765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:44:00.252837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:44:00.254015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:44:00.254015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:44:00.254015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:44:00.254015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:44:00.254015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:44:00.254015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:44:00.254015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:44:00.254015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:44:00.254015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 617/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:44:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:44:00.259559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d373ee-51b0-4376-a38b-fc6512d4558e None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:00.357546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d373ee-51b0-4376-a38b-fc6512d4558e None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:00.391485 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02750a-be53-4918-b4f2-8d787b38c474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:00.392136 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02750a-be53-4918-b4f2-8d787b38c474 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:00.392417 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02750a-be53-4918-b4f2-8d787b38c474 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:00.392692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02750a-be53-4918-b4f2-8d787b38c474 None admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:00.393468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02750a-be53-4918-b4f2-8d787b38c474 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:00.393775 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02750a-be53-4918-b4f2-8d787b38c474 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:00.395243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02750a-be53-4918-b4f2-8d787b38c474 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:00.409933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 642/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:44:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:00.416076 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a37c47-6b48-4f8a-b5be-9f655d00950b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:00.442404 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:00.518425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a37c47-6b48-4f8a-b5be-9f655d00950b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:00.552593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cace3ec-40ff-4b30-8532-47418f418663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:00.553252 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cace3ec-40ff-4b30-8532-47418f418663 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:00.553540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cace3ec-40ff-4b30-8532-47418f418663 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:00.553819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cace3ec-40ff-4b30-8532-47418f418663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:00.554691 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cace3ec-40ff-4b30-8532-47418f418663 None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=394b43cef91f4990b4707cb7a6798068) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:00.555009 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cace3ec-40ff-4b30-8532-47418f418663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:00.556426 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cace3ec-40ff-4b30-8532-47418f418663 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:00.562673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 618/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:44:00 2022] GET /identity/v3/role_assignments?user.id=394b43cef91f4990b4707cb7a6798068&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:02.845334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855c9d5-fbd7-4b0b-bbcb-9f49c008af37 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:02.845920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855c9d5-fbd7-4b0b-bbcb-9f49c008af37 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:02.845920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855c9d5-fbd7-4b0b-bbcb-9f49c008af37 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:02.847290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 643/1261] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:44:02.853922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc5674-d8f2-4c07-9fba-26c2913037f7 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:02.853922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc5674-d8f2-4c07-9fba-26c2913037f7 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:02.853922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc5674-d8f2-4c07-9fba-26c2913037f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:02.871861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-e6cc5674-d8f2-4c07-9fba-26c2913037f7 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:44:02.873087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e6cc5674-d8f2-4c07-9fba-26c2913037f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:44:02.940034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 619/1262] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:44:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:44:02.962860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855c9d5-fbd7-4b0b-bbcb-9f49c008af37 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:02.974196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:03.064137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855c9d5-fbd7-4b0b-bbcb-9f49c008af37 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:03.100858 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273a195-7c44-49d8-87ff-0f9c7a4d6e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:03.101576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a195-7c44-49d8-87ff-0f9c7a4d6e7b None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:03.101861 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a195-7c44-49d8-87ff-0f9c7a4d6e7b None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:03.102140 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273a195-7c44-49d8-87ff-0f9c7a4d6e7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:03.112982 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273a195-7c44-49d8-87ff-0f9c7a4d6e7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-9273a195-7c44-49d8-87ff-0f9c7a4d6e7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:44:03.120717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:44:03.121927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:44:03.123148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:44:03.123148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:44:03.123148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:44:03.123148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:44:03.123148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:44:03.123148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:44:03.123148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:44:03.123148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:44:03.123148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:44:03.123148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:44:03.123148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:44:03.123148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:44:03.123148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 644/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:44:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:44:03.127947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc5674-d8f2-4c07-9fba-26c2913037f7 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:03.146671 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:03.227776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc5674-d8f2-4c07-9fba-26c2913037f7 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:03.261385 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b5923-8ab5-4183-b9ae-dbf69b32416b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:03.262055 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b5923-8ab5-4183-b9ae-dbf69b32416b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:03.262371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b5923-8ab5-4183-b9ae-dbf69b32416b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:03.262657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b5923-8ab5-4183-b9ae-dbf69b32416b None admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:03.263407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b5923-8ab5-4183-b9ae-dbf69b32416b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:03.263720 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b5923-8ab5-4183-b9ae-dbf69b32416b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:03.265156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b5923-8ab5-4183-b9ae-dbf69b32416b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:03.274508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 620/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:44:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:03.279634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273a195-7c44-49d8-87ff-0f9c7a4d6e7b None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:03.346444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:03.378971 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273a195-7c44-49d8-87ff-0f9c7a4d6e7b None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:03.411477 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382775d8-604c-4bd4-86f9-704bc434eb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:03.412302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382775d8-604c-4bd4-86f9-704bc434eb4c None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:03.412587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382775d8-604c-4bd4-86f9-704bc434eb4c None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:03.412862 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382775d8-604c-4bd4-86f9-704bc434eb4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:03.423776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382775d8-604c-4bd4-86f9-704bc434eb4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:03.425218 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382775d8-604c-4bd4-86f9-704bc434eb4c None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:03.442979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-382775d8-604c-4bd4-86f9-704bc434eb4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:44:03.442979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:03.442979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:44:03.442979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:44:03.442979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:44:03.442979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:44:03.442979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:44:03.442979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:44:03.442979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:44:03.442979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:44:03.442979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:44:03.442979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:44:03.442979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:44:03.442979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:44:03.442979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:44:03.448200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:44:03.449407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:44:03.449407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:44:03.449407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:44:03.449407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:44:03.449407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 645/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:44:03.450653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b5923-8ab5-4183-b9ae-dbf69b32416b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:03.539728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:03.559044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b5923-8ab5-4183-b9ae-dbf69b32416b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:03.593429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886e117-d5fd-4844-9b30-75b7b19054bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:03.594080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886e117-d5fd-4844-9b30-75b7b19054bd None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:03.594399 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886e117-d5fd-4844-9b30-75b7b19054bd None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:03.594680 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886e117-d5fd-4844-9b30-75b7b19054bd None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:03.595396 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886e117-d5fd-4844-9b30-75b7b19054bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:03.595789 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886e117-d5fd-4844-9b30-75b7b19054bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:03.597155 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886e117-d5fd-4844-9b30-75b7b19054bd None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:03.609006 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 621/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:03.614893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382775d8-604c-4bd4-86f9-704bc434eb4c None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:03.717839 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382775d8-604c-4bd4-86f9-704bc434eb4c None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:03.737937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:03.752465 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abc047-8afd-4adf-872d-69a871a4e46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:03.753259 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abc047-8afd-4adf-872d-69a871a4e46f None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:03.753541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abc047-8afd-4adf-872d-69a871a4e46f None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:03.753816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abc047-8afd-4adf-872d-69a871a4e46f None admin] PATH_INFO: `/v3/users/placement` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:03.761634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abc047-8afd-4adf-872d-69a871a4e46f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:03.763149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abc047-8afd-4adf-872d-69a871a4e46f None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-b3abc047-8afd-4adf-872d-69a871a4e46f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:44:03.777741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:44:03.781192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:44:03.782200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:44:03.782200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:44:03.782200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:44:03.782200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:44:03.782200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:44:03.782200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:44:03.782200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:44:03.782200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:44:03.782200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 19:44:03.782200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:44:03.782200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 646/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:44:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:44:03.786290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886e117-d5fd-4844-9b30-75b7b19054bd None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:03.886956 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886e117-d5fd-4844-9b30-75b7b19054bd None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:03.919492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02781da9-84ad-4e91-b4b5-6bcf6092b4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:03.920156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02781da9-84ad-4e91-b4b5-6bcf6092b4de None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:03.920440 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02781da9-84ad-4e91-b4b5-6bcf6092b4de None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:03.920716 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02781da9-84ad-4e91-b4b5-6bcf6092b4de None admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:03.921548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02781da9-84ad-4e91-b4b5-6bcf6092b4de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:03.921853 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02781da9-84ad-4e91-b4b5-6bcf6092b4de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:03.923292 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02781da9-84ad-4e91-b4b5-6bcf6092b4de None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:03.932904 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:03.941008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 622/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Fri May 27 19:44:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:03.946688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abc047-8afd-4adf-872d-69a871a4e46f None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:04.047256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abc047-8afd-4adf-872d-69a871a4e46f None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:04.081660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897ff95-d8fe-4df4-92d5-2d8260b4f483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:04.082479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897ff95-d8fe-4df4-92d5-2d8260b4f483 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:04.082766 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897ff95-d8fe-4df4-92d5-2d8260b4f483 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:04.083056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897ff95-d8fe-4df4-92d5-2d8260b4f483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:04.093906 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897ff95-d8fe-4df4-92d5-2d8260b4f483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:04.095367 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897ff95-d8fe-4df4-92d5-2d8260b4f483 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:04.112381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-b897ff95-d8fe-4df4-92d5-2d8260b4f483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:44:04.112381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:04.112381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:44:04.112381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:44:04.112381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:44:04.112381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:44:04.112381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:44:04.112381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:44:04.112381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:44:04.112381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:44:04.112381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:44:04.112381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:44:04.112381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:44:04.112381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:44:04.112381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:44:04.113436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:44:04.114645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:44:04.114645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:44:04.114645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:44:04.114645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:44:04.114645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 647/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:44:04.119326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02781da9-84ad-4e91-b4b5-6bcf6092b4de None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:04.220085 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02781da9-84ad-4e91-b4b5-6bcf6092b4de None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:04.255912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d70f-3cc3-4ee5-85c2-9f50485e231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:04.256578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d70f-3cc3-4ee5-85c2-9f50485e231d None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:04.256870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d70f-3cc3-4ee5-85c2-9f50485e231d None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:04.257155 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3d70f-3cc3-4ee5-85c2-9f50485e231d None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:04.257880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3d70f-3cc3-4ee5-85c2-9f50485e231d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:04.258194 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3d70f-3cc3-4ee5-85c2-9f50485e231d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:04.259699 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3d70f-3cc3-4ee5-85c2-9f50485e231d None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:04.271121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 623/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:04.277009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897ff95-d8fe-4df4-92d5-2d8260b4f483 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:04.310488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:04.375918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897ff95-d8fe-4df4-92d5-2d8260b4f483 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:04.409973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd928b-15a0-4a55-8422-a5f05b8d43f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:04.410787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd928b-15a0-4a55-8422-a5f05b8d43f8 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:04.411073 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd928b-15a0-4a55-8422-a5f05b8d43f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:04.411351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd928b-15a0-4a55-8422-a5f05b8d43f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:04.418781 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd928b-15a0-4a55-8422-a5f05b8d43f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:04.420408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd928b-15a0-4a55-8422-a5f05b8d43f8 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:04.435176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-e1fd928b-15a0-4a55-8422-a5f05b8d43f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:44:04.435176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:04.435176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:44:04.435176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:44:04.435176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:44:04.435176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:44:04.435176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:44:04.435176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:44:04.435176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:44:04.435176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:44:04.435176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:44:04.435176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:44:04.435176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:44:04.435176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:44:04.435176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:44:04.436270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:44:04.437478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:44:04.437478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:44:04.437478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:44:04.437478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:44:04.437478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:44:04.437478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:44:04.437478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:44:04.437478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:44:04.437478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 648/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:44:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:44:04.442287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d70f-3cc3-4ee5-85c2-9f50485e231d None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:04.512535 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:04.553560 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3d70f-3cc3-4ee5-85c2-9f50485e231d None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:04.589476 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab168b-17f4-4463-b8ce-89791750b372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:04.590077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab168b-17f4-4463-b8ce-89791750b372 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:04.590392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab168b-17f4-4463-b8ce-89791750b372 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:04.590679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab168b-17f4-4463-b8ce-89791750b372 None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:04.591463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab168b-17f4-4463-b8ce-89791750b372 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:04.591780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab168b-17f4-4463-b8ce-89791750b372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:04.593252 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab168b-17f4-4463-b8ce-89791750b372 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:04.605593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 624/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:44:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:04.611549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd928b-15a0-4a55-8422-a5f05b8d43f8 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:04.702233 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:04.710718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd928b-15a0-4a55-8422-a5f05b8d43f8 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:04.743312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe98f66-04ca-4843-98f0-a245eca0962d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:04.744787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe98f66-04ca-4843-98f0-a245eca0962d None admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:04.745076 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe98f66-04ca-4843-98f0-a245eca0962d None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:04.745354 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe98f66-04ca-4843-98f0-a245eca0962d None admin] PATH_INFO: `/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/394b43cef91f4990b4707cb7a6798068/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:04.747359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe98f66-04ca-4843-98f0-a245eca0962d None admin] RBAC: Authorizing `identity:create_grant(project_id=400421f9ccc6478783fa6bbc822b0687, user_id=394b43cef91f4990b4707cb7a6798068, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:04.748816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe98f66-04ca-4843-98f0-a245eca0962d None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:04.890650 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 649/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Fri May 27 19:44:04 2022] PUT /identity/v3/projects/400421f9ccc6478783fa6bbc822b0687/users/394b43cef91f4990b4707cb7a6798068/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:44:07.071587 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560457ad-d090-4295-b06a-7cf8d7a3c3c5 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:07.072215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560457ad-d090-4295-b06a-7cf8d7a3c3c5 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:07.072215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560457ad-d090-4295-b06a-7cf8d7a3c3c5 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:07.073597 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 625/1274] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:44:07.078731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd7eff-8b25-472d-b5a1-28ad15a7216e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:07.079172 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd7eff-8b25-472d-b5a1-28ad15a7216e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:07.079296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd7eff-8b25-472d-b5a1-28ad15a7216e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:07.096717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-2ffd7eff-8b25-472d-b5a1-28ad15a7216e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:44:07.097994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2ffd7eff-8b25-472d-b5a1-28ad15a7216e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:44:07.164016 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 650/1275] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:44:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:44:07.187854 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560457ad-d090-4295-b06a-7cf8d7a3c3c5 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:07.290647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560457ad-d090-4295-b06a-7cf8d7a3c3c5 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:07.309062 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:07.325950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814eefc8-6c31-401b-9dc4-2fb98c0d65a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:07.326688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814eefc8-6c31-401b-9dc4-2fb98c0d65a7 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:07.326976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814eefc8-6c31-401b-9dc4-2fb98c0d65a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:07.327256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814eefc8-6c31-401b-9dc4-2fb98c0d65a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:07.336997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814eefc8-6c31-401b-9dc4-2fb98c0d65a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-814eefc8-6c31-401b-9dc4-2fb98c0d65a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 19:44:07.345054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:44:07.346189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:44:07.347389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:44:07.347389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:44:07.347389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:44:07.347389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:44:07.347389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 19:44:07.347389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 19:44:07.347389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 19:44:07.347389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 19:44:07.347389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 19:44:07.347389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 19:44:07.347389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 19:44:07.347389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:44:07.347389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 626/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Fri May 27 19:44:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:44:07.352114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd7eff-8b25-472d-b5a1-28ad15a7216e None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:07.433394 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:07.451182 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd7eff-8b25-472d-b5a1-28ad15a7216e None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:07.484876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef566b03-3135-4a1d-bfcb-d5771e7a8b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:07.485552 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef566b03-3135-4a1d-bfcb-d5771e7a8b11 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:07.485836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef566b03-3135-4a1d-bfcb-d5771e7a8b11 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:07.486114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef566b03-3135-4a1d-bfcb-d5771e7a8b11 None admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:07.486890 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef566b03-3135-4a1d-bfcb-d5771e7a8b11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:07.487197 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef566b03-3135-4a1d-bfcb-d5771e7a8b11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:07.488648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef566b03-3135-4a1d-bfcb-d5771e7a8b11 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:07.497442 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 651/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Fri May 27 19:44:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:07.503226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814eefc8-6c31-401b-9dc4-2fb98c0d65a7 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:07.606015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814eefc8-6c31-401b-9dc4-2fb98c0d65a7 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:07.639701 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd17c4-bb32-407c-8084-c46b87c3fb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:07.640494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd17c4-bb32-407c-8084-c46b87c3fb15 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:07.640805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd17c4-bb32-407c-8084-c46b87c3fb15 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:07.641137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd17c4-bb32-407c-8084-c46b87c3fb15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:07.651747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd17c4-bb32-407c-8084-c46b87c3fb15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:07.653188 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd17c4-bb32-407c-8084-c46b87c3fb15 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:07.670318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-ffcd17c4-bb32-407c-8084-c46b87c3fb15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:44:07.670318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:07.670318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:44:07.670318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:44:07.670318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:44:07.670318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:44:07.670318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:44:07.670318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:44:07.670318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:44:07.670318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:44:07.670318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:44:07.670318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:44:07.670318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:44:07.670318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:44:07.670318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:44:07.671393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:44:07.672458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:44:07.672458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:44:07.672458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:44:07.672458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:44:07.672458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 627/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:44:07.677458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef566b03-3135-4a1d-bfcb-d5771e7a8b11 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:07.777068 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef566b03-3135-4a1d-bfcb-d5771e7a8b11 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:07.810876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd6602-e0b9-4d5b-b052-84049f9123a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:07.811532 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd6602-e0b9-4d5b-b052-84049f9123a7 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:07.811817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd6602-e0b9-4d5b-b052-84049f9123a7 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:07.812094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd6602-e0b9-4d5b-b052-84049f9123a7 None admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:07.812807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd6602-e0b9-4d5b-b052-84049f9123a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:07.813112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd6602-e0b9-4d5b-b052-84049f9123a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:07.814596 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd6602-e0b9-4d5b-b052-84049f9123a7 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:07.827448 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 652/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:07.833087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd17c4-bb32-407c-8084-c46b87c3fb15 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:07.865040 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:07.936417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd17c4-bb32-407c-8084-c46b87c3fb15 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:07.977751 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16b7c9-4a3a-40b5-b03b-27f3eead4e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:07.979169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16b7c9-4a3a-40b5-b03b-27f3eead4e39 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:07.981982 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16b7c9-4a3a-40b5-b03b-27f3eead4e39 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:07.981982 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16b7c9-4a3a-40b5-b03b-27f3eead4e39 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:07.988511 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16b7c9-4a3a-40b5-b03b-27f3eead4e39 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:07.989986 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16b7c9-4a3a-40b5-b03b-27f3eead4e39 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-1e16b7c9-4a3a-40b5-b03b-27f3eead4e39 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 19:44:08.008357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:44:08.010034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:44:08.011192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:44:08.011192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:44:08.011192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 19:44:08.011192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 19:44:08.011192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 19:44:08.011192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 19:44:08.011192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 19:44:08.011192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 19:44:08.011192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 19:44:08.011192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:44:08.011192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 628/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:44:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:44:08.016230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd6602-e0b9-4d5b-b052-84049f9123a7 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:08.020254 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:08.126698 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd6602-e0b9-4d5b-b052-84049f9123a7 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:08.164354 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab79365-468a-4964-b8a0-a24c112c4abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:08.165050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab79365-468a-4964-b8a0-a24c112c4abd None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:08.165339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab79365-468a-4964-b8a0-a24c112c4abd None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:08.165622 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab79365-468a-4964-b8a0-a24c112c4abd None admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:08.166517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab79365-468a-4964-b8a0-a24c112c4abd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:08.166836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab79365-468a-4964-b8a0-a24c112c4abd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:08.168323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab79365-468a-4964-b8a0-a24c112c4abd None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:08.188138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 653/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Fri May 27 19:44:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:08.194500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16b7c9-4a3a-40b5-b03b-27f3eead4e39 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:08.291547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:08.301306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16b7c9-4a3a-40b5-b03b-27f3eead4e39 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:08.337286 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909899e0-a315-4984-a875-76705ea2a99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:08.338540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909899e0-a315-4984-a875-76705ea2a99b None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:08.338883 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909899e0-a315-4984-a875-76705ea2a99b None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:08.339210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909899e0-a315-4984-a875-76705ea2a99b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:08.410595 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909899e0-a315-4984-a875-76705ea2a99b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:08.411982 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909899e0-a315-4984-a875-76705ea2a99b None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:08.501101 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:08.511274 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 629/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Fri May 27 19:44:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 19:44:08.517124 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab79365-468a-4964-b8a0-a24c112c4abd None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:08.578011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:08.614009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab79365-468a-4964-b8a0-a24c112c4abd None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:08.647693 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22a450-5f4d-4ec3-b7ff-e7a235e8badb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:08.648482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22a450-5f4d-4ec3-b7ff-e7a235e8badb None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:08.648770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22a450-5f4d-4ec3-b7ff-e7a235e8badb None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:08.649051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22a450-5f4d-4ec3-b7ff-e7a235e8badb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:08.659077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22a450-5f4d-4ec3-b7ff-e7a235e8badb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:08.660518 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a22a450-5f4d-4ec3-b7ff-e7a235e8badb None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:08.677331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-3a22a450-5f4d-4ec3-b7ff-e7a235e8badb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:44:08.677331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:08.677331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:44:08.677331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:44:08.677331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:44:08.677331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:44:08.677331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:44:08.677331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:44:08.677331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:44:08.677331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:44:08.677331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:44:08.677331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:44:08.677331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 19:44:08.677331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 19:44:08.677331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:44:08.678416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:44:08.684252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 19:44:08.684252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 19:44:08.684252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 19:44:08.684252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:44:08.684252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 654/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:44:08.684834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909899e0-a315-4984-a875-76705ea2a99b None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:08.783995 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909899e0-a315-4984-a875-76705ea2a99b None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:08.819542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697c6c6-3ec9-4c76-abc4-ba51cbb70e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:08.820273 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c6c6-3ec9-4c76-abc4-ba51cbb70e32 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:08.820490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c6c6-3ec9-4c76-abc4-ba51cbb70e32 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:08.820771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697c6c6-3ec9-4c76-abc4-ba51cbb70e32 None admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:08.821491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697c6c6-3ec9-4c76-abc4-ba51cbb70e32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:08.822421 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697c6c6-3ec9-4c76-abc4-ba51cbb70e32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:08.823786 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697c6c6-3ec9-4c76-abc4-ba51cbb70e32 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:08.835459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 630/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Fri May 27 19:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:08.842389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22a450-5f4d-4ec3-b7ff-e7a235e8badb None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:08.938920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22a450-5f4d-4ec3-b7ff-e7a235e8badb None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:08.953572 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:08.973623 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84422b-b266-4af6-a7ad-50d11ebfd419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:08.974442 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84422b-b266-4af6-a7ad-50d11ebfd419 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:08.974730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84422b-b266-4af6-a7ad-50d11ebfd419 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:08.975007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84422b-b266-4af6-a7ad-50d11ebfd419 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:08.981408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84422b-b266-4af6-a7ad-50d11ebfd419 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:08.982887 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84422b-b266-4af6-a7ad-50d11ebfd419 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:08.997450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application [None req-cc84422b-b266-4af6-a7ad-50d11ebfd419 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:44:08.997450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:08.997450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:44:08.997450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:44:08.997450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:44:08.997450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:44:08.997450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:44:08.997450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:44:08.997450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:44:08.997450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:44:08.997450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:44:08.997450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:44:08.997450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 19:44:08.997450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 19:44:08.997450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application with Lock( May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._enter() May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.creator() May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:44:08.998555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application created_value = creator( May 27 19:44:08.999706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 19:44:08.999706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 19:44:08.999706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 19:44:08.999706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 19:44:08.999706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 19:44:08.999706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 19:44:08.999706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 19:44:08.999706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: ERROR keystone.server.flask.application May 27 19:44:08.999706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 655/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Fri May 27 19:44:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:44:09.004540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697c6c6-3ec9-4c76-abc4-ba51cbb70e32 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:09.055332 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:09.104523 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697c6c6-3ec9-4c76-abc4-ba51cbb70e32 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:09.137495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b3e57-8d91-4023-974e-3d396279d267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:09.138144 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b3e57-8d91-4023-974e-3d396279d267 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:09.138479 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b3e57-8d91-4023-974e-3d396279d267 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:09.138776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b3e57-8d91-4023-974e-3d396279d267 None admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:09.139605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b3e57-8d91-4023-974e-3d396279d267 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:09.139912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b3e57-8d91-4023-974e-3d396279d267 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:09.141326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b3e57-8d91-4023-974e-3d396279d267 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:09.154334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 631/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Fri May 27 19:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 19:44:09.161134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84422b-b266-4af6-a7ad-50d11ebfd419 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:09.259869 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84422b-b266-4af6-a7ad-50d11ebfd419 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:09.293478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e8f0f-2c02-4069-bb25-f824b4b3b9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:09.294132 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e8f0f-2c02-4069-bb25-f824b4b3b9b6 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:09.294452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e8f0f-2c02-4069-bb25-f824b4b3b9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:09.294740 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e8f0f-2c02-4069-bb25-f824b4b3b9b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:09.295567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e8f0f-2c02-4069-bb25-f824b4b3b9b6 None admin] RBAC: Adding query filter params (role.id=f84a80003ff94ef98290ceaeb0ef7c65, scope.project.id=400421f9ccc6478783fa6bbc822b0687, user.id=394b43cef91f4990b4707cb7a6798068) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:09.295884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e8f0f-2c02-4069-bb25-f824b4b3b9b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:09.297315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e8f0f-2c02-4069-bb25-f824b4b3b9b6 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:09.303057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 656/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Fri May 27 19:44:09 2022] GET /identity/v3/role_assignments?user.id=394b43cef91f4990b4707cb7a6798068&scope.project.id=400421f9ccc6478783fa6bbc822b0687&role.id=f84a80003ff94ef98290ceaeb0ef7c65 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:11.506093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55f3e0-cb25-4bc7-858f-81eabba4fc40 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:11.506616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55f3e0-cb25-4bc7-858f-81eabba4fc40 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:11.506710 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55f3e0-cb25-4bc7-858f-81eabba4fc40 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:11.508052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 632/1288] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:44:11.513276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f44171-cd7d-4d6a-b7ad-78703c72cb32 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:11.513731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f44171-cd7d-4d6a-b7ad-78703c72cb32 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:11.513822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f44171-cd7d-4d6a-b7ad-78703c72cb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:11.530909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c1f44171-cd7d-4d6a-b7ad-78703c72cb32 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:44:11.532383 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c1f44171-cd7d-4d6a-b7ad-78703c72cb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:44:11.563003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:11.600367 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 657/1289] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:44:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:44:11.624403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55f3e0-cb25-4bc7-858f-81eabba4fc40 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:11.724257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55f3e0-cb25-4bc7-858f-81eabba4fc40 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:11.735393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:11.758475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688b7e0-0f75-4144-9a8e-451d7c432e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:11.760031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688b7e0-0f75-4144-9a8e-451d7c432e98 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:11.760031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688b7e0-0f75-4144-9a8e-451d7c432e98 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:11.760031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688b7e0-0f75-4144-9a8e-451d7c432e98 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:11.760584 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688b7e0-0f75-4144-9a8e-451d7c432e98 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:11.761943 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688b7e0-0f75-4144-9a8e-451d7c432e98 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-0688b7e0-0f75-4144-9a8e-451d7c432e98 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:44:11.773437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:44:11.774743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:44:11.775815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:44:11.775815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:44:11.775815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:44:11.775815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:44:11.775815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:44:11.775815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:44:11.775815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:44:11.775815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:44:11.775815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:44:11.775815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:44:11.775815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:44:11.775815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:44:11.775815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 19:44:11.775815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:44:11.775815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 633/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Fri May 27 19:44:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:44:11.780904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f44171-cd7d-4d6a-b7ad-78703c72cb32 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:11.877781 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f44171-cd7d-4d6a-b7ad-78703c72cb32 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:11.910303 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b02bbe-4f2d-415c-b161-4cf64fb531d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:11.910986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b02bbe-4f2d-415c-b161-4cf64fb531d0 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:11.911273 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b02bbe-4f2d-415c-b161-4cf64fb531d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:11.911551 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b02bbe-4f2d-415c-b161-4cf64fb531d0 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:11.912260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b02bbe-4f2d-415c-b161-4cf64fb531d0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:11.912570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b02bbe-4f2d-415c-b161-4cf64fb531d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:11.913950 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b02bbe-4f2d-415c-b161-4cf64fb531d0 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:11.919201 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 658/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Fri May 27 19:44:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:11.925496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688b7e0-0f75-4144-9a8e-451d7c432e98 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:12.027241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688b7e0-0f75-4144-9a8e-451d7c432e98 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:12.061643 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f25a6b-53de-4709-a847-c4d807d1c124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:12.062302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f25a6b-53de-4709-a847-c4d807d1c124 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:12.062620 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f25a6b-53de-4709-a847-c4d807d1c124 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:12.062900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f25a6b-53de-4709-a847-c4d807d1c124 None admin] PATH_INFO: `/v3/services` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:12.063597 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f25a6b-53de-4709-a847-c4d807d1c124 None admin] RBAC: Adding query filter params (type=placement) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:12.063905 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f25a6b-53de-4709-a847-c4d807d1c124 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:12.065328 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f25a6b-53de-4709-a847-c4d807d1c124 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:12.069698 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 634/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Fri May 27 19:44:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:14.282783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5fe5f-828b-4f24-852e-a34cf3d3d4f8 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:14.283346 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5fe5f-828b-4f24-852e-a34cf3d3d4f8 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:14.283346 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5fe5f-828b-4f24-852e-a34cf3d3d4f8 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:14.284736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 659/1293] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:44:14.289803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86155-0e0e-42a9-88f6-3dab58745199 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:14.290179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86155-0e0e-42a9-88f6-3dab58745199 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:14.290936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b86155-0e0e-42a9-88f6-3dab58745199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:14.308012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-56b86155-0e0e-42a9-88f6-3dab58745199 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:44:14.309178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-56b86155-0e0e-42a9-88f6-3dab58745199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:44:14.338436 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:14.374402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 635/1294] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:44:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:44:14.397222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5fe5f-828b-4f24-852e-a34cf3d3d4f8 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:14.429422 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:14.497874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5fe5f-828b-4f24-852e-a34cf3d3d4f8 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:14.530690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c3ebd-8df7-45fc-be4f-29b1d5582250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:14.531350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c3ebd-8df7-45fc-be4f-29b1d5582250 None admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:14.531639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c3ebd-8df7-45fc-be4f-29b1d5582250 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:14.531920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c3ebd-8df7-45fc-be4f-29b1d5582250 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:14.537108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c3ebd-8df7-45fc-be4f-29b1d5582250 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:14.537108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c3ebd-8df7-45fc-be4f-29b1d5582250 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:14.613473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 660/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Fri May 27 19:44:14 2022] POST /identity/v3/services => generated 246 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:44:16.808668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171fff8-035e-4ae2-bbb6-882c0348fcf3 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:16.809185 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171fff8-035e-4ae2-bbb6-882c0348fcf3 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:16.809299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171fff8-035e-4ae2-bbb6-882c0348fcf3 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:16.810619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 636/1296] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:44:16.815861 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60522014-532e-40c6-bf26-a2c47a575c48 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:16.820971 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60522014-532e-40c6-bf26-a2c47a575c48 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:16.820971 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60522014-532e-40c6-bf26-a2c47a575c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:16.833133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-60522014-532e-40c6-bf26-a2c47a575c48 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:44:16.834326 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-60522014-532e-40c6-bf26-a2c47a575c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:44:16.906894 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 661/1297] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:44:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:44:16.930612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171fff8-035e-4ae2-bbb6-882c0348fcf3 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:17.032637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171fff8-035e-4ae2-bbb6-882c0348fcf3 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:17.067465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510c8d1-e74f-4d4b-bdf2-a053e2df7488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:17.067465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510c8d1-e74f-4d4b-bdf2-a053e2df7488 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:17.067465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510c8d1-e74f-4d4b-bdf2-a053e2df7488 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:17.067465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510c8d1-e74f-4d4b-bdf2-a053e2df7488 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:17.068000 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510c8d1-e74f-4d4b-bdf2-a053e2df7488 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:17.068498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510c8d1-e74f-4d4b-bdf2-a053e2df7488 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-9510c8d1-e74f-4d4b-bdf2-a053e2df7488 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:44:17.080678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:44:17.081843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:44:17.083070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:44:17.083070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:44:17.083070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:44:17.083070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:44:17.083070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:44:17.083070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:44:17.083070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:44:17.083070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:44:17.083070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:44:17.083070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:44:17.083070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:44:17.083070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:44:17.083070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 19:44:17.083070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:44:17.083070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 637/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Fri May 27 19:44:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:44:17.088595 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60522014-532e-40c6-bf26-a2c47a575c48 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:17.107095 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:17.187193 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60522014-532e-40c6-bf26-a2c47a575c48 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:17.219753 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f784a4-bef5-4481-af89-816a95431f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:17.220419 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f784a4-bef5-4481-af89-816a95431f31 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:17.220709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f784a4-bef5-4481-af89-816a95431f31 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:17.220992 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f784a4-bef5-4481-af89-816a95431f31 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:17.221704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f784a4-bef5-4481-af89-816a95431f31 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:17.222017 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f784a4-bef5-4481-af89-816a95431f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:17.223429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f784a4-bef5-4481-af89-816a95431f31 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:17.229036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 662/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Fri May 27 19:44:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:17.235040 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510c8d1-e74f-4d4b-bdf2-a053e2df7488 None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:17.266926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:17.335442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510c8d1-e74f-4d4b-bdf2-a053e2df7488 None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:17.371111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d7c5a-ac8c-4a98-8e69-5709e5ac4822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:17.371764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d7c5a-ac8c-4a98-8e69-5709e5ac4822 None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:17.372050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d7c5a-ac8c-4a98-8e69-5709e5ac4822 None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:17.372329 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d7c5a-ac8c-4a98-8e69-5709e5ac4822 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:17.373111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d7c5a-ac8c-4a98-8e69-5709e5ac4822 None admin] RBAC: Adding query filter params (interface=public, service_id=dbf49e67fb6049d7a9ec76c154ab53d9, region_id=RegionOne) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:17.373461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d7c5a-ac8c-4a98-8e69-5709e5ac4822 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:17.374852 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d7c5a-ac8c-4a98-8e69-5709e5ac4822 None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:17.379844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 638/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Fri May 27 19:44:17 2022] GET /identity/v3/endpoints?service_id=dbf49e67fb6049d7a9ec76c154ab53d9&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:17.386046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f784a4-bef5-4481-af89-816a95431f31 None admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:17.466525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:17.484093 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f784a4-bef5-4481-af89-816a95431f31 None admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:17.518284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6f145-0052-4893-b658-b503de63c012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:17.518981 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6f145-0052-4893-b658-b503de63c012 None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:17.519268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6f145-0052-4893-b658-b503de63c012 None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:17.519549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6f145-0052-4893-b658-b503de63c012 None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:17.520232 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6f145-0052-4893-b658-b503de63c012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:17.521607 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6f145-0052-4893-b658-b503de63c012 None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:17.528250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 663/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Fri May 27 19:44:17 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:44:19.744487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de384215-b8d1-49dc-aac2-bd58e58affb6 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:19.745044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de384215-b8d1-49dc-aac2-bd58e58affb6 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:19.745044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de384215-b8d1-49dc-aac2-bd58e58affb6 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:19.746490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 639/1302] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:44:19.751816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edec88f-2bb5-487f-bff7-f7f3c5fcdd36 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:19.752207 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edec88f-2bb5-487f-bff7-f7f3c5fcdd36 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:19.752374 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edec88f-2bb5-487f-bff7-f7f3c5fcdd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:19.768985 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-0edec88f-2bb5-487f-bff7-f7f3c5fcdd36 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:44:19.770149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-0edec88f-2bb5-487f-bff7-f7f3c5fcdd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:44:19.838917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 664/1303] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:44:19 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 19:44:19.863248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de384215-b8d1-49dc-aac2-bd58e58affb6 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:19.959419 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:19.966661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de384215-b8d1-49dc-aac2-bd58e58affb6 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:20.001481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a0a8c-b06f-4531-ab17-238bd731f0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:20.002210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a0a8c-b06f-4531-ab17-238bd731f0bd None admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:20.002529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a0a8c-b06f-4531-ab17-238bd731f0bd None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:20.002813 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a0a8c-b06f-4531-ab17-238bd731f0bd None admin] PATH_INFO: `/v3/services/placement` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:20.003471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a0a8c-b06f-4531-ab17-238bd731f0bd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:20.004842 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a0a8c-b06f-4531-ab17-238bd731f0bd None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application [None req-226a0a8c-b06f-4531-ab17-238bd731f0bd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 19:44:20.017256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 19:44:20.018470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.get_or_create( May 27 19:44:20.019502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 19:44:20.019502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application with Lock( May 27 19:44:20.019502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 19:44:20.019502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self._enter() May 27 19:44:20.019502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 19:44:20.019502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 19:44:20.019502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 19:44:20.019502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application return self.creator() May 27 19:44:20.019502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 19:44:20.019502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application created_value = creator( May 27 19:44:20.019502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 19:44:20.019502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 19:44:20.019502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 19:44:20.019502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: ERROR keystone.server.flask.application May 27 19:44:20.019502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 640/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Fri May 27 19:44:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 19:44:20.026199 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edec88f-2bb5-487f-bff7-f7f3c5fcdd36 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:20.109754 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:20.134050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edec88f-2bb5-487f-bff7-f7f3c5fcdd36 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:20.169349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d18af-79a4-445e-a342-812c6b436bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:20.170016 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d18af-79a4-445e-a342-812c6b436bfc None admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:20.170301 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d18af-79a4-445e-a342-812c6b436bfc None admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:20.170600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d18af-79a4-445e-a342-812c6b436bfc None admin] PATH_INFO: `/v3/services` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:20.171409 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d18af-79a4-445e-a342-812c6b436bfc None admin] RBAC: Adding query filter params (name=placement) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:44:20.171724 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d18af-79a4-445e-a342-812c6b436bfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:20.173093 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d18af-79a4-445e-a342-812c6b436bfc None admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:20.178287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 665/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Fri May 27 19:44:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:44:20.184709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a0a8c-b06f-4531-ab17-238bd731f0bd None admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:44:20.285510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a0a8c-b06f-4531-ab17-238bd731f0bd None admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:44:20.320570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994534a-7cec-4eef-ac14-f47d261de9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:44:20.321234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994534a-7cec-4eef-ac14-f47d261de9cf None admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:44:20.321521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994534a-7cec-4eef-ac14-f47d261de9cf None admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:44:20.321802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994534a-7cec-4eef-ac14-f47d261de9cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:44:20.322612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994534a-7cec-4eef-ac14-f47d261de9cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:44:20.323979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994534a-7cec-4eef-ac14-f47d261de9cf None admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:44:20.404599 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 641/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Fri May 27 19:44:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:44:30.175156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=30 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:44:30.399403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:45.033695 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3947f-e6fc-461c-9919-335508df58a7 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:45.034785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3947f-e6fc-461c-9919-335508df58a7 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:45.035556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3947f-e6fc-461c-9919-335508df58a7 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:45.038856 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 666/1307] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:50:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:50:45.042874 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd103411-cea0-4338-97e8-186b8d9eb6df None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:45.043601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd103411-cea0-4338-97e8-186b8d9eb6df None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:45.043601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd103411-cea0-4338-97e8-186b8d9eb6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:45.158886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-bd103411-cea0-4338-97e8-186b8d9eb6df None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:50:45.162748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-bd103411-cea0-4338-97e8-186b8d9eb6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:50:45.402376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 642/1308] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:50:45.441996 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea102d5-1d45-4a96-b1a4-0b447ee7129d None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:45.442550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea102d5-1d45-4a96-b1a4-0b447ee7129d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:45.442901 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea102d5-1d45-4a96-b1a4-0b447ee7129d None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:45.444308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 667/1309] 10.222.0.15 () {54 vars in 964 bytes} [Fri May 27 19:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:50:45.451059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b37c7a-5894-48eb-861e-45bcb7913515 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:45.451385 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b37c7a-5894-48eb-861e-45bcb7913515 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:45.451672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b37c7a-5894-48eb-861e-45bcb7913515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:45.543650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-06b37c7a-5894-48eb-861e-45bcb7913515 None None] MFA Rules not processed for user `af7e51b89f4c4dcc9963061e6e509eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:50:45.544894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-06b37c7a-5894-48eb-861e-45bcb7913515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:50:45.569382 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:45.655950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 643/1310] 10.222.0.15 () {58 vars in 1061 bytes} [Fri May 27 19:50:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:50:45.666702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea102d5-1d45-4a96-b1a4-0b447ee7129d None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:50:45.670514 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-3ea102d5-1d45-4a96-b1a4-0b447ee7129d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:50:45.802279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea102d5-1d45-4a96-b1a4-0b447ee7129d None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:50:45.883961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce13e28-f738-4605-be1d-5e56232558ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:50:45.885012 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce13e28-f738-4605-be1d-5e56232558ce service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:45.885545 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce13e28-f738-4605-be1d-5e56232558ce service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:45.886067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce13e28-f738-4605-be1d-5e56232558ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:45.887999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4ce13e28-f738-4605-be1d-5e56232558ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:50:45.961971 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:46.027933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce13e28-f738-4605-be1d-5e56232558ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:50:46.029452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce13e28-f738-4605-be1d-5e56232558ce service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:50:46.055589 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 668/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:50:48.637831 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af4a5c-84a3-4146-8d54-575276f47cd6 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:48.638475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af4a5c-84a3-4146-8d54-575276f47cd6 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:48.638475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af4a5c-84a3-4146-8d54-575276f47cd6 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:48.643335 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 644/1312] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:50:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:50:48.646391 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dbd25-9551-4a9f-b1c1-ca57cabcd7fd None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:48.646886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dbd25-9551-4a9f-b1c1-ca57cabcd7fd None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:48.647098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dbd25-9551-4a9f-b1c1-ca57cabcd7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:48.739858 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e70dbd25-9551-4a9f-b1c1-ca57cabcd7fd None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:50:48.741115 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e70dbd25-9551-4a9f-b1c1-ca57cabcd7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:50:48.857477 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 669/1313] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:50:48.895097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af4a5c-84a3-4146-8d54-575276f47cd6 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:50:48.896722 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-91af4a5c-84a3-4146-8d54-575276f47cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:50:49.023166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af4a5c-84a3-4146-8d54-575276f47cd6 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:50:49.117507 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:49.120629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf89923-3beb-429e-9e9b-516b9ec89e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:50:49.121310 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf89923-3beb-429e-9e9b-516b9ec89e41 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:49.121592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf89923-3beb-429e-9e9b-516b9ec89e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:49.121875 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf89923-3beb-429e-9e9b-516b9ec89e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:49.123645 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4bf89923-3beb-429e-9e9b-516b9ec89e41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:50:49.268094 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf89923-3beb-429e-9e9b-516b9ec89e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:50:49.269563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf89923-3beb-429e-9e9b-516b9ec89e41 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:50:49.291914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 645/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:50:52.087204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693edc-3705-4c09-adb9-f440f2ec9157 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:52.087824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693edc-3705-4c09-adb9-f440f2ec9157 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:52.087824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2693edc-3705-4c09-adb9-f440f2ec9157 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:52.089119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 670/1315] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:50:52.094886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ceb7a5-4e93-4afc-85f2-8802d9edc5c0 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:52.095370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ceb7a5-4e93-4afc-85f2-8802d9edc5c0 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:52.095490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ceb7a5-4e93-4afc-85f2-8802d9edc5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:52.167442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-d1ceb7a5-4e93-4afc-85f2-8802d9edc5c0 None None] MFA Rules not processed for user `068f43858bd84ea9a8a4bd23968f5df6`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:50:52.168691 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d1ceb7a5-4e93-4afc-85f2-8802d9edc5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:50:52.223796 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:52.279791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 646/1316] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:50:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:50:52.319998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2693edc-3705-4c09-adb9-f440f2ec9157 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:50:52.321579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a2693edc-3705-4c09-adb9-f440f2ec9157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:50:52.332274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:52.428658 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2693edc-3705-4c09-adb9-f440f2ec9157 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:50:52.503914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0b92b-26a3-4214-b0b9-8e6b3f626fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:50:52.504564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0b92b-26a3-4214-b0b9-8e6b3f626fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:52.504848 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0b92b-26a3-4214-b0b9-8e6b3f626fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:52.505124 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0b92b-26a3-4214-b0b9-8e6b3f626fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:52.506816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-66f0b92b-26a3-4214-b0b9-8e6b3f626fb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:50:52.570755 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:52.617229 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0b92b-26a3-4214-b0b9-8e6b3f626fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:50:52.618794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0b92b-26a3-4214-b0b9-8e6b3f626fb4 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:50:52.638257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 671/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:50:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:50:55.685277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722224a6-64f8-4d69-a721-9ade3f8542be None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:55.685840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722224a6-64f8-4d69-a721-9ade3f8542be None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:55.685938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722224a6-64f8-4d69-a721-9ade3f8542be None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:55.687292 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 647/1318] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:50:55.693169 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb741444-2b07-40c6-be3c-9e7715243124 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:55.693659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb741444-2b07-40c6-be3c-9e7715243124 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:55.693754 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb741444-2b07-40c6-be3c-9e7715243124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:55.760556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-fb741444-2b07-40c6-be3c-9e7715243124 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:50:55.761673 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-fb741444-2b07-40c6-be3c-9e7715243124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:50:55.863007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 672/1319] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:50:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:50:55.918696 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c20d8-c5d2-4ecd-8749-049f1eefeba2 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:55.918994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c20d8-c5d2-4ecd-8749-049f1eefeba2 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:55.919280 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c20d8-c5d2-4ecd-8749-049f1eefeba2 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:55.920680 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 648/1320] 10.222.0.15 () {54 vars in 964 bytes} [Fri May 27 19:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:50:55.927135 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cf47e-8667-4cbf-bb47-a3cb0d436a55 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:55.927412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cf47e-8667-4cbf-bb47-a3cb0d436a55 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:55.927695 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cf47e-8667-4cbf-bb47-a3cb0d436a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:55.957000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:56.019110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a66cf47e-8667-4cbf-bb47-a3cb0d436a55 None None] MFA Rules not processed for user `af7e51b89f4c4dcc9963061e6e509eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:50:56.020275 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a66cf47e-8667-4cbf-bb47-a3cb0d436a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:50:56.095975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 673/1321] 10.222.0.15 () {58 vars in 1061 bytes} [Fri May 27 19:50:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:50:56.105004 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c20d8-c5d2-4ecd-8749-049f1eefeba2 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:50:56.106674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-7a4c20d8-c5d2-4ecd-8749-049f1eefeba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:50:56.215175 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c20d8-c5d2-4ecd-8749-049f1eefeba2 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:50:56.292563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad8b3b-49b5-446d-8fc8-1f44a1a15823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:50:56.293226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad8b3b-49b5-446d-8fc8-1f44a1a15823 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:50:56.293516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad8b3b-49b5-446d-8fc8-1f44a1a15823 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:50:56.293796 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad8b3b-49b5-446d-8fc8-1f44a1a15823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:50:56.295516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b3ad8b3b-49b5-446d-8fc8-1f44a1a15823 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:50:56.303345 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:50:56.415438 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad8b3b-49b5-446d-8fc8-1f44a1a15823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:50:56.418033 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad8b3b-49b5-446d-8fc8-1f44a1a15823 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:50:56.436932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 649/1322] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:50:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:51:00.257967 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8ad3c-fd4d-44ec-94a9-3bac900ded31 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:00.258520 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8ad3c-fd4d-44ec-94a9-3bac900ded31 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:00.258801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8ad3c-fd4d-44ec-94a9-3bac900ded31 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:00.260347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 674/1323] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:00.265828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192bdc7-9ae5-41df-a155-9afbd5cd2082 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:00.266331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192bdc7-9ae5-41df-a155-9afbd5cd2082 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:00.267112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192bdc7-9ae5-41df-a155-9afbd5cd2082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:00.336435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-9192bdc7-9ae5-41df-a155-9afbd5cd2082 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:00.337659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9192bdc7-9ae5-41df-a155-9afbd5cd2082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:00.404402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:00.444032 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 650/1324] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:51:00.480075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8ad3c-fd4d-44ec-94a9-3bac900ded31 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:00.481612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-dde8ad3c-fd4d-44ec-94a9-3bac900ded31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:00.588492 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8ad3c-fd4d-44ec-94a9-3bac900ded31 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:00.600907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:00.665770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20662ddf-56ff-4926-b2b9-6ded2f94f770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:00.666304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20662ddf-56ff-4926-b2b9-6ded2f94f770 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:00.666619 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20662ddf-56ff-4926-b2b9-6ded2f94f770 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:00.666888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20662ddf-56ff-4926-b2b9-6ded2f94f770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:00.668596 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-20662ddf-56ff-4926-b2b9-6ded2f94f770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:00.784549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20662ddf-56ff-4926-b2b9-6ded2f94f770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:00.785998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20662ddf-56ff-4926-b2b9-6ded2f94f770 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:00.805630 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 675/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:51:03.075359 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7047a1-b98a-44e9-b4b0-169e7f9bcfde None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:03.075902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7047a1-b98a-44e9-b4b0-169e7f9bcfde None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:03.075902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7047a1-b98a-44e9-b4b0-169e7f9bcfde None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:03.077289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 651/1326] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:03.083122 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da271e3e-7bb6-4b4b-a986-19a0e145554d None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:03.083571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da271e3e-7bb6-4b4b-a986-19a0e145554d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:03.083694 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da271e3e-7bb6-4b4b-a986-19a0e145554d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:03.132364 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:03.150610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-da271e3e-7bb6-4b4b-a986-19a0e145554d None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:03.151854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-da271e3e-7bb6-4b4b-a986-19a0e145554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:03.256564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 676/1327] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:03.292094 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7047a1-b98a-44e9-b4b0-169e7f9bcfde None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:03.293634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-ef7047a1-b98a-44e9-b4b0-169e7f9bcfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:03.406033 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7047a1-b98a-44e9-b4b0-169e7f9bcfde None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:03.483382 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b76d3-83a0-4015-90e5-b44beedb1a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:03.484054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b76d3-83a0-4015-90e5-b44beedb1a50 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:03.484411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b76d3-83a0-4015-90e5-b44beedb1a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:03.487540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b76d3-83a0-4015-90e5-b44beedb1a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:03.487540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-964b76d3-83a0-4015-90e5-b44beedb1a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:03.505850 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:03.600908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b76d3-83a0-4015-90e5-b44beedb1a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:03.602380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b76d3-83a0-4015-90e5-b44beedb1a50 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:03.621411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 652/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:51:05.936442 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc48a3b-35f4-44a9-9456-12360a356c82 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:05.936986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc48a3b-35f4-44a9-9456-12360a356c82 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:05.936986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc48a3b-35f4-44a9-9456-12360a356c82 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:05.938436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 677/1329] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:05.943935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4e8af-ec44-411f-b3c3-d613c9015fec None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:05.944462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4e8af-ec44-411f-b3c3-d613c9015fec None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:05.944659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4e8af-ec44-411f-b3c3-d613c9015fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:06.021683 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-bbd4e8af-ec44-411f-b3c3-d613c9015fec None None] MFA Rules not processed for user `068f43858bd84ea9a8a4bd23968f5df6`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:06.022949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-bbd4e8af-ec44-411f-b3c3-d613c9015fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:06.095276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:06.139411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 653/1330] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:06.178128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc48a3b-35f4-44a9-9456-12360a356c82 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:06.179736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-3dc48a3b-35f4-44a9-9456-12360a356c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:06.296366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc48a3b-35f4-44a9-9456-12360a356c82 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:06.317532 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:06.381368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb1a91-e6b1-4d67-bc48-57bd7700380b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:06.382039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb1a91-e6b1-4d67-bc48-57bd7700380b service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:06.382328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb1a91-e6b1-4d67-bc48-57bd7700380b service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:06.382636 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb1a91-e6b1-4d67-bc48-57bd7700380b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:06.384315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4ceb1a91-e6b1-4d67-bc48-57bd7700380b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:06.509924 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb1a91-e6b1-4d67-bc48-57bd7700380b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:06.511434 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb1a91-e6b1-4d67-bc48-57bd7700380b service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:06.530188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 678/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:51:09.254425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34bd23-aa3e-43bd-82e9-b8747b260e12 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:09.257706 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34bd23-aa3e-43bd-82e9-b8747b260e12 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:09.257706 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34bd23-aa3e-43bd-82e9-b8747b260e12 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:09.257706 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 654/1332] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:51:09.263380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a81fb-854f-40c3-8e45-b0d7441991eb None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:09.263871 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a81fb-854f-40c3-8e45-b0d7441991eb None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:09.263983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a81fb-854f-40c3-8e45-b0d7441991eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:09.345736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:09.349281 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-4c1a81fb-854f-40c3-8e45-b0d7441991eb None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:09.350733 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4c1a81fb-854f-40c3-8e45-b0d7441991eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:09.465998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 679/1333] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:09.503155 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34bd23-aa3e-43bd-82e9-b8747b260e12 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:09.504890 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-6a34bd23-aa3e-43bd-82e9-b8747b260e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:09.632721 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34bd23-aa3e-43bd-82e9-b8747b260e12 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:09.723675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095ff68-5b86-49aa-8bb8-73032fddacbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:09.724343 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095ff68-5b86-49aa-8bb8-73032fddacbc service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:09.724630 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095ff68-5b86-49aa-8bb8-73032fddacbc service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:09.724916 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095ff68-5b86-49aa-8bb8-73032fddacbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:09.726635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4095ff68-5b86-49aa-8bb8-73032fddacbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:09.759701 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:09.855419 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095ff68-5b86-49aa-8bb8-73032fddacbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:09.856878 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095ff68-5b86-49aa-8bb8-73032fddacbc service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:09.878490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 655/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:51:12.195079 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5f44e-e468-4a44-a24e-64e3d78f2502 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:12.195633 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5f44e-e468-4a44-a24e-64e3d78f2502 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:12.195633 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5f44e-e468-4a44-a24e-64e3d78f2502 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:12.197009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 680/1335] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:12.202413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c49b73-8586-42cd-a130-5deec0ca2568 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:12.202861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c49b73-8586-42cd-a130-5deec0ca2568 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:12.202989 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c49b73-8586-42cd-a130-5deec0ca2568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:12.268585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-32c49b73-8586-42cd-a130-5deec0ca2568 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:12.269808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-32c49b73-8586-42cd-a130-5deec0ca2568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:12.343957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:12.365681 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 656/1336] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:12.405804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5f44e-e468-4a44-a24e-64e3d78f2502 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:12.407416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-64c5f44e-e468-4a44-a24e-64e3d78f2502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:12.511102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5f44e-e468-4a44-a24e-64e3d78f2502 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:12.538885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:12.583748 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf69a62-979b-43e3-956f-4c13d8cf74c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:12.584481 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf69a62-979b-43e3-956f-4c13d8cf74c3 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:12.585088 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf69a62-979b-43e3-956f-4c13d8cf74c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:12.585607 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf69a62-979b-43e3-956f-4c13d8cf74c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:12.587794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5cf69a62-979b-43e3-956f-4c13d8cf74c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:12.710696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf69a62-979b-43e3-956f-4c13d8cf74c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:12.712078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf69a62-979b-43e3-956f-4c13d8cf74c3 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:12.731253 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 681/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:51:15.861790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7591f33-0310-4f65-adcd-603d846044f9 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:15.862601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7591f33-0310-4f65-adcd-603d846044f9 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:15.862601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7591f33-0310-4f65-adcd-603d846044f9 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:15.864768 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 657/1338] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:15.870443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab68dbf-88b5-4ac9-a117-9f03ece7a2e1 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:15.870976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab68dbf-88b5-4ac9-a117-9f03ece7a2e1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:15.871077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab68dbf-88b5-4ac9-a117-9f03ece7a2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:15.944754 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-fab68dbf-88b5-4ac9-a117-9f03ece7a2e1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:15.946752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-fab68dbf-88b5-4ac9-a117-9f03ece7a2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:15.958184 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:16.065438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 682/1339] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:16.103060 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7591f33-0310-4f65-adcd-603d846044f9 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:16.105319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c7591f33-0310-4f65-adcd-603d846044f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:16.218089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7591f33-0310-4f65-adcd-603d846044f9 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:16.222232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b9d4d-0cc2-4979-8fe4-4cdfe53117e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:16.222923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b9d4d-0cc2-4979-8fe4-4cdfe53117e9 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:16.223207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b9d4d-0cc2-4979-8fe4-4cdfe53117e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:16.223484 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b9d4d-0cc2-4979-8fe4-4cdfe53117e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:16.232810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b9d4d-0cc2-4979-8fe4-4cdfe53117e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:16.234445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b9d4d-0cc2-4979-8fe4-4cdfe53117e9 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:16.244061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 658/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:51:20.812240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb4561-9d79-4d35-844b-c6dd77db0906 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:20.812770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb4561-9d79-4d35-844b-c6dd77db0906 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:20.812770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb4561-9d79-4d35-844b-c6dd77db0906 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:20.814120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 683/1341] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:20.820121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cd295-95ef-4b88-ab73-8fca4acd475e None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:20.820673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cd295-95ef-4b88-ab73-8fca4acd475e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:20.820673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cd295-95ef-4b88-ab73-8fca4acd475e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:20.854762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-f50cd295-95ef-4b88-ab73-8fca4acd475e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:20.856106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f50cd295-95ef-4b88-ab73-8fca4acd475e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:20.970485 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 659/1342] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:21.011475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb4561-9d79-4d35-844b-c6dd77db0906 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:21.024126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb4561-9d79-4d35-844b-c6dd77db0906 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:21.033116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1f627-9caa-4b56-9c6c-c38d84d3cf64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:21.034062 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f627-9caa-4b56-9c6c-c38d84d3cf64 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:21.034364 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f627-9caa-4b56-9c6c-c38d84d3cf64 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:21.034659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f627-9caa-4b56-9c6c-c38d84d3cf64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:21.052791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1f627-9caa-4b56-9c6c-c38d84d3cf64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:21.054463 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1f627-9caa-4b56-9c6c-c38d84d3cf64 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:21.065942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 684/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:51:24.340493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be21150-aa0e-4ff3-a124-d514ecd166f9 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:24.341031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be21150-aa0e-4ff3-a124-d514ecd166f9 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:24.341031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be21150-aa0e-4ff3-a124-d514ecd166f9 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:24.342389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 660/1344] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:24.348489 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdf8e9-77c4-4206-a6f7-ac9164cb4f51 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:24.348966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdf8e9-77c4-4206-a6f7-ac9164cb4f51 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:24.349100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fdf8e9-77c4-4206-a6f7-ac9164cb4f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:24.367442 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-d1fdf8e9-77c4-4206-a6f7-ac9164cb4f51 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:24.368646 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d1fdf8e9-77c4-4206-a6f7-ac9164cb4f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:24.376725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 685/1345] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:24.416355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be21150-aa0e-4ff3-a124-d514ecd166f9 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:24.418091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-6be21150-aa0e-4ff3-a124-d514ecd166f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:24.436971 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be21150-aa0e-4ff3-a124-d514ecd166f9 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:24.440528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1415500-5871-445c-a1c3-13eb60a4330a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:24.441229 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415500-5871-445c-a1c3-13eb60a4330a service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:24.441475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415500-5871-445c-a1c3-13eb60a4330a service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:24.441758 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415500-5871-445c-a1c3-13eb60a4330a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:24.451307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1415500-5871-445c-a1c3-13eb60a4330a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:24.453373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1415500-5871-445c-a1c3-13eb60a4330a service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:24.463790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 661/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 19:51:29.461543 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725f48b-c611-4256-846b-70e4c0462498 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:29.462040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725f48b-c611-4256-846b-70e4c0462498 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:29.462040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725f48b-c611-4256-846b-70e4c0462498 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:29.463573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 686/1347] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:29.468880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1637b9-1817-48dd-b376-41f202e33843 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:29.469286 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1637b9-1817-48dd-b376-41f202e33843 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:29.469449 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1637b9-1817-48dd-b376-41f202e33843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:29.488070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-4c1637b9-1817-48dd-b376-41f202e33843 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:29.489276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4c1637b9-1817-48dd-b376-41f202e33843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:29.497222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 662/1348] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:29.536480 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725f48b-c611-4256-846b-70e4c0462498 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:29.548002 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725f48b-c611-4256-846b-70e4c0462498 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:29.551704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e16c2-a97e-4796-a26a-bacc40008e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:29.552354 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e16c2-a97e-4796-a26a-bacc40008e94 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:29.552637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e16c2-a97e-4796-a26a-bacc40008e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:29.552929 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e16c2-a97e-4796-a26a-bacc40008e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:29.562395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e16c2-a97e-4796-a26a-bacc40008e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:29.563966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e16c2-a97e-4796-a26a-bacc40008e94 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:29.579253 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 687/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:51:35.097022 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdf58d-896b-46e8-bc16-ccf629e9a7ca None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:35.098020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdf58d-896b-46e8-bc16-ccf629e9a7ca None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:35.098551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdf58d-896b-46e8-bc16-ccf629e9a7ca None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:35.100151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 663/1350] 10.222.0.15 () {54 vars in 921 bytes} [Fri May 27 19:51:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:35.105336 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858eaa5-65b4-45ab-adef-bb305cde4a9e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:35.106262 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858eaa5-65b4-45ab-adef-bb305cde4a9e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:35.106799 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858eaa5-65b4-45ab-adef-bb305cde4a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:35.205157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-7858eaa5-65b4-45ab-adef-bb305cde4a9e None None] MFA Rules not processed for user `394b43cef91f4990b4707cb7a6798068`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:35.207212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-7858eaa5-65b4-45ab-adef-bb305cde4a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:35.277877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:35.308897 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 688/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Fri May 27 19:51:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:39.482312 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=98 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:39.652730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22178e61-2c1d-4398-8f20-d5bc76729890 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:39.653362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22178e61-2c1d-4398-8f20-d5bc76729890 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:39.653660 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22178e61-2c1d-4398-8f20-d5bc76729890 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:39.656059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 664/1352] 10.222.0.15 () {54 vars in 921 bytes} [Fri May 27 19:51:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:39.661716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ba5c5-a939-4fcd-bbb8-398d8e1f6922 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:39.667557 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ba5c5-a939-4fcd-bbb8-398d8e1f6922 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:39.667557 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ba5c5-a939-4fcd-bbb8-398d8e1f6922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:39.682393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e30ba5c5-a939-4fcd-bbb8-398d8e1f6922 None None] MFA Rules not processed for user `394b43cef91f4990b4707cb7a6798068`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:39.683595 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e30ba5c5-a939-4fcd-bbb8-398d8e1f6922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:39.697150 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 689/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Fri May 27 19:51:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:41.321847 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85e2a5-9983-45ce-b51e-7f1ca9b1c422 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:41.322451 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85e2a5-9983-45ce-b51e-7f1ca9b1c422 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:41.322451 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85e2a5-9983-45ce-b51e-7f1ca9b1c422 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:41.323830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 665/1354] 10.222.0.15 () {54 vars in 921 bytes} [Fri May 27 19:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:41.329235 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa69366-d77b-4555-9017-2469e17c305d None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:41.329689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa69366-d77b-4555-9017-2469e17c305d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:41.329814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa69366-d77b-4555-9017-2469e17c305d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:41.349048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-5aa69366-d77b-4555-9017-2469e17c305d None None] MFA Rules not processed for user `394b43cef91f4990b4707cb7a6798068`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:41.350255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5aa69366-d77b-4555-9017-2469e17c305d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:41.359340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 690/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Fri May 27 19:51:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:45.639843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0baa1-7ae1-435b-9ea2-6cd385de0a58 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:45.640436 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0baa1-7ae1-435b-9ea2-6cd385de0a58 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:45.640436 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0baa1-7ae1-435b-9ea2-6cd385de0a58 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:45.642873 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 666/1356] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:45.650585 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cb214-3e76-4847-827c-858d5372d484 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:45.651151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cb214-3e76-4847-827c-858d5372d484 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:45.651834 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cb214-3e76-4847-827c-858d5372d484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:45.676020 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-743cb214-3e76-4847-827c-858d5372d484 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:45.679843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-743cb214-3e76-4847-827c-858d5372d484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:45.685480 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 691/1357] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:45.743807 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00906d-3b98-4ea4-90a6-277ff3d376c6 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:45.744428 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00906d-3b98-4ea4-90a6-277ff3d376c6 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:45.745171 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00906d-3b98-4ea4-90a6-277ff3d376c6 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:45.747562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 667/1358] 10.222.0.15 () {54 vars in 961 bytes} [Fri May 27 19:51:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:45.757992 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7072919-2bff-4d1f-a899-a4aaa81534a8 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:45.758718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7072919-2bff-4d1f-a899-a4aaa81534a8 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:45.759246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7072919-2bff-4d1f-a899-a4aaa81534a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:45.823359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e7072919-2bff-4d1f-a899-a4aaa81534a8 None None] MFA Rules not processed for user `105353b6b1a941ac81df7ad35567ba7c`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:45.824858 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e7072919-2bff-4d1f-a899-a4aaa81534a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:45.947122 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 692/1359] 10.222.0.15 () {58 vars in 1058 bytes} [Fri May 27 19:51:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:45.955638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00906d-3b98-4ea4-90a6-277ff3d376c6 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:45.972400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00906d-3b98-4ea4-90a6-277ff3d376c6 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:45.980407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64147c63-b9d9-4373-9158-74585903d65c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:45.981479 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64147c63-b9d9-4373-9158-74585903d65c service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:45.981992 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64147c63-b9d9-4373-9158-74585903d65c service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:45.982545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64147c63-b9d9-4373-9158-74585903d65c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:45.999169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64147c63-b9d9-4373-9158-74585903d65c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:46.000946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64147c63-b9d9-4373-9158-74585903d65c service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:46.013870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 668/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:51:48.531125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2915310-4062-478f-9888-c6fecbba6f6f None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:48.532018 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2915310-4062-478f-9888-c6fecbba6f6f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:48.532018 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2915310-4062-478f-9888-c6fecbba6f6f None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:48.533458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 693/1361] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:51:48.539067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316a79-cfae-435d-8c17-6a1370f7e46e None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:48.539772 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316a79-cfae-435d-8c17-6a1370f7e46e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:48.539772 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316a79-cfae-435d-8c17-6a1370f7e46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:48.561054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-86316a79-cfae-435d-8c17-6a1370f7e46e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:48.562207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-86316a79-cfae-435d-8c17-6a1370f7e46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:48.578385 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 669/1362] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:51:48.616344 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2915310-4062-478f-9888-c6fecbba6f6f None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:48.632350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2915310-4062-478f-9888-c6fecbba6f6f None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:48.638081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949db5b-20a9-4c0e-b96c-46bd4f85e03d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:48.639378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949db5b-20a9-4c0e-b96c-46bd4f85e03d service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:48.639741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949db5b-20a9-4c0e-b96c-46bd4f85e03d service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:48.640098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949db5b-20a9-4c0e-b96c-46bd4f85e03d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:48.649512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949db5b-20a9-4c0e-b96c-46bd4f85e03d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:48.651295 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949db5b-20a9-4c0e-b96c-46bd4f85e03d service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:48.667445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 694/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:51:51.458778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9f0d1-7661-4cd5-941e-5071dd5acc7c None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:51.459284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9f0d1-7661-4cd5-941e-5071dd5acc7c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:51.459284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9f0d1-7661-4cd5-941e-5071dd5acc7c None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:51.460647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 670/1364] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:51.466045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c4d3f-b2ce-4e4e-b62d-0a8cb2510975 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:51.466624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c4d3f-b2ce-4e4e-b62d-0a8cb2510975 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:51.466706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c4d3f-b2ce-4e4e-b62d-0a8cb2510975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:51.498197 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-945c4d3f-b2ce-4e4e-b62d-0a8cb2510975 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:51.499541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-945c4d3f-b2ce-4e4e-b62d-0a8cb2510975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:51.507562 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 695/1365] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:51:51.560276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3371ac-95d2-4975-a172-de192b6f720e None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:51.561382 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3371ac-95d2-4975-a172-de192b6f720e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:51.561830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3371ac-95d2-4975-a172-de192b6f720e None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:51.563595 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 671/1366] 10.222.0.15 () {54 vars in 961 bytes} [Fri May 27 19:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:51.569241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6b681-3b62-404a-983d-9b57b560d077 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:51.571756 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6b681-3b62-404a-983d-9b57b560d077 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:51.571756 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6b681-3b62-404a-983d-9b57b560d077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:51.590634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e1d6b681-3b62-404a-983d-9b57b560d077 None None] MFA Rules not processed for user `105353b6b1a941ac81df7ad35567ba7c`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:51.591935 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e1d6b681-3b62-404a-983d-9b57b560d077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:51.602429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 696/1367] 10.222.0.15 () {58 vars in 1058 bytes} [Fri May 27 19:51:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:51.610673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3371ac-95d2-4975-a172-de192b6f720e None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:51.625903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3371ac-95d2-4975-a172-de192b6f720e None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:51.631896 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd8e2e-de18-4d66-a1bb-9ee45c5aaaa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:51.632630 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd8e2e-de18-4d66-a1bb-9ee45c5aaaa0 service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:51.632978 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd8e2e-de18-4d66-a1bb-9ee45c5aaaa0 service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:51.633326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd8e2e-de18-4d66-a1bb-9ee45c5aaaa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:51.642010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd8e2e-de18-4d66-a1bb-9ee45c5aaaa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:51.643811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd8e2e-de18-4d66-a1bb-9ee45c5aaaa0 service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:51.653609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 672/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:51:54.189512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b2801-3544-407b-8752-0743a0cd5ca3 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:54.190082 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b2801-3544-407b-8752-0743a0cd5ca3 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:54.190082 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b2801-3544-407b-8752-0743a0cd5ca3 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:54.191488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 697/1369] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:51:54.197228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a498c-84c9-48b7-ae80-e11c97eeab99 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:54.197692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a498c-84c9-48b7-ae80-e11c97eeab99 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:54.197783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a498c-84c9-48b7-ae80-e11c97eeab99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:54.216461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-296a498c-84c9-48b7-ae80-e11c97eeab99 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:54.218183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-296a498c-84c9-48b7-ae80-e11c97eeab99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:54.226272 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 673/1370] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:54.271088 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b2801-3544-407b-8752-0743a0cd5ca3 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:54.276619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631f31c-2c0e-4e33-a7f6-f9e0f599e03f None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:54.276917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631f31c-2c0e-4e33-a7f6-f9e0f599e03f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:54.277200 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631f31c-2c0e-4e33-a7f6-f9e0f599e03f None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:54.278782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 674/1371] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:51:54.284800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac9e0d-a2ae-4ed8-8403-9491bb3b0080 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:54.285096 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac9e0d-a2ae-4ed8-8403-9491bb3b0080 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:54.285381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac9e0d-a2ae-4ed8-8403-9491bb3b0080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:54.287199 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b2801-3544-407b-8752-0743a0cd5ca3 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:54.293098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5c2d3-8b6d-4035-81a3-ceef4df90e6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:54.293773 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5c2d3-8b6d-4035-81a3-ceef4df90e6f service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:54.294060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5c2d3-8b6d-4035-81a3-ceef4df90e6f service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:54.294384 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5c2d3-8b6d-4035-81a3-ceef4df90e6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:54.304127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5c2d3-8b6d-4035-81a3-ceef4df90e6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:54.305767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5c2d3-8b6d-4035-81a3-ceef4df90e6f service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:54.307608 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-94ac9e0d-a2ae-4ed8-8403-9491bb3b0080 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:54.308947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-94ac9e0d-a2ae-4ed8-8403-9491bb3b0080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:54.319013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 675/1372] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:51:54.326893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 698/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:51:54.609754 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445be9c-3967-4011-b1a8-ed87414fb2b1 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:54.610364 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445be9c-3967-4011-b1a8-ed87414fb2b1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:54.610693 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445be9c-3967-4011-b1a8-ed87414fb2b1 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:54.612236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 676/1374] 10.222.0.15 () {54 vars in 963 bytes} [Fri May 27 19:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:54.618561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6544f-23a9-46ae-a598-91863da8986a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:54.619099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6544f-23a9-46ae-a598-91863da8986a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:54.619610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6544f-23a9-46ae-a598-91863da8986a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:54.685009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-b9b6544f-23a9-46ae-a598-91863da8986a None None] MFA Rules not processed for user `8a892d3f80464f9e9ced137c5de8bd60`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:54.686669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b9b6544f-23a9-46ae-a598-91863da8986a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:54.698547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:51:54.766271 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 699/1375] 10.222.0.15 () {58 vars in 1060 bytes} [Fri May 27 19:51:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:54.774215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445be9c-3967-4011-b1a8-ed87414fb2b1 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:54.785758 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445be9c-3967-4011-b1a8-ed87414fb2b1 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:54.789414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a646c6-dde8-48c9-ae66-68d5882376f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:54.790066 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a646c6-dde8-48c9-ae66-68d5882376f5 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:54.790369 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a646c6-dde8-48c9-ae66-68d5882376f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:54.790685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a646c6-dde8-48c9-ae66-68d5882376f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:54.801452 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a646c6-dde8-48c9-ae66-68d5882376f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:54.802946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a646c6-dde8-48c9-ae66-68d5882376f5 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:54.814447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 677/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:51:56.785678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711a431-1e69-4fb1-a569-c06b8f1b96ff None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:56.786225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711a431-1e69-4fb1-a569-c06b8f1b96ff None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:56.786538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711a431-1e69-4fb1-a569-c06b8f1b96ff None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:56.788847 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 700/1377] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:56.794887 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef5a5a-2f18-41ad-ae98-7b9522fea29e None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:56.795364 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef5a5a-2f18-41ad-ae98-7b9522fea29e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:56.795481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef5a5a-2f18-41ad-ae98-7b9522fea29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:56.815956 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-e8ef5a5a-2f18-41ad-ae98-7b9522fea29e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:56.817261 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e8ef5a5a-2f18-41ad-ae98-7b9522fea29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:56.825581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 678/1378] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:51:56.872227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711a431-1e69-4fb1-a569-c06b8f1b96ff None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:56.901649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711a431-1e69-4fb1-a569-c06b8f1b96ff None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:56.908124 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e088ae-4131-49c6-8b24-1d0b24315bb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:56.908782 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e088ae-4131-49c6-8b24-1d0b24315bb4 service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:56.909072 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e088ae-4131-49c6-8b24-1d0b24315bb4 service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:56.909351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e088ae-4131-49c6-8b24-1d0b24315bb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:56.919250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e088ae-4131-49c6-8b24-1d0b24315bb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:56.921109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e088ae-4131-49c6-8b24-1d0b24315bb4 service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:56.940746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 701/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:51:59.431295 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82355c4-fe00-4f5e-a58c-67289faec0ee None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:59.432054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82355c4-fe00-4f5e-a58c-67289faec0ee None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:59.432054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82355c4-fe00-4f5e-a58c-67289faec0ee None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:59.433599 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 679/1380] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:51:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:51:59.439627 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63365a64-96b7-48f1-9e65-757c43cb981c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:59.440428 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63365a64-96b7-48f1-9e65-757c43cb981c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:59.440717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63365a64-96b7-48f1-9e65-757c43cb981c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:59.460317 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-63365a64-96b7-48f1-9e65-757c43cb981c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:51:59.461431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-63365a64-96b7-48f1-9e65-757c43cb981c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:51:59.469670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 702/1381] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:51:59.518597 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82355c4-fe00-4f5e-a58c-67289faec0ee None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:51:59.535796 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82355c4-fe00-4f5e-a58c-67289faec0ee None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:51:59.542728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3579fec-2ba7-423e-83a3-d45d8414a365 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:51:59.543470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3579fec-2ba7-423e-83a3-d45d8414a365 service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:51:59.543846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3579fec-2ba7-423e-83a3-d45d8414a365 service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:51:59.544200 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3579fec-2ba7-423e-83a3-d45d8414a365 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:51:59.554189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3579fec-2ba7-423e-83a3-d45d8414a365 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:51:59.555983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3579fec-2ba7-423e-83a3-d45d8414a365 service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:51:59.576712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 680/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:02.085591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8136ed0-e710-4542-953c-e48a4ec31ae9 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:02.086206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8136ed0-e710-4542-953c-e48a4ec31ae9 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:02.086206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8136ed0-e710-4542-953c-e48a4ec31ae9 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:02.088268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 703/1383] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:52:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:02.093557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54984111-768b-41e1-a0e2-fdd57570da70 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:02.094276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54984111-768b-41e1-a0e2-fdd57570da70 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:02.094276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54984111-768b-41e1-a0e2-fdd57570da70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:02.114455 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-54984111-768b-41e1-a0e2-fdd57570da70 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:02.115843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-54984111-768b-41e1-a0e2-fdd57570da70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:02.125536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 681/1384] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:52:02.168332 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8136ed0-e710-4542-953c-e48a4ec31ae9 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:02.184605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8136ed0-e710-4542-953c-e48a4ec31ae9 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:02.190534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da8790-41b0-4a9d-bc70-32d4e920c01a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:02.191308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da8790-41b0-4a9d-bc70-32d4e920c01a service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:02.191701 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da8790-41b0-4a9d-bc70-32d4e920c01a service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:02.192082 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da8790-41b0-4a9d-bc70-32d4e920c01a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:02.201805 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da8790-41b0-4a9d-bc70-32d4e920c01a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:02.203588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da8790-41b0-4a9d-bc70-32d4e920c01a service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:02.214047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 704/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:04.447485 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804183d-11e8-4117-8136-2c5a5d807d16 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:04.448389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804183d-11e8-4117-8136-2c5a5d807d16 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:04.448389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804183d-11e8-4117-8136-2c5a5d807d16 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:04.449450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 682/1386] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:04.456985 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2668-c43e-4fd1-8a39-b66a3fa4920e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:04.457500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2668-c43e-4fd1-8a39-b66a3fa4920e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:04.457738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2668-c43e-4fd1-8a39-b66a3fa4920e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:04.484329 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-583a2668-c43e-4fd1-8a39-b66a3fa4920e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:04.485901 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-583a2668-c43e-4fd1-8a39-b66a3fa4920e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:04.496690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 705/1387] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:04.558281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804183d-11e8-4117-8136-2c5a5d807d16 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:04.573651 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804183d-11e8-4117-8136-2c5a5d807d16 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:04.580102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa0131-9e70-4294-869e-56b3be3b6dea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:04.581042 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa0131-9e70-4294-869e-56b3be3b6dea service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:04.581482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa0131-9e70-4294-869e-56b3be3b6dea service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:04.581880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa0131-9e70-4294-869e-56b3be3b6dea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:04.594520 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa0131-9e70-4294-869e-56b3be3b6dea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:04.596638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa0131-9e70-4294-869e-56b3be3b6dea service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:04.609960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 683/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:07.081220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc995537-3c12-4c27-8d13-cf5401deb85a None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:07.082123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc995537-3c12-4c27-8d13-cf5401deb85a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:07.082123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc995537-3c12-4c27-8d13-cf5401deb85a None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:07.083177 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 706/1389] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:07.091573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbd51b-0650-403d-ade8-7a1cfc2bbdbd None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:07.092456 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbd51b-0650-403d-ade8-7a1cfc2bbdbd None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:07.093151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbd51b-0650-403d-ade8-7a1cfc2bbdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:07.120173 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b3fbd51b-0650-403d-ade8-7a1cfc2bbdbd None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:07.123603 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b3fbd51b-0650-403d-ade8-7a1cfc2bbdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:07.132085 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 684/1390] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:07.187953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc995537-3c12-4c27-8d13-cf5401deb85a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:07.206952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc995537-3c12-4c27-8d13-cf5401deb85a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:07.213926 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c097d4-d99a-45bd-8ab6-9c4756516922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:07.214764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c097d4-d99a-45bd-8ab6-9c4756516922 service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:07.215369 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c097d4-d99a-45bd-8ab6-9c4756516922 service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:07.215715 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c097d4-d99a-45bd-8ab6-9c4756516922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:07.228011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c097d4-d99a-45bd-8ab6-9c4756516922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:07.230923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c097d4-d99a-45bd-8ab6-9c4756516922 service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:07.242467 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 707/1391] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:09.744743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319c2a3-b362-43e3-9cb0-6b76c4789f5c None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:09.745311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319c2a3-b362-43e3-9cb0-6b76c4789f5c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:09.745311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319c2a3-b362-43e3-9cb0-6b76c4789f5c None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:09.746642 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 685/1392] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:09.752573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9f747-6ca2-4374-8139-16280a9eedc6 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:09.753050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9f747-6ca2-4374-8139-16280a9eedc6 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:09.753152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9f747-6ca2-4374-8139-16280a9eedc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:09.770906 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-19b9f747-6ca2-4374-8139-16280a9eedc6 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:09.773102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-19b9f747-6ca2-4374-8139-16280a9eedc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:09.781562 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 708/1393] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:09.825823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319c2a3-b362-43e3-9cb0-6b76c4789f5c None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:09.833713 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=49 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:09.840205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319c2a3-b362-43e3-9cb0-6b76c4789f5c None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:09.846072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69792214-0f6f-43c4-8c45-a2d2a60e68ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:09.847738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69792214-0f6f-43c4-8c45-a2d2a60e68ff service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:09.847738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69792214-0f6f-43c4-8c45-a2d2a60e68ff service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:09.847738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69792214-0f6f-43c4-8c45-a2d2a60e68ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:09.855601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69792214-0f6f-43c4-8c45-a2d2a60e68ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:09.857736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69792214-0f6f-43c4-8c45-a2d2a60e68ff service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:09.867348 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 686/1394] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:11.095908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468b052-820d-45fc-bcd9-d6fa5bd202b7 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:11.096495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468b052-820d-45fc-bcd9-d6fa5bd202b7 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:11.096495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468b052-820d-45fc-bcd9-d6fa5bd202b7 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:11.097853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 709/1395] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:11.103745 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302b0bf-f57a-407e-a6b2-0008f0f23be3 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:11.104250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302b0bf-f57a-407e-a6b2-0008f0f23be3 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:11.104352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302b0bf-f57a-407e-a6b2-0008f0f23be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:11.128060 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-6302b0bf-f57a-407e-a6b2-0008f0f23be3 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:11.134421 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-6302b0bf-f57a-407e-a6b2-0008f0f23be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:11.139665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 687/1396] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:52:11.196040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe709bd-3567-4e24-86a8-a8df893ec70e None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:11.196343 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe709bd-3567-4e24-86a8-a8df893ec70e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:11.196634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe709bd-3567-4e24-86a8-a8df893ec70e None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:11.198011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 710/1397] 10.222.0.15 () {54 vars in 962 bytes} [Fri May 27 19:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:11.203609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0b9fc-af0e-4fa2-8227-b753a1bbe014 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:11.203911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0b9fc-af0e-4fa2-8227-b753a1bbe014 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:11.204199 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0b9fc-af0e-4fa2-8227-b753a1bbe014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:11.254239 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-70a0b9fc-af0e-4fa2-8227-b753a1bbe014 None None] MFA Rules not processed for user `cc2b57ae83164912a4e23dda9dc239f4`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:11.255419 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-70a0b9fc-af0e-4fa2-8227-b753a1bbe014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:11.317367 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 688/1398] 10.222.0.15 () {58 vars in 1059 bytes} [Fri May 27 19:52:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:52:11.325969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe709bd-3567-4e24-86a8-a8df893ec70e None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:11.337633 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe709bd-3567-4e24-86a8-a8df893ec70e None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:11.342107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d2e08-eadc-4284-b384-b8b591ea5d67 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2b57ae83164912a4e23dda9dc239f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:11.342797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d2e08-eadc-4284-b384-b8b591ea5d67 service glance] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:11.343090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d2e08-eadc-4284-b384-b8b591ea5d67 service glance] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:11.343373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d2e08-eadc-4284-b384-b8b591ea5d67 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:11.353218 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d2e08-eadc-4284-b384-b8b591ea5d67 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:11.354791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d2e08-eadc-4284-b384-b8b591ea5d67 service glance] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:11.364430 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 711/1399] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:12.073235 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cd19f-c7c1-435c-bfbc-1a1c94881816 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:12.073534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cd19f-c7c1-435c-bfbc-1a1c94881816 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:12.073821 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cd19f-c7c1-435c-bfbc-1a1c94881816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:12.126811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-ca6cd19f-c7c1-435c-bfbc-1a1c94881816 None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:12.128028 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-ca6cd19f-c7c1-435c-bfbc-1a1c94881816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:12.194160 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 689/1400] 10.222.0.15 () {58 vars in 1009 bytes} [Fri May 27 19:52:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:12.235907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f041b-3962-4e69-afca-09bcd66c976a None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:12.236428 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f041b-3962-4e69-afca-09bcd66c976a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:12.236540 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f041b-3962-4e69-afca-09bcd66c976a None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:12.238000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 712/1401] 10.222.0.15 () {54 vars in 942 bytes} [Fri May 27 19:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:12.244886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6ed5-fae3-4147-87c5-a312323b557c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:12.245183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6ed5-fae3-4147-87c5-a312323b557c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:12.245622 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6ed5-fae3-4147-87c5-a312323b557c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:12.247097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f62ea-9c72-44de-9456-244676cfb27e None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:12.247373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f62ea-9c72-44de-9456-244676cfb27e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:12.247756 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f62ea-9c72-44de-9456-244676cfb27e None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:12.249166 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 713/1402] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:52:12.254449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35427389-726b-4189-bdf2-52f1de787720 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:12.254746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35427389-726b-4189-bdf2-52f1de787720 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:12.255031 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35427389-726b-4189-bdf2-52f1de787720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:12.273306 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-35427389-726b-4189-bdf2-52f1de787720 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:12.276110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-35427389-726b-4189-bdf2-52f1de787720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:12.283556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 714/1403] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:52:12.303277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:12.306274 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-984a6ed5-fae3-4147-87c5-a312323b557c None None] MFA Rules not processed for user `799058a415e44194a50697841b410062`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:12.307508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-984a6ed5-fae3-4147-87c5-a312323b557c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:12.331700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35427389-726b-4189-bdf2-52f1de787720 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:12.344395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35427389-726b-4189-bdf2-52f1de787720 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:12.350573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733ca08-4a8b-48de-9a78-c520bcc137c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:12.351642 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733ca08-4a8b-48de-9a78-c520bcc137c2 service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:12.351998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733ca08-4a8b-48de-9a78-c520bcc137c2 service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:12.352350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733ca08-4a8b-48de-9a78-c520bcc137c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:12.361504 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733ca08-4a8b-48de-9a78-c520bcc137c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:12.363127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733ca08-4a8b-48de-9a78-c520bcc137c2 service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:12.373419 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 715/1404] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 19:52:12.383708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 690/1405] 10.222.0.15 () {58 vars in 1039 bytes} [Fri May 27 19:52:12 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:12.394531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733ca08-4a8b-48de-9a78-c520bcc137c2 service nova] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:12.405563 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733ca08-4a8b-48de-9a78-c520bcc137c2 service nova] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:12.410995 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a52bd-4a07-4dcc-8dcd-2646086e72ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:12.411669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a52bd-4a07-4dcc-8dcd-2646086e72ec service swift] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:12.411953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a52bd-4a07-4dcc-8dcd-2646086e72ec service swift] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:12.412234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a52bd-4a07-4dcc-8dcd-2646086e72ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:12.420593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a52bd-4a07-4dcc-8dcd-2646086e72ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:12.422193 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a52bd-4a07-4dcc-8dcd-2646086e72ec service swift] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:12.430367 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 716/1406] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 19:52:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 19:52:14.879876 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e20b42-e0d6-484d-8038-0b8791234e2b None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:14.879876 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e20b42-e0d6-484d-8038-0b8791234e2b None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:14.879876 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e20b42-e0d6-484d-8038-0b8791234e2b None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:14.881952 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 691/1407] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:52:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:14.890120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e5b69-2dde-45d2-b02b-017ed6b0fce0 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:14.891591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e5b69-2dde-45d2-b02b-017ed6b0fce0 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:14.892120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e5b69-2dde-45d2-b02b-017ed6b0fce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:14.910833 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-0e6e5b69-2dde-45d2-b02b-017ed6b0fce0 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:14.912268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-0e6e5b69-2dde-45d2-b02b-017ed6b0fce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:14.921171 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 717/1408] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:14.975478 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e20b42-e0d6-484d-8038-0b8791234e2b None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:14.992280 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e20b42-e0d6-484d-8038-0b8791234e2b None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:14.998538 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47eaa73-380d-46b3-afd4-1b93a5cff7b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:14.999294 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47eaa73-380d-46b3-afd4-1b93a5cff7b9 service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:14.999624 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47eaa73-380d-46b3-afd4-1b93a5cff7b9 service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:14.999958 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47eaa73-380d-46b3-afd4-1b93a5cff7b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:15.009070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47eaa73-380d-46b3-afd4-1b93a5cff7b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:15.011309 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47eaa73-380d-46b3-afd4-1b93a5cff7b9 service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:15.021970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 692/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:24.905194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=71 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:25.017450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=36 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:52:37.602497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025bb25-1231-4288-a5b5-29f54d2929d1 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:37.603110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025bb25-1231-4288-a5b5-29f54d2929d1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:37.603110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025bb25-1231-4288-a5b5-29f54d2929d1 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:37.604426 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 718/1410] 10.222.0.15 () {54 vars in 918 bytes} [Fri May 27 19:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:37.610038 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028be89d-b711-4fca-a3fd-b6e7364d204e None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:37.610537 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028be89d-b711-4fca-a3fd-b6e7364d204e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:37.610655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028be89d-b711-4fca-a3fd-b6e7364d204e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:37.628702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-028be89d-b711-4fca-a3fd-b6e7364d204e None None] MFA Rules not processed for user `394b43cef91f4990b4707cb7a6798068`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:37.629931 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-028be89d-b711-4fca-a3fd-b6e7364d204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:37.638348 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 693/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Fri May 27 19:52:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:37.652854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d34d2d-ae92-400e-bc75-ea842b72e4eb None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:37.653149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d34d2d-ae92-400e-bc75-ea842b72e4eb None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:37.653437 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d34d2d-ae92-400e-bc75-ea842b72e4eb None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:37.654822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 719/1412] 10.222.0.15 () {54 vars in 918 bytes} [Fri May 27 19:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:37.659798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d25d23-3060-4cbf-b2f2-b6f1d7503f74 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:37.660120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d25d23-3060-4cbf-b2f2-b6f1d7503f74 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:37.660402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d25d23-3060-4cbf-b2f2-b6f1d7503f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:37.678724 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-83d25d23-3060-4cbf-b2f2-b6f1d7503f74 None None] MFA Rules not processed for user `105353b6b1a941ac81df7ad35567ba7c`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:37.679915 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-83d25d23-3060-4cbf-b2f2-b6f1d7503f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:37.689104 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 694/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Fri May 27 19:52:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:40.421417 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b1af9-7555-450c-a07d-0bb43d6fd083 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:40.422014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b1af9-7555-450c-a07d-0bb43d6fd083 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:40.422014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b1af9-7555-450c-a07d-0bb43d6fd083 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:40.423376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 720/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 19:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:40.428890 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcf9d5-e4d0-432e-af21-2eba49348f14 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:40.429368 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcf9d5-e4d0-432e-af21-2eba49348f14 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:40.429468 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcf9d5-e4d0-432e-af21-2eba49348f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:40.448228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-88bcf9d5-e4d0-432e-af21-2eba49348f14 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:40.449497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-88bcf9d5-e4d0-432e-af21-2eba49348f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:40.457758 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 695/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 19:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:40.506761 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b1af9-7555-450c-a07d-0bb43d6fd083 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:40.521381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b1af9-7555-450c-a07d-0bb43d6fd083 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:40.526883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5382ce-af30-4541-a916-2fcfc7ae1c9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:40.527538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5382ce-af30-4541-a916-2fcfc7ae1c9b service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:40.527870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5382ce-af30-4541-a916-2fcfc7ae1c9b service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:40.528154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5382ce-af30-4541-a916-2fcfc7ae1c9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:40.537399 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5382ce-af30-4541-a916-2fcfc7ae1c9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:40.539204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5382ce-af30-4541-a916-2fcfc7ae1c9b service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:40.550006 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 721/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:41.542495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fefb8-359a-4589-87d8-a13232030079 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:41.543070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fefb8-359a-4589-87d8-a13232030079 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:41.543070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fefb8-359a-4589-87d8-a13232030079 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:41.544503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 696/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 19:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:41.551166 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96e121-d78a-4120-bed9-6c858b9129be None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:41.551791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96e121-d78a-4120-bed9-6c858b9129be None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:41.551791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96e121-d78a-4120-bed9-6c858b9129be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:41.570399 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-1c96e121-d78a-4120-bed9-6c858b9129be None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:41.571620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-1c96e121-d78a-4120-bed9-6c858b9129be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:41.580378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 722/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 19:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:41.759210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fefb8-359a-4589-87d8-a13232030079 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:41.765646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fefb8-359a-4589-87d8-a13232030079 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:41.771206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568fb401-215f-4857-9082-f7c5fd20b79d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:41.771865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fb401-215f-4857-9082-f7c5fd20b79d service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:41.772149 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fb401-215f-4857-9082-f7c5fd20b79d service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:41.772428 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568fb401-215f-4857-9082-f7c5fd20b79d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:41.781663 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fb401-215f-4857-9082-f7c5fd20b79d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:41.783340 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568fb401-215f-4857-9082-f7c5fd20b79d service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:41.794425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 697/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:42.741752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111cab-be19-4eb2-9d4c-4fa5cb8946e8 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:42.742294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111cab-be19-4eb2-9d4c-4fa5cb8946e8 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:42.742294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd111cab-be19-4eb2-9d4c-4fa5cb8946e8 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:42.743634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 723/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 19:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:42.749540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd86ffc-3e15-4776-8d19-ee911a0fee1d None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:42.750034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd86ffc-3e15-4776-8d19-ee911a0fee1d None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:42.750130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd86ffc-3e15-4776-8d19-ee911a0fee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:42.769189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-5cd86ffc-3e15-4776-8d19-ee911a0fee1d None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:42.770442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-5cd86ffc-3e15-4776-8d19-ee911a0fee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:42.778316 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 698/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 19:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:42.929117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111cab-be19-4eb2-9d4c-4fa5cb8946e8 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:42.944083 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd111cab-be19-4eb2-9d4c-4fa5cb8946e8 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:42.949484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657c3bb-66f9-4b22-8330-a168bdafb515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:42.950132 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657c3bb-66f9-4b22-8330-a168bdafb515 service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:42.950453 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657c3bb-66f9-4b22-8330-a168bdafb515 service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:42.950736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657c3bb-66f9-4b22-8330-a168bdafb515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:42.959711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657c3bb-66f9-4b22-8330-a168bdafb515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:42.961328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657c3bb-66f9-4b22-8330-a168bdafb515 service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:42.972309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 724/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 19:52:43.903903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30370f-c2e6-4cb8-bd03-c8aab52516fb None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:43.904465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30370f-c2e6-4cb8-bd03-c8aab52516fb None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:43.904465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30370f-c2e6-4cb8-bd03-c8aab52516fb None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:43.906168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 699/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 19:52:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:43.911830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa1b59-2a14-41eb-8b0b-7742c511060e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:43.912349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa1b59-2a14-41eb-8b0b-7742c511060e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:43.912461 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa1b59-2a14-41eb-8b0b-7742c511060e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:43.931410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-d3aa1b59-2a14-41eb-8b0b-7742c511060e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:43.932659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d3aa1b59-2a14-41eb-8b0b-7742c511060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:43.940847 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 725/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 19:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:44.095060 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30370f-c2e6-4cb8-bd03-c8aab52516fb None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:44.109210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30370f-c2e6-4cb8-bd03-c8aab52516fb None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:44.114597 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7e40d-4e16-4503-8698-edfe5034bf1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:44.115242 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7e40d-4e16-4503-8698-edfe5034bf1e service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:44.115529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7e40d-4e16-4503-8698-edfe5034bf1e service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:44.115811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7e40d-4e16-4503-8698-edfe5034bf1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:44.124429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7e40d-4e16-4503-8698-edfe5034bf1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:44.126039 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7e40d-4e16-4503-8698-edfe5034bf1e service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:44.136384 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 700/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:45.063222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38f9ca-832c-415f-b516-b64b2b6613f7 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:45.063822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38f9ca-832c-415f-b516-b64b2b6613f7 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:45.063822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38f9ca-832c-415f-b516-b64b2b6613f7 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:45.065256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 726/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 19:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:45.070245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b826b81-1b91-462c-a0b2-8e58a9691a0a None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:45.070751 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b826b81-1b91-462c-a0b2-8e58a9691a0a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:45.070941 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b826b81-1b91-462c-a0b2-8e58a9691a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:45.090601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-2b826b81-1b91-462c-a0b2-8e58a9691a0a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:45.091836 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2b826b81-1b91-462c-a0b2-8e58a9691a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:45.099860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 701/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 19:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:45.250543 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38f9ca-832c-415f-b516-b64b2b6613f7 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:45.265483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38f9ca-832c-415f-b516-b64b2b6613f7 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:45.270873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68977501-3770-48b2-b6f8-27d8bcf8c921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:45.271515 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68977501-3770-48b2-b6f8-27d8bcf8c921 service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:45.271799 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68977501-3770-48b2-b6f8-27d8bcf8c921 service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:45.272074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68977501-3770-48b2-b6f8-27d8bcf8c921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:45.280973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68977501-3770-48b2-b6f8-27d8bcf8c921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:45.282601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68977501-3770-48b2-b6f8-27d8bcf8c921 service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:45.292862 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 727/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:46.211845 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea9511-0ddb-4c37-b8da-bcf9a89a8c05 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:46.212449 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea9511-0ddb-4c37-b8da-bcf9a89a8c05 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:46.212449 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea9511-0ddb-4c37-b8da-bcf9a89a8c05 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:46.214357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 702/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 19:52:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:46.219567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7522b0-8019-4ca8-ae81-f541589bac75 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:46.220042 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7522b0-8019-4ca8-ae81-f541589bac75 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:46.220149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7522b0-8019-4ca8-ae81-f541589bac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:46.238797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-4f7522b0-8019-4ca8-ae81-f541589bac75 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:46.240019 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4f7522b0-8019-4ca8-ae81-f541589bac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:46.248021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 728/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 19:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:46.397687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea9511-0ddb-4c37-b8da-bcf9a89a8c05 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:46.413740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea9511-0ddb-4c37-b8da-bcf9a89a8c05 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:46.419723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77dccd-aacd-45e9-a203-ef480300cb51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:46.420373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77dccd-aacd-45e9-a203-ef480300cb51 service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:46.420668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77dccd-aacd-45e9-a203-ef480300cb51 service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:46.420948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77dccd-aacd-45e9-a203-ef480300cb51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:46.429481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77dccd-aacd-45e9-a203-ef480300cb51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:46.430976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77dccd-aacd-45e9-a203-ef480300cb51 service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:46.440443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 703/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:47.360580 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc59c1e-d4b2-4eec-9921-be778734a1ab None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:47.361151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc59c1e-d4b2-4eec-9921-be778734a1ab None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:47.361265 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc59c1e-d4b2-4eec-9921-be778734a1ab None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:47.362608 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 729/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 19:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:47.368068 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b5463-e514-4c55-ad04-c16c0e69dca2 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:47.368539 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b5463-e514-4c55-ad04-c16c0e69dca2 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:47.368659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b5463-e514-4c55-ad04-c16c0e69dca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:47.387920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-e80b5463-e514-4c55-ad04-c16c0e69dca2 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:47.389011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e80b5463-e514-4c55-ad04-c16c0e69dca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:47.397221 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 704/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 19:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:47.549359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc59c1e-d4b2-4eec-9921-be778734a1ab None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:47.564507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc59c1e-d4b2-4eec-9921-be778734a1ab None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:47.569891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb79ca-b93e-4ecf-af5a-be07f93b0153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:47.570560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb79ca-b93e-4ecf-af5a-be07f93b0153 service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:47.570851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb79ca-b93e-4ecf-af5a-be07f93b0153 service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:47.571130 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb79ca-b93e-4ecf-af5a-be07f93b0153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:47.579610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb79ca-b93e-4ecf-af5a-be07f93b0153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:47.581212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb79ca-b93e-4ecf-af5a-be07f93b0153 service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:47.591135 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 730/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:48.505675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d771b58-5c02-4111-a2a9-c847d65c9b58 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:48.506248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d771b58-5c02-4111-a2a9-c847d65c9b58 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:48.506248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d771b58-5c02-4111-a2a9-c847d65c9b58 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:48.507823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 705/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 19:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:48.512926 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf74ed-5135-4647-a755-deb5192d4989 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:48.513359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf74ed-5135-4647-a755-deb5192d4989 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:48.513487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf74ed-5135-4647-a755-deb5192d4989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:48.533571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c9cf74ed-5135-4647-a755-deb5192d4989 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:48.534831 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c9cf74ed-5135-4647-a755-deb5192d4989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:48.544389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 731/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 19:52:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:48.694789 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d771b58-5c02-4111-a2a9-c847d65c9b58 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:48.709822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d771b58-5c02-4111-a2a9-c847d65c9b58 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:48.715868 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e26fbc-4f3d-4882-8d98-c207c4796125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:48.716524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e26fbc-4f3d-4882-8d98-c207c4796125 service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:48.716821 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e26fbc-4f3d-4882-8d98-c207c4796125 service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:48.717101 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e26fbc-4f3d-4882-8d98-c207c4796125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:48.725875 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e26fbc-4f3d-4882-8d98-c207c4796125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:48.727439 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e26fbc-4f3d-4882-8d98-c207c4796125 service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:48.738844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 706/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:49.644488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64cd36-d341-45a3-b779-5974c6d4fc63 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:49.645065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64cd36-d341-45a3-b779-5974c6d4fc63 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:49.645065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64cd36-d341-45a3-b779-5974c6d4fc63 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:49.646408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 732/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 19:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:49.652037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c19394-538c-4a0d-8109-13e82ee1865f None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:49.652485 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c19394-538c-4a0d-8109-13e82ee1865f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:49.652581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c19394-538c-4a0d-8109-13e82ee1865f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:49.670800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-20c19394-538c-4a0d-8109-13e82ee1865f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:49.672008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-20c19394-538c-4a0d-8109-13e82ee1865f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:49.679853 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 707/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 19:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:49.832872 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64cd36-d341-45a3-b779-5974c6d4fc63 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:49.847911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64cd36-d341-45a3-b779-5974c6d4fc63 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:49.853247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87a13b-d40f-4d7c-89c1-f3948337281c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:49.853900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87a13b-d40f-4d7c-89c1-f3948337281c service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:49.854184 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87a13b-d40f-4d7c-89c1-f3948337281c service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:49.854497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87a13b-d40f-4d7c-89c1-f3948337281c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:49.863433 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87a13b-d40f-4d7c-89c1-f3948337281c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:49.865036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87a13b-d40f-4d7c-89c1-f3948337281c service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:49.875011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 733/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:51.968837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d462465-6428-4128-9ac8-4356aa4a4d3f None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:51.969481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d462465-6428-4128-9ac8-4356aa4a4d3f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:51.969481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d462465-6428-4128-9ac8-4356aa4a4d3f None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:51.970809 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 708/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 19:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:51.976186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b46a5-4949-4ea1-87fa-2ae1e6ad16ed None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:51.976638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b46a5-4949-4ea1-87fa-2ae1e6ad16ed None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:51.976755 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b46a5-4949-4ea1-87fa-2ae1e6ad16ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:51.995424 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-946b46a5-4949-4ea1-87fa-2ae1e6ad16ed None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:51.996637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-946b46a5-4949-4ea1-87fa-2ae1e6ad16ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:52.004519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 734/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 19:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:52.042715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d462465-6428-4128-9ac8-4356aa4a4d3f None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:52.053519 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d462465-6428-4128-9ac8-4356aa4a4d3f None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:52.057667 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff21b1-e6c4-40d8-b8f2-005acb8d9d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:52.059690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff21b1-e6c4-40d8-b8f2-005acb8d9d2d service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:52.059690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff21b1-e6c4-40d8-b8f2-005acb8d9d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:52.059690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff21b1-e6c4-40d8-b8f2-005acb8d9d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:52.067736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff21b1-e6c4-40d8-b8f2-005acb8d9d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:52.069157 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff21b1-e6c4-40d8-b8f2-005acb8d9d2d service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:52.078668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 709/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:54.420067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a41d7-0cd1-4b7a-a2d9-6086a7e16f2c None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:54.420614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a41d7-0cd1-4b7a-a2d9-6086a7e16f2c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:54.420614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a41d7-0cd1-4b7a-a2d9-6086a7e16f2c None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:54.422050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 735/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 19:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:54.427844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf6f25-74cf-4ee8-b870-dd9701fbb208 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:54.428575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf6f25-74cf-4ee8-b870-dd9701fbb208 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:54.428575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf6f25-74cf-4ee8-b870-dd9701fbb208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:54.450091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-32bf6f25-74cf-4ee8-b870-dd9701fbb208 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:54.451366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-32bf6f25-74cf-4ee8-b870-dd9701fbb208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:54.460786 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 710/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 19:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:52:54.499305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a41d7-0cd1-4b7a-a2d9-6086a7e16f2c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:54.510848 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a41d7-0cd1-4b7a-a2d9-6086a7e16f2c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:54.514381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91769afd-036b-45f5-88e9-6733a5dd33d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:54.515027 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91769afd-036b-45f5-88e9-6733a5dd33d5 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:54.515310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91769afd-036b-45f5-88e9-6733a5dd33d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:54.515588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91769afd-036b-45f5-88e9-6733a5dd33d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:54.524932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91769afd-036b-45f5-88e9-6733a5dd33d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:54.526979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91769afd-036b-45f5-88e9-6733a5dd33d5 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:54.538733 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 736/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:57.130272 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbee2ce-35ef-46d6-9490-fa13e89e3a5b None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:57.130949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbee2ce-35ef-46d6-9490-fa13e89e3a5b None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:57.130949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbee2ce-35ef-46d6-9490-fa13e89e3a5b None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:57.132404 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 711/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 19:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:52:57.138255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a09ffd-6368-4d7d-af02-9a04529bebd3 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:57.138776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a09ffd-6368-4d7d-af02-9a04529bebd3 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:57.138881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a09ffd-6368-4d7d-af02-9a04529bebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:57.157746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-72a09ffd-6368-4d7d-af02-9a04529bebd3 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:57.158979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-72a09ffd-6368-4d7d-af02-9a04529bebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:57.166806 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 737/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 19:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:57.205868 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbee2ce-35ef-46d6-9490-fa13e89e3a5b None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:57.218701 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbee2ce-35ef-46d6-9490-fa13e89e3a5b None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:57.224821 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901ab3e-7d7e-4642-b458-55d33109b0f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:57.224821 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901ab3e-7d7e-4642-b458-55d33109b0f4 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:57.224821 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901ab3e-7d7e-4642-b458-55d33109b0f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:57.224821 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901ab3e-7d7e-4642-b458-55d33109b0f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:57.233132 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901ab3e-7d7e-4642-b458-55d33109b0f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:57.234960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901ab3e-7d7e-4642-b458-55d33109b0f4 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:57.244507 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 712/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:52:59.668305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f90bb4-a1c5-4e45-ab77-e40cee82bc92 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:59.668879 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f90bb4-a1c5-4e45-ab77-e40cee82bc92 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:59.668879 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f90bb4-a1c5-4e45-ab77-e40cee82bc92 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:59.670294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 738/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 19:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:52:59.676114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94672ea4-8a46-4e87-b844-5dbd0cc2ec05 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:59.676593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94672ea4-8a46-4e87-b844-5dbd0cc2ec05 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:59.676702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94672ea4-8a46-4e87-b844-5dbd0cc2ec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:59.694972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-94672ea4-8a46-4e87-b844-5dbd0cc2ec05 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:52:59.696181 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-94672ea4-8a46-4e87-b844-5dbd0cc2ec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:52:59.704086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 713/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 19:52:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:52:59.743044 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f90bb4-a1c5-4e45-ab77-e40cee82bc92 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:52:59.753844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f90bb4-a1c5-4e45-ab77-e40cee82bc92 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:52:59.757405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427c83a-b4a1-4d88-b604-ffb2c8414ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:52:59.758051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427c83a-b4a1-4d88-b604-ffb2c8414ace service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:52:59.758359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427c83a-b4a1-4d88-b604-ffb2c8414ace service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:52:59.758647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427c83a-b4a1-4d88-b604-ffb2c8414ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:52:59.767910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427c83a-b4a1-4d88-b604-ffb2c8414ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:52:59.769355 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427c83a-b4a1-4d88-b604-ffb2c8414ace service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:52:59.779879 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 739/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:53:02.039360 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d460f-29da-4ae7-8e1e-efd670793e8a None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:02.039930 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d460f-29da-4ae7-8e1e-efd670793e8a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:02.039930 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d460f-29da-4ae7-8e1e-efd670793e8a None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:02.041475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 714/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 19:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:53:02.046791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ac0ff-0fad-4d78-8465-e20d4de50b1d None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:02.047186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ac0ff-0fad-4d78-8465-e20d4de50b1d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:02.047363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ac0ff-0fad-4d78-8465-e20d4de50b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:02.065204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-cd2ac0ff-0fad-4d78-8465-e20d4de50b1d None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:53:02.066421 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-cd2ac0ff-0fad-4d78-8465-e20d4de50b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:53:02.074875 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 740/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 19:53:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:53:02.111081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d460f-29da-4ae7-8e1e-efd670793e8a None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:53:02.122103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d460f-29da-4ae7-8e1e-efd670793e8a None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:53:02.125653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b20302-bde8-433f-ba03-8305debd97bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:53:02.126276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b20302-bde8-433f-ba03-8305debd97bf service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:02.126618 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b20302-bde8-433f-ba03-8305debd97bf service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:02.126894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b20302-bde8-433f-ba03-8305debd97bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:02.136207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b20302-bde8-433f-ba03-8305debd97bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:53:02.137623 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b20302-bde8-433f-ba03-8305debd97bf service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:53:02.147088 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 715/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:53:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:53:04.419027 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637cfb-eb81-40d3-9392-1a03a0fa9e4c None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:04.419603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637cfb-eb81-40d3-9392-1a03a0fa9e4c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:04.419603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64637cfb-eb81-40d3-9392-1a03a0fa9e4c None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:04.420956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 741/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 19:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:53:04.426370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808094b-2670-418b-8425-98b3887bf2ff None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:04.426845 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808094b-2670-418b-8425-98b3887bf2ff None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:04.427003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808094b-2670-418b-8425-98b3887bf2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:04.444586 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-e808094b-2670-418b-8425-98b3887bf2ff None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:53:04.445785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e808094b-2670-418b-8425-98b3887bf2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:53:04.453534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 716/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 19:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:53:04.491983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64637cfb-eb81-40d3-9392-1a03a0fa9e4c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:53:04.502958 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64637cfb-eb81-40d3-9392-1a03a0fa9e4c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:53:04.506558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cded02-9b5c-4e35-a586-79abccee64f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:53:04.507202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cded02-9b5c-4e35-a586-79abccee64f1 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:04.507488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cded02-9b5c-4e35-a586-79abccee64f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:04.507766 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cded02-9b5c-4e35-a586-79abccee64f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:04.516911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cded02-9b5c-4e35-a586-79abccee64f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:53:04.518376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cded02-9b5c-4e35-a586-79abccee64f1 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:53:04.528570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 742/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:53:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:53:06.801270 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d2d0b-91be-4b3d-b8da-e9ffefc73f1f None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:06.801805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d2d0b-91be-4b3d-b8da-e9ffefc73f1f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:06.801924 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d2d0b-91be-4b3d-b8da-e9ffefc73f1f None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:06.803333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 717/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 19:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:53:06.809164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd12bfc-4cd8-4f75-a58d-8f61c1d674d1 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:06.809628 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd12bfc-4cd8-4f75-a58d-8f61c1d674d1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:06.809740 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd12bfc-4cd8-4f75-a58d-8f61c1d674d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:06.815829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=70 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:06.828268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-5dd12bfc-4cd8-4f75-a58d-8f61c1d674d1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:53:06.832205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5dd12bfc-4cd8-4f75-a58d-8f61c1d674d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:53:06.837405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 743/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 19:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:53:06.875019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d2d0b-91be-4b3d-b8da-e9ffefc73f1f None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:53:06.880362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=73 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:06.886147 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d2d0b-91be-4b3d-b8da-e9ffefc73f1f None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:53:06.889586 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9befac-0454-4964-bb33-64fbdab108ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:53:06.890219 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9befac-0454-4964-bb33-64fbdab108ce service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:06.890537 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9befac-0454-4964-bb33-64fbdab108ce service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:06.890818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9befac-0454-4964-bb33-64fbdab108ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:06.899803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9befac-0454-4964-bb33-64fbdab108ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:53:06.901355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9befac-0454-4964-bb33-64fbdab108ce service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:53:06.911902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 718/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:53:09.165577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdfa2f-09c9-48c7-b2f1-af2efbce56b6 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:09.166150 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdfa2f-09c9-48c7-b2f1-af2efbce56b6 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:09.166150 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdfa2f-09c9-48c7-b2f1-af2efbce56b6 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:09.167539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 744/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 19:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:53:09.172941 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b05246-735e-4a33-bc2d-984fb9bba8a9 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:09.173370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b05246-735e-4a33-bc2d-984fb9bba8a9 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:09.173514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b05246-735e-4a33-bc2d-984fb9bba8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:09.191042 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-47b05246-735e-4a33-bc2d-984fb9bba8a9 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:53:09.192253 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-47b05246-735e-4a33-bc2d-984fb9bba8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:53:09.200548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 719/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 19:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:53:09.237635 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdfa2f-09c9-48c7-b2f1-af2efbce56b6 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:53:09.248506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdfa2f-09c9-48c7-b2f1-af2efbce56b6 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:53:09.252009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8220f-16cd-4af1-9612-1025611908d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:53:09.252648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8220f-16cd-4af1-9612-1025611908d1 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:09.252940 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8220f-16cd-4af1-9612-1025611908d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:09.253221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8220f-16cd-4af1-9612-1025611908d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:09.262902 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8220f-16cd-4af1-9612-1025611908d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:53:09.264369 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8220f-16cd-4af1-9612-1025611908d1 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:53:09.273704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 745/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:53:11.582429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616374b0-9b79-4dc7-8b78-cb1ee50c6fc0 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:11.583009 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616374b0-9b79-4dc7-8b78-cb1ee50c6fc0 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:11.583139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616374b0-9b79-4dc7-8b78-cb1ee50c6fc0 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:11.584455 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 720/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 19:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:53:11.591322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b9ccf-33b3-4823-9979-1744c0c080f5 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:11.591786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b9ccf-33b3-4823-9979-1744c0c080f5 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:11.591882 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b9ccf-33b3-4823-9979-1744c0c080f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:11.610803 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-de2b9ccf-33b3-4823-9979-1744c0c080f5 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:53:11.612022 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-de2b9ccf-33b3-4823-9979-1744c0c080f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:53:11.619880 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 746/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 19:53:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:53:11.657727 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616374b0-9b79-4dc7-8b78-cb1ee50c6fc0 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:53:11.668694 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616374b0-9b79-4dc7-8b78-cb1ee50c6fc0 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:53:11.672207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3307fd8-28cd-437d-b819-df18060921d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:53:11.672875 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3307fd8-28cd-437d-b819-df18060921d0 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:11.673162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3307fd8-28cd-437d-b819-df18060921d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:11.673443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3307fd8-28cd-437d-b819-df18060921d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:11.686041 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3307fd8-28cd-437d-b819-df18060921d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:53:11.687507 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3307fd8-28cd-437d-b819-df18060921d0 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:53:11.697552 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 721/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:53:13.937419 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b253e-7423-4440-8ee6-93e750a1afcc None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:13.937965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b253e-7423-4440-8ee6-93e750a1afcc None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:13.937965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b253e-7423-4440-8ee6-93e750a1afcc None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:13.939399 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 747/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 19:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:53:13.944642 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba35060-4816-4de6-8537-6b3e766f1029 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:13.945078 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba35060-4816-4de6-8537-6b3e766f1029 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:13.945197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba35060-4816-4de6-8537-6b3e766f1029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:13.963937 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-9ba35060-4816-4de6-8537-6b3e766f1029 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:53:13.965140 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9ba35060-4816-4de6-8537-6b3e766f1029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:53:13.973068 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 722/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 19:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:53:14.009539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b253e-7423-4440-8ee6-93e750a1afcc None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:53:14.020597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b253e-7423-4440-8ee6-93e750a1afcc None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:53:14.024113 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460de615-90d4-4b4c-8fc5-b9bb3e6c8ebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:53:14.024763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460de615-90d4-4b4c-8fc5-b9bb3e6c8ebe service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:14.025043 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460de615-90d4-4b4c-8fc5-b9bb3e6c8ebe service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:14.025321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460de615-90d4-4b4c-8fc5-b9bb3e6c8ebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:14.035177 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460de615-90d4-4b4c-8fc5-b9bb3e6c8ebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:53:14.047166 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460de615-90d4-4b4c-8fc5-b9bb3e6c8ebe service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:53:14.047166 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 748/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:53:23.958127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=17 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:24.042068 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=17 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:53:47.327783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe49cf4-ce3d-46e3-9ffa-bbe1b5dc98a7 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:47.328376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe49cf4-ce3d-46e3-9ffa-bbe1b5dc98a7 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:47.328376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe49cf4-ce3d-46e3-9ffa-bbe1b5dc98a7 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:47.329731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 723/1471] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:53:47.335096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a82239-146d-473a-ab0e-2aa6e2104f37 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:47.335573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a82239-146d-473a-ab0e-2aa6e2104f37 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:47.335678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a82239-146d-473a-ab0e-2aa6e2104f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:47.353561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-f0a82239-146d-473a-ab0e-2aa6e2104f37 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:53:47.354816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f0a82239-146d-473a-ab0e-2aa6e2104f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:53:47.362617 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 749/1472] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:53:47.410024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9e082-b351-4df5-8772-9e8515068f56 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:47.410321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9e082-b351-4df5-8772-9e8515068f56 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:47.410646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9e082-b351-4df5-8772-9e8515068f56 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:47.412007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 724/1473] 10.222.0.15 () {54 vars in 962 bytes} [Fri May 27 19:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:53:47.416963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fc3d1-2356-4dc2-b485-a408d33ab0e7 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:47.417260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fc3d1-2356-4dc2-b485-a408d33ab0e7 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:47.417547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fc3d1-2356-4dc2-b485-a408d33ab0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:47.435477 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-4e7fc3d1-2356-4dc2-b485-a408d33ab0e7 None None] MFA Rules not processed for user `cc2b57ae83164912a4e23dda9dc239f4`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:53:47.436679 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4e7fc3d1-2356-4dc2-b485-a408d33ab0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:53:47.443108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 750/1474] 10.222.0.15 () {58 vars in 1059 bytes} [Fri May 27 19:53:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:53:47.450858 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9e082-b351-4df5-8772-9e8515068f56 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:53:47.462052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9e082-b351-4df5-8772-9e8515068f56 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:53:47.465546 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ede41-0d03-48c9-b0b3-f2e24d2d4454 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2b57ae83164912a4e23dda9dc239f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:53:47.466174 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ede41-0d03-48c9-b0b3-f2e24d2d4454 service glance] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:47.466492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ede41-0d03-48c9-b0b3-f2e24d2d4454 service glance] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:47.466777 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ede41-0d03-48c9-b0b3-f2e24d2d4454 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:47.477890 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ede41-0d03-48c9-b0b3-f2e24d2d4454 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:53:47.479402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ede41-0d03-48c9-b0b3-f2e24d2d4454 service glance] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:53:47.489335 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 725/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 19:53:49.779185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7256d5-835a-4d24-ba1f-4afac322167b None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:49.779759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7256d5-835a-4d24-ba1f-4afac322167b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:49.779759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7256d5-835a-4d24-ba1f-4afac322167b None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:49.781099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 751/1476] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:53:49.786568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00a6ad-5d81-4cdd-8431-5dcebe64a0d5 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:49.786973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00a6ad-5d81-4cdd-8431-5dcebe64a0d5 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:49.787148 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00a6ad-5d81-4cdd-8431-5dcebe64a0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:49.805733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-9a00a6ad-5d81-4cdd-8431-5dcebe64a0d5 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:53:49.806959 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9a00a6ad-5d81-4cdd-8431-5dcebe64a0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:53:49.814837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 726/1477] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:53:49.838262 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7256d5-835a-4d24-ba1f-4afac322167b None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:53:49.850789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7256d5-835a-4d24-ba1f-4afac322167b None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:53:49.855166 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe643c-bc9c-4a71-9de1-e0f92df0888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:53:49.855812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe643c-bc9c-4a71-9de1-e0f92df0888d admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:49.856100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe643c-bc9c-4a71-9de1-e0f92df0888d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:49.856377 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe643c-bc9c-4a71-9de1-e0f92df0888d admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:49.857110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe643c-bc9c-4a71-9de1-e0f92df0888d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:53:49.858944 dv-cinder-839793-12-smb devstack@keystone.service[92145]: WARNING py.warnings [None req-abfe643c-bc9c-4a71-9de1-e0f92df0888d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 19:53:49.858944 dv-cinder-839793-12-smb devstack@keystone.service[92145]: warnings.warn(msg) May 27 19:53:49.858944 dv-cinder-839793-12-smb devstack@keystone.service[92145]: May 27 19:53:49.860092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe643c-bc9c-4a71-9de1-e0f92df0888d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:53:49.879475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 752/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Fri May 27 19:53:49 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:53:52.113513 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7335b-1046-4d52-b727-1b5a91449d56 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:52.114052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7335b-1046-4d52-b727-1b5a91449d56 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:52.114052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7335b-1046-4d52-b727-1b5a91449d56 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:52.115499 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 727/1479] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:53:52.120867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc265d-a780-4b57-acbd-50070e93532f None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:52.121349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc265d-a780-4b57-acbd-50070e93532f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:52.121463 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc265d-a780-4b57-acbd-50070e93532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:52.139096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-99dc265d-a780-4b57-acbd-50070e93532f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:53:52.140287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-99dc265d-a780-4b57-acbd-50070e93532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:53:52.148543 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 753/1480] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:53:52.191819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7335b-1046-4d52-b727-1b5a91449d56 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:53:52.211390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7335b-1046-4d52-b727-1b5a91449d56 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:53:52.217944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f63162-5481-4aba-a54a-74930239cc2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:53:52.218623 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f63162-5481-4aba-a54a-74930239cc2f service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:52.218916 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f63162-5481-4aba-a54a-74930239cc2f service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:52.219201 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f63162-5481-4aba-a54a-74930239cc2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:52.227701 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f63162-5481-4aba-a54a-74930239cc2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:53:52.236819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f63162-5481-4aba-a54a-74930239cc2f service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:53:52.238726 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 728/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:53:54.655749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29491c62-d8ec-4bbd-9563-3cb064f0cd3a None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:54.656287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29491c62-d8ec-4bbd-9563-3cb064f0cd3a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:54.656422 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29491c62-d8ec-4bbd-9563-3cb064f0cd3a None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:54.657691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 754/1482] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:53:54.663573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0e75-5a50-4900-8ded-f8b114f231f8 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:54.663994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0e75-5a50-4900-8ded-f8b114f231f8 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:54.664132 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0e75-5a50-4900-8ded-f8b114f231f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:54.681816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-62dd0e75-5a50-4900-8ded-f8b114f231f8 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:53:54.683082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-62dd0e75-5a50-4900-8ded-f8b114f231f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:53:54.691077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 729/1483] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:53:54.727126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29491c62-d8ec-4bbd-9563-3cb064f0cd3a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:53:54.737766 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29491c62-d8ec-4bbd-9563-3cb064f0cd3a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:53:54.741219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bab792-41a4-4cb3-9db4-4a8b5de6f8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:53:54.741850 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bab792-41a4-4cb3-9db4-4a8b5de6f8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:54.742140 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bab792-41a4-4cb3-9db4-4a8b5de6f8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:54.742454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bab792-41a4-4cb3-9db4-4a8b5de6f8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:54.751288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bab792-41a4-4cb3-9db4-4a8b5de6f8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:53:54.752738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bab792-41a4-4cb3-9db4-4a8b5de6f8b1 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:53:54.762546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 755/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:53:57.029810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2cdb0-9bb6-4d52-8f86-52c9f98c6858 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:57.030411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2cdb0-9bb6-4d52-8f86-52c9f98c6858 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:57.030411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2cdb0-9bb6-4d52-8f86-52c9f98c6858 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:57.032253 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 730/1485] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:53:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:53:57.037993 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538cc35-7e88-43aa-a7e8-71fccaa33690 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:57.038668 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538cc35-7e88-43aa-a7e8-71fccaa33690 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:57.038668 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538cc35-7e88-43aa-a7e8-71fccaa33690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:57.056630 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-4538cc35-7e88-43aa-a7e8-71fccaa33690 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:53:57.057837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4538cc35-7e88-43aa-a7e8-71fccaa33690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:53:57.065783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 756/1486] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:53:57.104771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2cdb0-9bb6-4d52-8f86-52c9f98c6858 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:53:57.115830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2cdb0-9bb6-4d52-8f86-52c9f98c6858 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:53:57.119417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe00ff-c20d-441e-8922-d306cb56b58c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:53:57.120079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe00ff-c20d-441e-8922-d306cb56b58c service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:57.120353 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe00ff-c20d-441e-8922-d306cb56b58c service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:57.120639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe00ff-c20d-441e-8922-d306cb56b58c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:57.130377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe00ff-c20d-441e-8922-d306cb56b58c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:53:57.133354 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe00ff-c20d-441e-8922-d306cb56b58c service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:53:57.142335 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 731/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:53:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:53:59.471873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7af1c4-72f9-4024-8dc5-66da1b2796cb None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:59.472494 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7af1c4-72f9-4024-8dc5-66da1b2796cb None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:59.472494 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7af1c4-72f9-4024-8dc5-66da1b2796cb None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:59.473832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 757/1488] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:53:59.479989 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b7574-644b-480d-bdab-711d1364abbf None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:59.480411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b7574-644b-480d-bdab-711d1364abbf None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:59.480563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b7574-644b-480d-bdab-711d1364abbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:59.498569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-290b7574-644b-480d-bdab-711d1364abbf None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:53:59.499775 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-290b7574-644b-480d-bdab-711d1364abbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:53:59.507969 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 732/1489] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:53:59.548258 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7af1c4-72f9-4024-8dc5-66da1b2796cb None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:53:59.560551 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7af1c4-72f9-4024-8dc5-66da1b2796cb None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:53:59.564185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54d8fa-1de7-478c-8fbd-061902c1c7bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:53:59.564833 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54d8fa-1de7-478c-8fbd-061902c1c7bb service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:53:59.565116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54d8fa-1de7-478c-8fbd-061902c1c7bb service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:53:59.565392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54d8fa-1de7-478c-8fbd-061902c1c7bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:53:59.574776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54d8fa-1de7-478c-8fbd-061902c1c7bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:53:59.576242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54d8fa-1de7-478c-8fbd-061902c1c7bb service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:53:59.586639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 758/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:54:02.165826 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999230ab-a7f9-4b7a-b3db-49cec37ab367 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:54:02.166426 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999230ab-a7f9-4b7a-b3db-49cec37ab367 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:54:02.166426 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999230ab-a7f9-4b7a-b3db-49cec37ab367 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:54:02.167790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 733/1491] 10.222.0.15 () {54 vars in 926 bytes} [Fri May 27 19:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:54:02.173427 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3226d21-5e5a-43c8-897c-033912ff8b38 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:54:02.173908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3226d21-5e5a-43c8-897c-033912ff8b38 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:54:02.174005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3226d21-5e5a-43c8-897c-033912ff8b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:54:02.192497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c3226d21-5e5a-43c8-897c-033912ff8b38 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:54:02.193738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c3226d21-5e5a-43c8-897c-033912ff8b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:54:02.201574 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 759/1492] 10.222.0.15 () {58 vars in 1023 bytes} [Fri May 27 19:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:54:02.241042 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999230ab-a7f9-4b7a-b3db-49cec37ab367 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:54:02.253183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999230ab-a7f9-4b7a-b3db-49cec37ab367 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:54:02.256976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7217c-fa38-47c4-a6f4-12c3b5ff578b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:54:02.257630 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7217c-fa38-47c4-a6f4-12c3b5ff578b service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:54:02.257917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7217c-fa38-47c4-a6f4-12c3b5ff578b service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:54:02.258196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7217c-fa38-47c4-a6f4-12c3b5ff578b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:54:02.267384 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7217c-fa38-47c4-a6f4-12c3b5ff578b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:54:02.268814 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7217c-fa38-47c4-a6f4-12c3b5ff578b service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:54:02.278585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 734/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:54:12.187210 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=33 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:54:12.274038 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=33 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:50.677591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cb7c4-5168-4b3a-bd24-27174566f928 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:50.678171 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cb7c4-5168-4b3a-bd24-27174566f928 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:50.678171 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cb7c4-5168-4b3a-bd24-27174566f928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:50.696815 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e84cb7c4-5168-4b3a-bd24-27174566f928 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:55:50.698004 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e84cb7c4-5168-4b3a-bd24-27174566f928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:55:50.705866 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 760/1494] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:55:50.714995 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760a18c-e7e5-49b2-8dee-cd1d2a635dca None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:50.715495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760a18c-e7e5-49b2-8dee-cd1d2a635dca None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:50.715599 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760a18c-e7e5-49b2-8dee-cd1d2a635dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:50.734188 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-2760a18c-e7e5-49b2-8dee-cd1d2a635dca None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:55:50.735896 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2760a18c-e7e5-49b2-8dee-cd1d2a635dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:55:50.743559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 735/1495] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:55:50.747934 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cb7c4-5168-4b3a-bd24-27174566f928 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:55:50.757420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cb7c4-5168-4b3a-bd24-27174566f928 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:55:50.762033 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab07e19-28ae-4943-9b86-1159dcf836bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:55:50.762729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab07e19-28ae-4943-9b86-1159dcf836bb admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:50.763014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab07e19-28ae-4943-9b86-1159dcf836bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:50.763292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab07e19-28ae-4943-9b86-1159dcf836bb admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:50.764015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab07e19-28ae-4943-9b86-1159dcf836bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:55:50.764326 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab07e19-28ae-4943-9b86-1159dcf836bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:55:50.765343 dv-cinder-839793-12-smb devstack@keystone.service[92145]: WARNING py.warnings [None req-7ab07e19-28ae-4943-9b86-1159dcf836bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 19:55:50.765343 dv-cinder-839793-12-smb devstack@keystone.service[92145]: warnings.warn(msg) May 27 19:55:50.765343 dv-cinder-839793-12-smb devstack@keystone.service[92145]: May 27 19:55:50.766243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab07e19-28ae-4943-9b86-1159dcf836bb admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:55:50.777900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 761/1496] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 19:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:55:50.786426 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760a18c-e7e5-49b2-8dee-cd1d2a635dca None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:55:50.795580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760a18c-e7e5-49b2-8dee-cd1d2a635dca None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:55:50.800795 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8afe72-0777-47d6-98a3-35426015ce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:55:50.801449 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8afe72-0777-47d6-98a3-35426015ce5a admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:50.801738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8afe72-0777-47d6-98a3-35426015ce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:50.802022 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8afe72-0777-47d6-98a3-35426015ce5a admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:50.802762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8afe72-0777-47d6-98a3-35426015ce5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:55:50.804533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: WARNING py.warnings [None req-cb8afe72-0777-47d6-98a3-35426015ce5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 19:55:50.804533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: warnings.warn(msg) May 27 19:55:50.804533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: May 27 19:55:50.805785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8afe72-0777-47d6-98a3-35426015ce5a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:55:50.911323 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 736/1497] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:55:50 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:55:50.915529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab07e19-28ae-4943-9b86-1159dcf836bb admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:55:50.926043 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab07e19-28ae-4943-9b86-1159dcf836bb admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:55:50.980826 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b33995-a3a8-40c8-be4d-c634d292c6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:55:50.981506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b33995-a3a8-40c8-be4d-c634d292c6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:50.981798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b33995-a3a8-40c8-be4d-c634d292c6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:50.982083 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b33995-a3a8-40c8-be4d-c634d292c6c0 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:50.982851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b33995-a3a8-40c8-be4d-c634d292c6c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:55:50.983880 dv-cinder-839793-12-smb devstack@keystone.service[92145]: WARNING py.warnings [None req-e8b33995-a3a8-40c8-be4d-c634d292c6c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 19:55:50.983880 dv-cinder-839793-12-smb devstack@keystone.service[92145]: warnings.warn(msg) May 27 19:55:50.983880 dv-cinder-839793-12-smb devstack@keystone.service[92145]: May 27 19:55:50.985168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b33995-a3a8-40c8-be4d-c634d292c6c0 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:55:51.227694 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 762/1498] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:55:50 2022] POST /identity/v3/users => generated 288 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:55:51.232782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8afe72-0777-47d6-98a3-35426015ce5a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:55:51.243153 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8afe72-0777-47d6-98a3-35426015ce5a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:55:51.247672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32072e07-4be5-4b31-a3a5-f8792ebc380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:55:51.248334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32072e07-4be5-4b31-a3a5-f8792ebc380b admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:51.248621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32072e07-4be5-4b31-a3a5-f8792ebc380b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:51.248899 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32072e07-4be5-4b31-a3a5-f8792ebc380b admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:51.249622 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32072e07-4be5-4b31-a3a5-f8792ebc380b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:55:51.250733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: WARNING py.warnings [None req-32072e07-4be5-4b31-a3a5-f8792ebc380b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 19:55:51.250733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: warnings.warn(msg) May 27 19:55:51.250733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: May 27 19:55:51.251626 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32072e07-4be5-4b31-a3a5-f8792ebc380b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:55:51.264179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 737/1499] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:55:51.268856 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b33995-a3a8-40c8-be4d-c634d292c6c0 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:55:51.279214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b33995-a3a8-40c8-be4d-c634d292c6c0 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:55:51.284928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388ad4c-73b9-480e-84d2-14ac5ff9b2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:55:51.285584 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388ad4c-73b9-480e-84d2-14ac5ff9b2ad admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:51.285865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388ad4c-73b9-480e-84d2-14ac5ff9b2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:51.286142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388ad4c-73b9-480e-84d2-14ac5ff9b2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:51.286906 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388ad4c-73b9-480e-84d2-14ac5ff9b2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:55:51.287920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: WARNING py.warnings [None req-7388ad4c-73b9-480e-84d2-14ac5ff9b2ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 19:55:51.287920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: warnings.warn(msg) May 27 19:55:51.287920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: May 27 19:55:51.288794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388ad4c-73b9-480e-84d2-14ac5ff9b2ad admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:55:51.302085 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 763/1500] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:55:51.306208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32072e07-4be5-4b31-a3a5-f8792ebc380b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:55:51.316683 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32072e07-4be5-4b31-a3a5-f8792ebc380b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:55:51.321320 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10566211-d210-4cd7-9235-d9789d0794f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:55:51.324672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10566211-d210-4cd7-9235-d9789d0794f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:51.324672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10566211-d210-4cd7-9235-d9789d0794f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:51.324672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10566211-d210-4cd7-9235-d9789d0794f8 admin admin] PATH_INFO: `/v3/projects/795183672d1d4440915c46d1a0ddbc7d/users/bf2368df48a749329b7367000aeed45b/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:51.338365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10566211-d210-4cd7-9235-d9789d0794f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=795183672d1d4440915c46d1a0ddbc7d, user_id=bf2368df48a749329b7367000aeed45b, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:55:51.338893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: WARNING py.warnings [None req-10566211-d210-4cd7-9235-d9789d0794f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 19:55:51.338893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: warnings.warn(msg) May 27 19:55:51.338893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: May 27 19:55:51.340815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10566211-d210-4cd7-9235-d9789d0794f8 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:55:51.424326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 738/1501] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:55:51 2022] PUT /identity/v3/projects/795183672d1d4440915c46d1a0ddbc7d/users/bf2368df48a749329b7367000aeed45b/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 19:55:51.435819 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9bef4-47c9-4875-97dc-4cca2344516c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:51.436116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9bef4-47c9-4875-97dc-4cca2344516c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:51.436400 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9bef4-47c9-4875-97dc-4cca2344516c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:51.463290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-dfa9bef4-47c9-4875-97dc-4cca2344516c None None] MFA Rules not processed for user `bf2368df48a749329b7367000aeed45b`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:55:51.464488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-dfa9bef4-47c9-4875-97dc-4cca2344516c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:55:51.527797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 764/1502] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:55:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:55:51.542234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28806e-ed12-4ae4-8004-cec5aeceea68 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:51.542566 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28806e-ed12-4ae4-8004-cec5aeceea68 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:51.542852 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28806e-ed12-4ae4-8004-cec5aeceea68 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:51.544219 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 739/1503] 10.222.0.15 () {54 vars in 963 bytes} [Fri May 27 19:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:55:51.549280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eab9f-bec9-4cdd-91d4-8fab615ba3da None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:51.549573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eab9f-bec9-4cdd-91d4-8fab615ba3da None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:51.549871 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1eab9f-bec9-4cdd-91d4-8fab615ba3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:51.568328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-9f1eab9f-bec9-4cdd-91d4-8fab615ba3da None None] MFA Rules not processed for user `8a892d3f80464f9e9ced137c5de8bd60`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:55:51.569508 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9f1eab9f-bec9-4cdd-91d4-8fab615ba3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:55:51.612287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:51.619749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 765/1504] 10.222.0.15 () {58 vars in 1060 bytes} [Fri May 27 19:55:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:55:51.734054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28806e-ed12-4ae4-8004-cec5aeceea68 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:55:51.745190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28806e-ed12-4ae4-8004-cec5aeceea68 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:55:51.748666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb687ab8-b3fe-46a5-bd06-b512e7f9f17b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:55:51.749296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb687ab8-b3fe-46a5-bd06-b512e7f9f17b service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:51.749578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb687ab8-b3fe-46a5-bd06-b512e7f9f17b service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:51.749854 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb687ab8-b3fe-46a5-bd06-b512e7f9f17b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:51.758574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb687ab8-b3fe-46a5-bd06-b512e7f9f17b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:55:51.759989 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb687ab8-b3fe-46a5-bd06-b512e7f9f17b service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:55:51.768582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 740/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:55:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:55:51.809831 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64410594-24ae-4b8a-8572-6691f6a9ac4a None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:51.810255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64410594-24ae-4b8a-8572-6691f6a9ac4a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:51.810435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64410594-24ae-4b8a-8572-6691f6a9ac4a None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:51.811703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 766/1506] 10.222.0.15 () {52 vars in 829 bytes} [Fri May 27 19:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:55:51.815797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb687ab8-b3fe-46a5-bd06-b512e7f9f17b service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:55:51.876423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb687ab8-b3fe-46a5-bd06-b512e7f9f17b service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:55:51.880949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dcec5-4859-47ef-b59d-19b837c7e1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:55:51.881813 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dcec5-4859-47ef-b59d-19b837c7e1ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:51.882102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dcec5-4859-47ef-b59d-19b837c7e1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:51.882413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dcec5-4859-47ef-b59d-19b837c7e1ae admin admin] PATH_INFO: `/v3/users/bf2368df48a749329b7367000aeed45b` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:51.883594 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dcec5-4859-47ef-b59d-19b837c7e1ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2368df48a749329b7367000aeed45b)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:55:51.884609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: WARNING py.warnings [None req-703dcec5-4859-47ef-b59d-19b837c7e1ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 19:55:51.884609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: warnings.warn(msg) May 27 19:55:51.884609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: May 27 19:55:51.885819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dcec5-4859-47ef-b59d-19b837c7e1ae admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:55:52.158281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-703dcec5-4859-47ef-b59d-19b837c7e1ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2368df48a749329b7367000aeed45b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:55:52.158959 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-703dcec5-4859-47ef-b59d-19b837c7e1ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2368df48a749329b7367000aeed45b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:55:52.237207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-703dcec5-4859-47ef-b59d-19b837c7e1ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2368df48a749329b7367000aeed45b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:55:52.255104 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-703dcec5-4859-47ef-b59d-19b837c7e1ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2368df48a749329b7367000aeed45b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:55:52.263506 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:55:52.267675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-703dcec5-4859-47ef-b59d-19b837c7e1ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2368df48a749329b7367000aeed45b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:55:52.273823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 741/1507] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 19:55:51 2022] DELETE /identity/v3/users/bf2368df48a749329b7367000aeed45b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:55:52.278414 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28935b8b-320e-477c-877b-2237fe24a055 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:52.284612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28935b8b-320e-477c-877b-2237fe24a055 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:52.284612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28935b8b-320e-477c-877b-2237fe24a055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:52.296608 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-28935b8b-320e-477c-877b-2237fe24a055 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:55:52.298435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-28935b8b-320e-477c-877b-2237fe24a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:55:52.355487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 767/1508] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:55:52.365614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dcec5-4859-47ef-b59d-19b837c7e1ae admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:55:52.367016 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-703dcec5-4859-47ef-b59d-19b837c7e1ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:55:52.422588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dcec5-4859-47ef-b59d-19b837c7e1ae admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:55:52.426675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2ee2c-527c-484a-9662-80fefda7147d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:55:52.427322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2ee2c-527c-484a-9662-80fefda7147d service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:52.427608 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2ee2c-527c-484a-9662-80fefda7147d service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:52.427886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2ee2c-527c-484a-9662-80fefda7147d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:52.436545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2ee2c-527c-484a-9662-80fefda7147d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:55:52.437962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2ee2c-527c-484a-9662-80fefda7147d service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:55:52.447153 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 742/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:55:52.954492 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28935b8b-320e-477c-877b-2237fe24a055 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:55:52.956017 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-28935b8b-320e-477c-877b-2237fe24a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:55:52.967916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28935b8b-320e-477c-877b-2237fe24a055 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:55:52.972587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a93eb8-777e-4221-a850-45f0d46e3b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:55:52.973454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a93eb8-777e-4221-a850-45f0d46e3b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:55:52.973748 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a93eb8-777e-4221-a850-45f0d46e3b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:55:52.974033 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a93eb8-777e-4221-a850-45f0d46e3b63 admin admin] PATH_INFO: `/v3/projects/795183672d1d4440915c46d1a0ddbc7d` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:55:52.975284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a93eb8-777e-4221-a850-45f0d46e3b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=795183672d1d4440915c46d1a0ddbc7d)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:55:52.976324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: WARNING py.warnings [None req-74a93eb8-777e-4221-a850-45f0d46e3b63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 19:55:52.976324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: warnings.warn(msg) May 27 19:55:52.976324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: May 27 19:55:52.977552 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a93eb8-777e-4221-a850-45f0d46e3b63 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:55:53.149890 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-74a93eb8-777e-4221-a850-45f0d46e3b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '795183672d1d4440915c46d1a0ddbc7d', 'request_id': 'req-74a93eb8-777e-4221-a850-45f0d46e3b63'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:55:53.163109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-74a93eb8-777e-4221-a850-45f0d46e3b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '795183672d1d4440915c46d1a0ddbc7d', 'request_id': 'req-74a93eb8-777e-4221-a850-45f0d46e3b63'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:55:53.169144 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-74a93eb8-777e-4221-a850-45f0d46e3b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '795183672d1d4440915c46d1a0ddbc7d', 'request_id': 'req-74a93eb8-777e-4221-a850-45f0d46e3b63'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:55:53.265275 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-74a93eb8-777e-4221-a850-45f0d46e3b63 admin admin] The token cache is being invalidate because project 795183672d1d4440915c46d1a0ddbc7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 19:55:53.265518 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-74a93eb8-777e-4221-a850-45f0d46e3b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:55:53.266147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-74a93eb8-777e-4221-a850-45f0d46e3b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:55:53.268023 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 768/1510] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 19:55:52 2022] DELETE /identity/v3/projects/795183672d1d4440915c46d1a0ddbc7d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:56:02.443073 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=29 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:56:03.262023 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:57:41.448986 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcf778-6826-416b-b50a-38d3b4e0a277 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:41.449526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcf778-6826-416b-b50a-38d3b4e0a277 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:41.449634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcf778-6826-416b-b50a-38d3b4e0a277 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:41.450970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 743/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 19:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:57:41.456353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5f4d0-c760-469e-883f-5faf5d8e7ff7 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:41.456762 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5f4d0-c760-469e-883f-5faf5d8e7ff7 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:41.456922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5f4d0-c760-469e-883f-5faf5d8e7ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:41.476837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e5a5f4d0-c760-469e-883f-5faf5d8e7ff7 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:57:41.478067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e5a5f4d0-c760-469e-883f-5faf5d8e7ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:57:41.536084 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 769/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 19:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:57:41.704472 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcf778-6826-416b-b50a-38d3b4e0a277 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:57:41.706970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c9dcf778-6826-416b-b50a-38d3b4e0a277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:57:41.782549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcf778-6826-416b-b50a-38d3b4e0a277 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:57:41.788536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4df0f-73ce-4cf8-aa3b-20201b4d48a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:57:41.789192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4df0f-73ce-4cf8-aa3b-20201b4d48a9 service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:41.789494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4df0f-73ce-4cf8-aa3b-20201b4d48a9 service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:41.789778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4df0f-73ce-4cf8-aa3b-20201b4d48a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:41.798090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4df0f-73ce-4cf8-aa3b-20201b4d48a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:57:41.799777 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4df0f-73ce-4cf8-aa3b-20201b4d48a9 service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:57:41.809695 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 744/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:57:42.545001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f442e-2a9b-4115-9cfa-ae5f70455809 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:42.545560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f442e-2a9b-4115-9cfa-ae5f70455809 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:42.545560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f442e-2a9b-4115-9cfa-ae5f70455809 None None] PATH_INFO: `/v3` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:42.546897 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 770/1514] 10.222.0.24 () {54 vars in 925 bytes} [Fri May 27 19:57:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:57:42.582793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad775f3-0504-445d-a447-f296bb65f8f3 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:42.583328 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad775f3-0504-445d-a447-f296bb65f8f3 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:42.583437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad775f3-0504-445d-a447-f296bb65f8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:42.602056 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-0ad775f3-0504-445d-a447-f296bb65f8f3 None None] MFA Rules not processed for user `394b43cef91f4990b4707cb7a6798068`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:57:42.603312 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-0ad775f3-0504-445d-a447-f296bb65f8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:57:42.669897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 745/1515] 10.222.0.24 () {58 vars in 1015 bytes} [Fri May 27 19:57:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:57:42.691867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd73b0-b608-4ae0-b8b7-022b1b491f28 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:42.692100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd73b0-b608-4ae0-b8b7-022b1b491f28 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:42.692383 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd73b0-b608-4ae0-b8b7-022b1b491f28 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:42.693832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 771/1516] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 19:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:57:42.698644 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eed67-fa35-4507-8a93-5e19281d7bfc None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:42.698938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eed67-fa35-4507-8a93-5e19281d7bfc None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:42.699218 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eed67-fa35-4507-8a93-5e19281d7bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:42.717366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-7e8eed67-fa35-4507-8a93-5e19281d7bfc None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:57:42.718606 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-7e8eed67-fa35-4507-8a93-5e19281d7bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:57:42.726979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 746/1517] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 19:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:57:42.877481 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd73b0-b608-4ae0-b8b7-022b1b491f28 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:57:42.891984 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dd73b0-b608-4ae0-b8b7-022b1b491f28 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:57:42.897362 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f1ee5-b939-4e5b-bbec-22ad71b90251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:57:42.898034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f1ee5-b939-4e5b-bbec-22ad71b90251 service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:42.898358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f1ee5-b939-4e5b-bbec-22ad71b90251 service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:42.898665 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f1ee5-b939-4e5b-bbec-22ad71b90251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:42.906748 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f1ee5-b939-4e5b-bbec-22ad71b90251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:57:42.908849 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f1ee5-b939-4e5b-bbec-22ad71b90251 service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:57:42.918094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 772/1518] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:57:46.697962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f048aac-baee-40f4-b143-faafef53592b None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:46.698497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f048aac-baee-40f4-b143-faafef53592b None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:46.698497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f048aac-baee-40f4-b143-faafef53592b None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:46.699880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 747/1519] 10.222.0.15 () {54 vars in 960 bytes} [Fri May 27 19:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:57:46.704868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49acc3f-3e98-4288-a62b-53361a7f3cd0 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:46.705809 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49acc3f-3e98-4288-a62b-53361a7f3cd0 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:46.705940 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49acc3f-3e98-4288-a62b-53361a7f3cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:46.723599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a49acc3f-3e98-4288-a62b-53361a7f3cd0 None None] MFA Rules not processed for user `394b43cef91f4990b4707cb7a6798068`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:57:46.724788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a49acc3f-3e98-4288-a62b-53361a7f3cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:57:46.733120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 773/1520] 10.222.0.15 () {58 vars in 1057 bytes} [Fri May 27 19:57:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:57:46.740461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f048aac-baee-40f4-b143-faafef53592b None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:57:46.754068 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f048aac-baee-40f4-b143-faafef53592b None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:57:46.758994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e47a47-9bd9-41f8-820a-8c8709cf6b39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394b43cef91f4990b4707cb7a6798068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:57:46.759685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e47a47-9bd9-41f8-820a-8c8709cf6b39 service placement] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:46.759979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e47a47-9bd9-41f8-820a-8c8709cf6b39 service placement] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:46.760261 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e47a47-9bd9-41f8-820a-8c8709cf6b39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:46.769420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e47a47-9bd9-41f8-820a-8c8709cf6b39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:57:46.771059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e47a47-9bd9-41f8-820a-8c8709cf6b39 service placement] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:57:46.780699 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 748/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:57:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:57:54.186702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6a473-f26c-457f-a273-02263b4f6517 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:54.187248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6a473-f26c-457f-a273-02263b4f6517 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:54.187248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6a473-f26c-457f-a273-02263b4f6517 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:54.191291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 774/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 19:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:57:54.194793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50226e-8113-47c8-a4bb-b811515021d6 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:54.195196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50226e-8113-47c8-a4bb-b811515021d6 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:54.195375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50226e-8113-47c8-a4bb-b811515021d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:54.214160 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-ac50226e-8113-47c8-a4bb-b811515021d6 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:57:54.215392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-ac50226e-8113-47c8-a4bb-b811515021d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:57:54.223233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 749/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 19:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:57:54.387916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6a473-f26c-457f-a273-02263b4f6517 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:57:54.402417 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6a473-f26c-457f-a273-02263b4f6517 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:57:54.407698 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220517b-bea4-4c72-81f2-79237610eb61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:57:54.408327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220517b-bea4-4c72-81f2-79237610eb61 service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:54.408613 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220517b-bea4-4c72-81f2-79237610eb61 service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:54.408888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220517b-bea4-4c72-81f2-79237610eb61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:54.416997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220517b-bea4-4c72-81f2-79237610eb61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:57:54.418607 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220517b-bea4-4c72-81f2-79237610eb61 service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:57:54.427864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 775/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:57:55.290447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb9c96-75b2-47b5-89f1-7743e929ef49 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:55.291019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb9c96-75b2-47b5-89f1-7743e929ef49 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:55.291019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb9c96-75b2-47b5-89f1-7743e929ef49 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:55.292370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 750/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 19:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:57:55.297159 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a21b74-ca7d-4dd9-9a86-6317cfd2f360 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:55.297556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a21b74-ca7d-4dd9-9a86-6317cfd2f360 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:55.297736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a21b74-ca7d-4dd9-9a86-6317cfd2f360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:55.316584 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a4a21b74-ca7d-4dd9-9a86-6317cfd2f360 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:57:55.317777 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a4a21b74-ca7d-4dd9-9a86-6317cfd2f360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:57:55.325503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 776/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:57:55.476518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb9c96-75b2-47b5-89f1-7743e929ef49 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:57:55.491532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb9c96-75b2-47b5-89f1-7743e929ef49 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:57:55.497214 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680d605-6aae-406b-b4f5-83a163527581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:57:55.497862 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d605-6aae-406b-b4f5-83a163527581 service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:55.498152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d605-6aae-406b-b4f5-83a163527581 service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:55.498473 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d605-6aae-406b-b4f5-83a163527581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:55.507693 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680d605-6aae-406b-b4f5-83a163527581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:57:55.509270 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680d605-6aae-406b-b4f5-83a163527581 service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:57:55.518949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 751/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:57:59.562240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafecbe-8e88-47fc-a827-1a80a32cbc29 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:59.562826 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafecbe-8e88-47fc-a827-1a80a32cbc29 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:59.562925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafecbe-8e88-47fc-a827-1a80a32cbc29 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:59.564242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 777/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 19:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:57:59.569441 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43ba8f-1321-4c14-9dad-4ea2388e430c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:59.569885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43ba8f-1321-4c14-9dad-4ea2388e430c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:59.569991 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43ba8f-1321-4c14-9dad-4ea2388e430c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:59.587576 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-1a43ba8f-1321-4c14-9dad-4ea2388e430c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:57:59.588866 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-1a43ba8f-1321-4c14-9dad-4ea2388e430c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:57:59.597049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 752/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 19:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:57:59.633079 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafecbe-8e88-47fc-a827-1a80a32cbc29 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:57:59.634766 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5dafecbe-8e88-47fc-a827-1a80a32cbc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:57:59.691946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafecbe-8e88-47fc-a827-1a80a32cbc29 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:57:59.695363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d2351-03fe-49d7-aa3f-ffec0fc09c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:57:59.695999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d2351-03fe-49d7-aa3f-ffec0fc09c85 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:57:59.696284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d2351-03fe-49d7-aa3f-ffec0fc09c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:57:59.696559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d2351-03fe-49d7-aa3f-ffec0fc09c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:57:59.705803 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d2351-03fe-49d7-aa3f-ffec0fc09c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:57:59.707291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d2351-03fe-49d7-aa3f-ffec0fc09c85 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:57:59.716410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 778/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:58:01.874013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247923-c3dd-43bf-b966-cf7933e1d09f None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:58:01.874614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247923-c3dd-43bf-b966-cf7933e1d09f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:58:01.874614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd247923-c3dd-43bf-b966-cf7933e1d09f None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:58:01.876028 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 753/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 19:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:58:01.881220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eaa64-482c-4068-bc2f-f0db5c09c9ab None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:58:01.881668 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eaa64-482c-4068-bc2f-f0db5c09c9ab None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:58:01.881852 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eaa64-482c-4068-bc2f-f0db5c09c9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:58:01.900059 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c42eaa64-482c-4068-bc2f-f0db5c09c9ab None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:58:01.901240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c42eaa64-482c-4068-bc2f-f0db5c09c9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:58:01.909546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 779/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 19:58:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:58:01.944637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd247923-c3dd-43bf-b966-cf7933e1d09f None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:58:01.956104 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd247923-c3dd-43bf-b966-cf7933e1d09f None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:58:01.959572 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed68a2-07af-4405-bb63-9fb35596636b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:58:01.960204 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed68a2-07af-4405-bb63-9fb35596636b service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:58:01.960487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed68a2-07af-4405-bb63-9fb35596636b service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:58:01.960764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed68a2-07af-4405-bb63-9fb35596636b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:58:01.970446 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed68a2-07af-4405-bb63-9fb35596636b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:58:01.971859 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed68a2-07af-4405-bb63-9fb35596636b service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:58:01.981318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 754/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:58:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:58:05.656095 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32685069-8414-48de-bb6a-612d6f2dd1b9 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:58:05.656742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32685069-8414-48de-bb6a-612d6f2dd1b9 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:58:05.656742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32685069-8414-48de-bb6a-612d6f2dd1b9 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:58:05.658102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 780/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 19:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:58:05.663362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b22f-1ae4-4dc9-a0c8-171bddb4fd72 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:58:05.663824 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b22f-1ae4-4dc9-a0c8-171bddb4fd72 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:58:05.663934 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b22f-1ae4-4dc9-a0c8-171bddb4fd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:58:05.670191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=91 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:58:05.682216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-c5e4b22f-1ae4-4dc9-a0c8-171bddb4fd72 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:58:05.683484 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c5e4b22f-1ae4-4dc9-a0c8-171bddb4fd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:58:05.691927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 755/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 19:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:58:05.964468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32685069-8414-48de-bb6a-612d6f2dd1b9 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:58:05.966105 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-32685069-8414-48de-bb6a-612d6f2dd1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:58:05.972003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=75 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:58:06.023947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32685069-8414-48de-bb6a-612d6f2dd1b9 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:58:06.027441 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5c10e-d657-4b85-a2f8-159269435e3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:58:06.028121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5c10e-d657-4b85-a2f8-159269435e3c service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:58:06.028404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5c10e-d657-4b85-a2f8-159269435e3c service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:58:06.028683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5c10e-d657-4b85-a2f8-159269435e3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:58:06.037680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5c10e-d657-4b85-a2f8-159269435e3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:58:06.039174 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5c10e-d657-4b85-a2f8-159269435e3c service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:58:06.049141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 781/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:58:08.274979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988d08c-32d8-439e-b618-b0b3e356dd08 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:58:08.275555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988d08c-32d8-439e-b618-b0b3e356dd08 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:58:08.275555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988d08c-32d8-439e-b618-b0b3e356dd08 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:58:08.276925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 756/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 19:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:58:08.282398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d63fed-a99d-4283-a214-2b24700a8eac None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:58:08.282881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d63fed-a99d-4283-a214-2b24700a8eac None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:58:08.283001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d63fed-a99d-4283-a214-2b24700a8eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:58:08.300593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-10d63fed-a99d-4283-a214-2b24700a8eac None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:58:08.301803 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-10d63fed-a99d-4283-a214-2b24700a8eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:58:08.309872 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 782/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 19:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:58:08.580398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988d08c-32d8-439e-b618-b0b3e356dd08 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:58:08.582063 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-3988d08c-32d8-439e-b618-b0b3e356dd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:58:08.595427 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988d08c-32d8-439e-b618-b0b3e356dd08 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:58:08.598891 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4f67f-c718-40a1-8b01-6e50322c708b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:58:08.599525 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4f67f-c718-40a1-8b01-6e50322c708b service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:58:08.599812 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4f67f-c718-40a1-8b01-6e50322c708b service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:58:08.600091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4f67f-c718-40a1-8b01-6e50322c708b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:58:08.608867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4f67f-c718-40a1-8b01-6e50322c708b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:58:08.610914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4f67f-c718-40a1-8b01-6e50322c708b service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:58:08.620174 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 757/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:58:18.295862 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=28 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:58:18.616087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=8 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:40.805522 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92560e0f-802b-439a-b7cc-0b6817aecdac None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:40.806720 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92560e0f-802b-439a-b7cc-0b6817aecdac None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:40.807858 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92560e0f-802b-439a-b7cc-0b6817aecdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:40.843485 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-92560e0f-802b-439a-b7cc-0b6817aecdac None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:40.845150 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-92560e0f-802b-439a-b7cc-0b6817aecdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:40.857736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 783/1540] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:40.867711 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a12779-01b6-40a5-9a4a-c077145990be None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:40.868760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a12779-01b6-40a5-9a4a-c077145990be None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:40.869259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a12779-01b6-40a5-9a4a-c077145990be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:40.895918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-f9a12779-01b6-40a5-9a4a-c077145990be None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:40.897662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f9a12779-01b6-40a5-9a4a-c077145990be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:40.912108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 758/1541] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:40.917897 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92560e0f-802b-439a-b7cc-0b6817aecdac None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:40.932084 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92560e0f-802b-439a-b7cc-0b6817aecdac None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:40.939196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ee74a-251d-4ca7-907c-6fa198903b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:40.940148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ee74a-251d-4ca7-907c-6fa198903b9c admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:40.940649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ee74a-251d-4ca7-907c-6fa198903b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:40.941132 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ee74a-251d-4ca7-907c-6fa198903b9c admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:40.942078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ee74a-251d-4ca7-907c-6fa198903b9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:59:40.942625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ee74a-251d-4ca7-907c-6fa198903b9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:40.944489 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ee74a-251d-4ca7-907c-6fa198903b9c admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:40.958930 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 784/1542] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 19:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:59:40.967792 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a12779-01b6-40a5-9a4a-c077145990be None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:40.978277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a12779-01b6-40a5-9a4a-c077145990be None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:40.984332 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670851ef-157b-45fb-8524-69c068cb7ca6 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:40.984907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670851ef-157b-45fb-8524-69c068cb7ca6 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:40.985404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670851ef-157b-45fb-8524-69c068cb7ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.000298 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dd4d9-cd98-42c4-9b24-872a176f5e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:41.000298 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dd4d9-cd98-42c4-9b24-872a176f5e5f admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.000298 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dd4d9-cd98-42c4-9b24-872a176f5e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.000298 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dd4d9-cd98-42c4-9b24-872a176f5e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.000715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1dd4d9-cd98-42c4-9b24-872a176f5e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:41.000715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1dd4d9-cd98-42c4-9b24-872a176f5e5f admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:41.022061 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-670851ef-157b-45fb-8524-69c068cb7ca6 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:41.027791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-670851ef-157b-45fb-8524-69c068cb7ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:41.054102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 785/1543] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:41.066148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd9100-023e-4c5f-85e3-30f54f4ae0a6 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.066384 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd9100-023e-4c5f-85e3-30f54f4ae0a6 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.066817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd9100-023e-4c5f-85e3-30f54f4ae0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.107715 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-8bcd9100-023e-4c5f-85e3-30f54f4ae0a6 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:41.109131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8bcd9100-023e-4c5f-85e3-30f54f4ae0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:41.123222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 786/1544] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 27 19:59:41.124322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb7f7b-3401-4d78-9633-636705d927b2 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.124614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb7f7b-3401-4d78-9633-636705d927b2 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.124894 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb7f7b-3401-4d78-9633-636705d927b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.161592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 759/1545] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:40 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:41.162558 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dd4d9-cd98-42c4-9b24-872a176f5e5f admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.163597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-97cb7f7b-3401-4d78-9633-636705d927b2 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:41.164852 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-97cb7f7b-3401-4d78-9633-636705d927b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:41.294074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 787/1546] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:41.295521 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e728d7e-6735-4693-8c25-80e503932dfd None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.295819 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e728d7e-6735-4693-8c25-80e503932dfd None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.296102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e728d7e-6735-4693-8c25-80e503932dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.297685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dd4d9-cd98-42c4-9b24-872a176f5e5f admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:41.305968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33418e3-ca25-4acb-815c-a326fa190da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:41.306817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33418e3-ca25-4acb-815c-a326fa190da5 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.307788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33418e3-ca25-4acb-815c-a326fa190da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.308081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33418e3-ca25-4acb-815c-a326fa190da5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.309333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33418e3-ca25-4acb-815c-a326fa190da5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:59:41.309647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33418e3-ca25-4acb-815c-a326fa190da5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:41.310705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: WARNING py.warnings [None req-e33418e3-ca25-4acb-815c-a326fa190da5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 19:59:41.310705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: warnings.warn(msg) May 27 19:59:41.310705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: May 27 19:59:41.312151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33418e3-ca25-4acb-815c-a326fa190da5 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:41.321921 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-7e728d7e-6735-4693-8c25-80e503932dfd None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:41.323657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-7e728d7e-6735-4693-8c25-80e503932dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:41.326655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 760/1547] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 19:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:59:41.327615 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33418e3-ca25-4acb-815c-a326fa190da5 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.333025 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 788/1548] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:41.334773 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc77c5-07c6-4479-9f19-7237eab211a4 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.335235 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc77c5-07c6-4479-9f19-7237eab211a4 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.335680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc77c5-07c6-4479-9f19-7237eab211a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.339216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33418e3-ca25-4acb-815c-a326fa190da5 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:41.344718 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953044e3-e0b1-464d-b310-819ff3cb727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:41.345362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953044e3-e0b1-464d-b310-819ff3cb727a admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.345655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953044e3-e0b1-464d-b310-819ff3cb727a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.345940 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953044e3-e0b1-464d-b310-819ff3cb727a admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.346674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953044e3-e0b1-464d-b310-819ff3cb727a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:41.347690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: WARNING py.warnings [None req-953044e3-e0b1-464d-b310-819ff3cb727a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 19:59:41.347690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: warnings.warn(msg) May 27 19:59:41.347690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: May 27 19:59:41.348922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953044e3-e0b1-464d-b310-819ff3cb727a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:41.355344 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-70fc77c5-07c6-4479-9f19-7237eab211a4 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:41.356536 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-70fc77c5-07c6-4479-9f19-7237eab211a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:41.364411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 789/1549] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:41.365643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae84df-ad4a-4911-a077-a3e2b24ee03e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.365966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae84df-ad4a-4911-a077-a3e2b24ee03e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.366267 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae84df-ad4a-4911-a077-a3e2b24ee03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.387873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-5dae84df-ad4a-4911-a077-a3e2b24ee03e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:41.389072 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5dae84df-ad4a-4911-a077-a3e2b24ee03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:41.396758 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 790/1550] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:41.397945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4957fe-bbda-4600-be9f-be046fd83d88 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.406945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4957fe-bbda-4600-be9f-be046fd83d88 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.406945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4957fe-bbda-4600-be9f-be046fd83d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.415399 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-5e4957fe-bbda-4600-be9f-be046fd83d88 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:41.416588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5e4957fe-bbda-4600-be9f-be046fd83d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:41.424227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 791/1551] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:41.425404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542addc5-193b-4956-ba97-7b478af62932 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.425692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542addc5-193b-4956-ba97-7b478af62932 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.425969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542addc5-193b-4956-ba97-7b478af62932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.433148 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 761/1552] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:41.434101 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953044e3-e0b1-464d-b310-819ff3cb727a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.444186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953044e3-e0b1-464d-b310-819ff3cb727a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:41.444454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-542addc5-193b-4956-ba97-7b478af62932 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:41.445637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-542addc5-193b-4956-ba97-7b478af62932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:41.449495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4df3d-9845-4888-a8f7-a87e717972fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:41.450147 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4df3d-9845-4888-a8f7-a87e717972fd admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.450470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4df3d-9845-4888-a8f7-a87e717972fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.450738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4df3d-9845-4888-a8f7-a87e717972fd admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.451422 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4df3d-9845-4888-a8f7-a87e717972fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:41.453434 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4df3d-9845-4888-a8f7-a87e717972fd admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:41.454161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 792/1553] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:41.455486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae741e0-8bd2-4fa4-849a-cb6dc38d8e21 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.455785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae741e0-8bd2-4fa4-849a-cb6dc38d8e21 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.456068 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae741e0-8bd2-4fa4-849a-cb6dc38d8e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.475132 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-dae741e0-8bd2-4fa4-849a-cb6dc38d8e21 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:41.476864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-dae741e0-8bd2-4fa4-849a-cb6dc38d8e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:41.485083 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 793/1554] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:41.488631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283376-0c25-4fc0-906b-3d9d4ef1bbbe None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.488631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283376-0c25-4fc0-906b-3d9d4ef1bbbe None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.488631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1283376-0c25-4fc0-906b-3d9d4ef1bbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.505368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a1283376-0c25-4fc0-906b-3d9d4ef1bbbe None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:41.506562 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a1283376-0c25-4fc0-906b-3d9d4ef1bbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:41.515014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 794/1555] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:41.517177 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a852264-7371-4358-984c-93e137b35a8e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.517501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a852264-7371-4358-984c-93e137b35a8e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.517786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a852264-7371-4358-984c-93e137b35a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.535643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-1a852264-7371-4358-984c-93e137b35a8e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:41.536827 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-1a852264-7371-4358-984c-93e137b35a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:41.542443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 762/1556] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:41.543730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e87e1a-92b3-45c8-9828-1dd03e257a63 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.544059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e87e1a-92b3-45c8-9828-1dd03e257a63 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.544341 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e87e1a-92b3-45c8-9828-1dd03e257a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.547740 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 795/1557] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:41.548540 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a852264-7371-4358-984c-93e137b35a8e None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.561638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a852264-7371-4358-984c-93e137b35a8e None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:41.566100 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-82e87e1a-92b3-45c8-9828-1dd03e257a63 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:41.567348 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-82e87e1a-92b3-45c8-9828-1dd03e257a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:41.617221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae251301-222e-480d-b63c-f0223e000de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:41.617808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae251301-222e-480d-b63c-f0223e000de3 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.618094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae251301-222e-480d-b63c-f0223e000de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.618405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae251301-222e-480d-b63c-f0223e000de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.619130 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae251301-222e-480d-b63c-f0223e000de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:59:41.619975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae251301-222e-480d-b63c-f0223e000de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:41.621595 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae251301-222e-480d-b63c-f0223e000de3 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:41.626289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 763/1558] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:41.627159 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e87e1a-92b3-45c8-9828-1dd03e257a63 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.640469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 796/1559] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 19:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:59:41.640469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76b9f2-99c2-4d7f-84d4-d9c312fa6e1e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.640469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76b9f2-99c2-4d7f-84d4-d9c312fa6e1e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.640469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76b9f2-99c2-4d7f-84d4-d9c312fa6e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.640920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e87e1a-92b3-45c8-9828-1dd03e257a63 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:41.644936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96d121-2c40-4a52-bc33-d1b9b86914d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:41.645595 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96d121-2c40-4a52-bc33-d1b9b86914d4 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.645880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96d121-2c40-4a52-bc33-d1b9b86914d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.646157 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96d121-2c40-4a52-bc33-d1b9b86914d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.646914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96d121-2c40-4a52-bc33-d1b9b86914d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:41.648513 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96d121-2c40-4a52-bc33-d1b9b86914d4 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:41.657921 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-af76b9f2-99c2-4d7f-84d4-d9c312fa6e1e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:41.659178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-af76b9f2-99c2-4d7f-84d4-d9c312fa6e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:41.662635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 764/1560] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:41.662635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96d121-2c40-4a52-bc33-d1b9b86914d4 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.670075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 797/1561] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:41.671396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16de56a-5630-41ab-a4f1-2b332e451335 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.671695 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16de56a-5630-41ab-a4f1-2b332e451335 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.671975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16de56a-5630-41ab-a4f1-2b332e451335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.672613 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96d121-2c40-4a52-bc33-d1b9b86914d4 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:41.677140 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac14b-4aaa-42e1-9c32-06845719b984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:41.677775 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac14b-4aaa-42e1-9c32-06845719b984 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.678060 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac14b-4aaa-42e1-9c32-06845719b984 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.678304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:41.678562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac14b-4aaa-42e1-9c32-06845719b984 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.679145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aac14b-4aaa-42e1-9c32-06845719b984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:59:41.679436 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aac14b-4aaa-42e1-9c32-06845719b984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:41.681024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aac14b-4aaa-42e1-9c32-06845719b984 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:41.690142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a16de56a-5630-41ab-a4f1-2b332e451335 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:41.691775 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a16de56a-5630-41ab-a4f1-2b332e451335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:41.694093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 765/1562] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 19:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:59:41.694962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac14b-4aaa-42e1-9c32-06845719b984 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.700337 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:41.705029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 798/1563] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:41.705029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16de56a-5630-41ab-a4f1-2b332e451335 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.708587 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac14b-4aaa-42e1-9c32-06845719b984 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:41.714711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16de56a-5630-41ab-a4f1-2b332e451335 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:41.714944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954276f-2736-40de-8a7c-6dfcaaaf3132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:41.720266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954276f-2736-40de-8a7c-6dfcaaaf3132 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.720266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954276f-2736-40de-8a7c-6dfcaaaf3132 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.720266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954276f-2736-40de-8a7c-6dfcaaaf3132 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.720266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954276f-2736-40de-8a7c-6dfcaaaf3132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:41.720761 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25c07d-bf04-4d3e-bce9-702512aac1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:41.720761 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25c07d-bf04-4d3e-bce9-702512aac1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.720761 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25c07d-bf04-4d3e-bce9-702512aac1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.721049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954276f-2736-40de-8a7c-6dfcaaaf3132 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:41.721139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25c07d-bf04-4d3e-bce9-702512aac1d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.723420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25c07d-bf04-4d3e-bce9-702512aac1d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:59:41.723420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25c07d-bf04-4d3e-bce9-702512aac1d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:41.723420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25c07d-bf04-4d3e-bce9-702512aac1d0 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:41.735348 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 799/1564] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 19:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:59:41.736146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25c07d-bf04-4d3e-bce9-702512aac1d0 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.745631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25c07d-bf04-4d3e-bce9-702512aac1d0 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:41.750222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d3768-c5f8-4d46-a08d-c165580b3126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:41.750897 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d3768-c5f8-4d46-a08d-c165580b3126 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.751187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d3768-c5f8-4d46-a08d-c165580b3126 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.751470 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9d3768-c5f8-4d46-a08d-c165580b3126 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.752193 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d3768-c5f8-4d46-a08d-c165580b3126 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:59:41.752510 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d3768-c5f8-4d46-a08d-c165580b3126 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:41.754148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9d3768-c5f8-4d46-a08d-c165580b3126 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:41.766565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 800/1565] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 19:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:59:41.767314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d3768-c5f8-4d46-a08d-c165580b3126 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.778826 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9d3768-c5f8-4d46-a08d-c165580b3126 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:41.783454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d270d-c4e4-4455-93af-5961ccb25a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:41.784063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d270d-c4e4-4455-93af-5961ccb25a86 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.784357 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d270d-c4e4-4455-93af-5961ccb25a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.784641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d270d-c4e4-4455-93af-5961ccb25a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.785322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d270d-c4e4-4455-93af-5961ccb25a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:41.786319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: WARNING py.warnings [None req-6a2d270d-c4e4-4455-93af-5961ccb25a86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 19:59:41.786319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: warnings.warn(msg) May 27 19:59:41.786319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: May 27 19:59:41.787529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d270d-c4e4-4455-93af-5961ccb25a86 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:41.808395 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 766/1566] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:41.812094 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954276f-2736-40de-8a7c-6dfcaaaf3132 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.818675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954276f-2736-40de-8a7c-6dfcaaaf3132 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:41.823778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873d76c-73ae-4d10-83b1-9c1084a7431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:41.824413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873d76c-73ae-4d10-83b1-9c1084a7431a admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.824705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873d76c-73ae-4d10-83b1-9c1084a7431a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.824989 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873d76c-73ae-4d10-83b1-9c1084a7431a admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.825709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873d76c-73ae-4d10-83b1-9c1084a7431a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:41.827320 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873d76c-73ae-4d10-83b1-9c1084a7431a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:41.836964 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 767/1567] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:41.837731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873d76c-73ae-4d10-83b1-9c1084a7431a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.847362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873d76c-73ae-4d10-83b1-9c1084a7431a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:41.851886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119c7cd-32fd-4d1a-bbf8-04b1a60ddc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:41.852696 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119c7cd-32fd-4d1a-bbf8-04b1a60ddc30 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.853229 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119c7cd-32fd-4d1a-bbf8-04b1a60ddc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.853862 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119c7cd-32fd-4d1a-bbf8-04b1a60ddc30 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.854608 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119c7cd-32fd-4d1a-bbf8-04b1a60ddc30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:59:41.854924 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119c7cd-32fd-4d1a-bbf8-04b1a60ddc30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:41.856459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119c7cd-32fd-4d1a-bbf8-04b1a60ddc30 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:41.868829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 768/1568] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 19:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:59:41.869696 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119c7cd-32fd-4d1a-bbf8-04b1a60ddc30 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.878905 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119c7cd-32fd-4d1a-bbf8-04b1a60ddc30 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:41.883724 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91b806-3c0a-4a04-a5f3-fe9b78bbec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:41.884355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91b806-3c0a-4a04-a5f3-fe9b78bbec7b admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.884648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91b806-3c0a-4a04-a5f3-fe9b78bbec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.884931 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91b806-3c0a-4a04-a5f3-fe9b78bbec7b admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.886284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91b806-3c0a-4a04-a5f3-fe9b78bbec7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:41.894758 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91b806-3c0a-4a04-a5f3-fe9b78bbec7b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:41.894898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 801/1569] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:41.894898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d270d-c4e4-4455-93af-5961ccb25a86 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.955640 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d270d-c4e4-4455-93af-5961ccb25a86 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:41.962412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 769/1570] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:41.962412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91b806-3c0a-4a04-a5f3-fe9b78bbec7b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.963876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fc059-f24e-4e1c-b312-e94356f1cb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:41.964633 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fc059-f24e-4e1c-b312-e94356f1cb6d admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:41.964925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fc059-f24e-4e1c-b312-e94356f1cb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:41.965206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fc059-f24e-4e1c-b312-e94356f1cb6d admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:41.966018 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fc059-f24e-4e1c-b312-e94356f1cb6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:59:41.966386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fc059-f24e-4e1c-b312-e94356f1cb6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:41.968210 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fc059-f24e-4e1c-b312-e94356f1cb6d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:41.980227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 802/1571] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 19:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:59:41.981042 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fc059-f24e-4e1c-b312-e94356f1cb6d admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:41.990874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fc059-f24e-4e1c-b312-e94356f1cb6d admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:42.031211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91b806-3c0a-4a04-a5f3-fe9b78bbec7b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:42.038299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e71d41-5770-4467-b6c5-10a2b5d7d993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:42.039363 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e71d41-5770-4467-b6c5-10a2b5d7d993 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.039836 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e71d41-5770-4467-b6c5-10a2b5d7d993 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.040304 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e71d41-5770-4467-b6c5-10a2b5d7d993 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.041364 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e71d41-5770-4467-b6c5-10a2b5d7d993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:42.045043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e71d41-5770-4467-b6c5-10a2b5d7d993 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:42.058952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fce12-bfb1-4c8a-81d0-c7d78265527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:42.059965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fce12-bfb1-4c8a-81d0-c7d78265527f admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.060436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fce12-bfb1-4c8a-81d0-c7d78265527f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.060859 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fce12-bfb1-4c8a-81d0-c7d78265527f admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.061927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fce12-bfb1-4c8a-81d0-c7d78265527f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:42.064455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fce12-bfb1-4c8a-81d0-c7d78265527f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:42.198848 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 770/1572] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/projects => generated 405 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:42.199764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e71d41-5770-4467-b6c5-10a2b5d7d993 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:42.227664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 803/1573] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:41 2022] POST /identity/v3/projects => generated 375 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:42.227664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fce12-bfb1-4c8a-81d0-c7d78265527f admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:42.257822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:42.270811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e71d41-5770-4467-b6c5-10a2b5d7d993 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:42.289445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fce12-bfb1-4c8a-81d0-c7d78265527f admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:42.294760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d2003-67db-43f6-b513-f0c19d3ea291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:42.295678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d2003-67db-43f6-b513-f0c19d3ea291 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.299523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d2003-67db-43f6-b513-f0c19d3ea291 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.299523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d2003-67db-43f6-b513-f0c19d3ea291 admin admin] PATH_INFO: `/v3/projects/2c8924b178354b5e97abd9096ca7ea4b/users/0184375e869e4a9aac742ccb0b228218/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.305114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:42.311679 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d2003-67db-43f6-b513-f0c19d3ea291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8924b178354b5e97abd9096ca7ea4b, user_id=0184375e869e4a9aac742ccb0b228218, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:42.312744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: WARNING py.warnings [None req-6e5d2003-67db-43f6-b513-f0c19d3ea291 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 19:59:42.312744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: warnings.warn(msg) May 27 19:59:42.312744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: May 27 19:59:42.314776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d2003-67db-43f6-b513-f0c19d3ea291 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:42.332828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff0782-4485-4374-901e-498cd3ca187a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:42.333499 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff0782-4485-4374-901e-498cd3ca187a admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.333785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff0782-4485-4374-901e-498cd3ca187a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.334099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff0782-4485-4374-901e-498cd3ca187a admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.334850 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff0782-4485-4374-901e-498cd3ca187a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:42.336430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff0782-4485-4374-901e-498cd3ca187a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:42.345893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 771/1574] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:42.346805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff0782-4485-4374-901e-498cd3ca187a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:42.355814 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff0782-4485-4374-901e-498cd3ca187a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:42.362581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532d580-8365-4e9c-97a4-0be33496c8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:42.362581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d580-8365-4e9c-97a4-0be33496c8df admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.362581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d580-8365-4e9c-97a4-0be33496c8df admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.362581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532d580-8365-4e9c-97a4-0be33496c8df admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.362962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532d580-8365-4e9c-97a4-0be33496c8df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:42.363917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532d580-8365-4e9c-97a4-0be33496c8df admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:42.387917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 804/1575] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:42 2022] PUT /identity/v3/projects/2c8924b178354b5e97abd9096ca7ea4b/users/0184375e869e4a9aac742ccb0b228218/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:42.388557 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d2003-67db-43f6-b513-f0c19d3ea291 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:42.448263 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d2003-67db-43f6-b513-f0c19d3ea291 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:42.452992 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584851d-04f5-4f16-8a9a-a157e91cebbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:42.453602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584851d-04f5-4f16-8a9a-a157e91cebbc admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.453888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584851d-04f5-4f16-8a9a-a157e91cebbc admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.454168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5584851d-04f5-4f16-8a9a-a157e91cebbc admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.454906 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584851d-04f5-4f16-8a9a-a157e91cebbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:42.456836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5584851d-04f5-4f16-8a9a-a157e91cebbc admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:42.457557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 772/1576] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:42 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:42.458370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532d580-8365-4e9c-97a4-0be33496c8df admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:42.525782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532d580-8365-4e9c-97a4-0be33496c8df admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:42.530508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37348c36-dc22-4992-b93b-cd5b832e4133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:42.531185 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348c36-dc22-4992-b93b-cd5b832e4133 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.531549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348c36-dc22-4992-b93b-cd5b832e4133 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.531843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348c36-dc22-4992-b93b-cd5b832e4133 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.532605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37348c36-dc22-4992-b93b-cd5b832e4133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:42.534569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37348c36-dc22-4992-b93b-cd5b832e4133 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:42.550651 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 805/1577] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:42 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:42.554155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584851d-04f5-4f16-8a9a-a157e91cebbc admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:42.562187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5584851d-04f5-4f16-8a9a-a157e91cebbc admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:42.567154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fd84c-5ae5-4d2b-abfd-e9575f2b4ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:42.567789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fd84c-5ae5-4d2b-abfd-e9575f2b4ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.568073 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fd84c-5ae5-4d2b-abfd-e9575f2b4ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.568353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fd84c-5ae5-4d2b-abfd-e9575f2b4ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.569030 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fd84c-5ae5-4d2b-abfd-e9575f2b4ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:42.571005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fd84c-5ae5-4d2b-abfd-e9575f2b4ce5 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:42.647632 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 773/1578] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:42 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:42.648609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37348c36-dc22-4992-b93b-cd5b832e4133 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:42.658001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37348c36-dc22-4992-b93b-cd5b832e4133 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:42.662512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f435d9b-ce04-4b9d-84c6-edd7f14be45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:42.663162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f435d9b-ce04-4b9d-84c6-edd7f14be45a admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.663435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f435d9b-ce04-4b9d-84c6-edd7f14be45a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.663716 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f435d9b-ce04-4b9d-84c6-edd7f14be45a admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.664390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f435d9b-ce04-4b9d-84c6-edd7f14be45a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:42.666814 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f435d9b-ce04-4b9d-84c6-edd7f14be45a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:42.679840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 806/1579] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:42 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:42.679840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fd84c-5ae5-4d2b-abfd-e9575f2b4ce5 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:42.741861 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fd84c-5ae5-4d2b-abfd-e9575f2b4ce5 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:42.747068 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780be47-f9b2-426a-88a8-6ece267cb124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:42.747728 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780be47-f9b2-426a-88a8-6ece267cb124 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.748014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780be47-f9b2-426a-88a8-6ece267cb124 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.748299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780be47-f9b2-426a-88a8-6ece267cb124 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.749055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780be47-f9b2-426a-88a8-6ece267cb124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:42.751002 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780be47-f9b2-426a-88a8-6ece267cb124 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:42.765192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 774/1580] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:42 2022] POST /identity/v3/users => generated 303 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:42.765192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f435d9b-ce04-4b9d-84c6-edd7f14be45a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:42.772891 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f435d9b-ce04-4b9d-84c6-edd7f14be45a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:42.778134 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166ec80-6256-43e5-a4e3-75ce3a2ff2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:42.778803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166ec80-6256-43e5-a4e3-75ce3a2ff2ef admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.779094 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166ec80-6256-43e5-a4e3-75ce3a2ff2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.779378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166ec80-6256-43e5-a4e3-75ce3a2ff2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.780105 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166ec80-6256-43e5-a4e3-75ce3a2ff2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:42.781691 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166ec80-6256-43e5-a4e3-75ce3a2ff2ef admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:42.792297 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 775/1581] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:42.793473 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623ef04-2040-4b52-bcc2-41de5e442d21 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.793771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623ef04-2040-4b52-bcc2-41de5e442d21 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.794058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623ef04-2040-4b52-bcc2-41de5e442d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.819333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-f623ef04-2040-4b52-bcc2-41de5e442d21 None None] MFA Rules not processed for user `0184375e869e4a9aac742ccb0b228218`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:42.820536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f623ef04-2040-4b52-bcc2-41de5e442d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:42.873821 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 807/1582] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:42 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:42.873821 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780be47-f9b2-426a-88a8-6ece267cb124 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:42.877161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:42.881638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780be47-f9b2-426a-88a8-6ece267cb124 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:42.886260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89153b5d-3d59-4339-a6a5-94ceaf4ba568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:42.886705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 776/1583] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:42.886946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89153b5d-3d59-4339-a6a5-94ceaf4ba568 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.887231 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89153b5d-3d59-4339-a6a5-94ceaf4ba568 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.887498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623ef04-2040-4b52-bcc2-41de5e442d21 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:42.887594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89153b5d-3d59-4339-a6a5-94ceaf4ba568 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.888181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89153b5d-3d59-4339-a6a5-94ceaf4ba568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:42.890143 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89153b5d-3d59-4339-a6a5-94ceaf4ba568 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:42.897126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:42.903995 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623ef04-2040-4b52-bcc2-41de5e442d21 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:42.906092 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb01f3-541b-4186-ab4f-2954170975b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:42.906799 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb01f3-541b-4186-ab4f-2954170975b2 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.907092 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb01f3-541b-4186-ab4f-2954170975b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.907374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb01f3-541b-4186-ab4f-2954170975b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.908107 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb01f3-541b-4186-ab4f-2954170975b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:42.909749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb01f3-541b-4186-ab4f-2954170975b2 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:42.920224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 777/1584] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:42.920993 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb01f3-541b-4186-ab4f-2954170975b2 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:42.930869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb01f3-541b-4186-ab4f-2954170975b2 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:42.935459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8d2aa-b8b5-455a-a10e-b68b4e32a716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:42.936071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8d2aa-b8b5-455a-a10e-b68b4e32a716 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.936362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8d2aa-b8b5-455a-a10e-b68b4e32a716 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.936659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8d2aa-b8b5-455a-a10e-b68b4e32a716 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.937347 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8d2aa-b8b5-455a-a10e-b68b4e32a716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:42.938972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8d2aa-b8b5-455a-a10e-b68b4e32a716 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:42.949278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 778/1585] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:42.950081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8d2aa-b8b5-455a-a10e-b68b4e32a716 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:42.959793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8d2aa-b8b5-455a-a10e-b68b4e32a716 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:42.965116 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d0603-7ded-48ea-b294-ae4c4c6bef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:42.965767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d0603-7ded-48ea-b294-ae4c4c6bef7f admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:42.966093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d0603-7ded-48ea-b294-ae4c4c6bef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:42.966408 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d0603-7ded-48ea-b294-ae4c4c6bef7f admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:42.967107 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d0603-7ded-48ea-b294-ae4c4c6bef7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:42.969049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d0603-7ded-48ea-b294-ae4c4c6bef7f admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:42.989838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 808/1586] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:42 2022] POST /identity/v3/users => generated 284 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:42.989838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89153b5d-3d59-4339-a6a5-94ceaf4ba568 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:42.997867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89153b5d-3d59-4339-a6a5-94ceaf4ba568 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.002824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90c3c4-42be-41f2-8879-91bd512675b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.003473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90c3c4-42be-41f2-8879-91bd512675b6 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.003762 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90c3c4-42be-41f2-8879-91bd512675b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.004043 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a90c3c4-42be-41f2-8879-91bd512675b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.005035 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90c3c4-42be-41f2-8879-91bd512675b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.006713 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a90c3c4-42be-41f2-8879-91bd512675b6 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.017353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 809/1587] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:43.018213 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90c3c4-42be-41f2-8879-91bd512675b6 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.027434 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a90c3c4-42be-41f2-8879-91bd512675b6 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.032102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453ecbe-efcf-48b1-b5b2-a674e58e5df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.032940 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453ecbe-efcf-48b1-b5b2-a674e58e5df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.033225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453ecbe-efcf-48b1-b5b2-a674e58e5df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.033505 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453ecbe-efcf-48b1-b5b2-a674e58e5df1 admin admin] PATH_INFO: `/v3/projects/32b01d760d4746108521a14e2a4ab4d0/users/9cbadf27b0054737bc798f8500dd661f/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.048454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453ecbe-efcf-48b1-b5b2-a674e58e5df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b01d760d4746108521a14e2a4ab4d0, user_id=9cbadf27b0054737bc798f8500dd661f, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.051164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453ecbe-efcf-48b1-b5b2-a674e58e5df1 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.070927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 779/1588] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:42 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:43.074416 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d0603-7ded-48ea-b294-ae4c4c6bef7f admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.082465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d0603-7ded-48ea-b294-ae4c4c6bef7f admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.087049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ddb08-02dd-4aad-88c0-867c14b0e557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.087690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ddb08-02dd-4aad-88c0-867c14b0e557 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.087979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ddb08-02dd-4aad-88c0-867c14b0e557 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.088260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71ddb08-02dd-4aad-88c0-867c14b0e557 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.089049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ddb08-02dd-4aad-88c0-867c14b0e557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.090683 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71ddb08-02dd-4aad-88c0-867c14b0e557 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.101279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 780/1589] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:43.103056 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ddb08-02dd-4aad-88c0-867c14b0e557 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.111388 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71ddb08-02dd-4aad-88c0-867c14b0e557 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.115974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957208e4-c11f-412a-a46d-45692999ec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.116584 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957208e4-c11f-412a-a46d-45692999ec9e admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.116871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957208e4-c11f-412a-a46d-45692999ec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.117176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957208e4-c11f-412a-a46d-45692999ec9e admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.117853 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957208e4-c11f-412a-a46d-45692999ec9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.120236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957208e4-c11f-412a-a46d-45692999ec9e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.127717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 810/1590] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:43 2022] PUT /identity/v3/projects/32b01d760d4746108521a14e2a4ab4d0/users/9cbadf27b0054737bc798f8500dd661f/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:43.128554 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453ecbe-efcf-48b1-b5b2-a674e58e5df1 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.191841 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453ecbe-efcf-48b1-b5b2-a674e58e5df1 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.196556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89897c-7de8-4589-baaf-e5d6cbd980e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.197223 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89897c-7de8-4589-baaf-e5d6cbd980e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.198013 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89897c-7de8-4589-baaf-e5d6cbd980e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.198291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b89897c-7de8-4589-baaf-e5d6cbd980e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.199060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89897c-7de8-4589-baaf-e5d6cbd980e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.200697 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b89897c-7de8-4589-baaf-e5d6cbd980e8 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.210423 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 811/1591] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:43.211301 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89897c-7de8-4589-baaf-e5d6cbd980e8 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.216860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 781/1592] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:43 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:43.216860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957208e4-c11f-412a-a46d-45692999ec9e admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.223364 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b89897c-7de8-4589-baaf-e5d6cbd980e8 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.279064 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3589a90-ce5f-42da-829d-a7c9e4a80f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.279691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3589a90-ce5f-42da-829d-a7c9e4a80f61 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.279979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3589a90-ce5f-42da-829d-a7c9e4a80f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.280262 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3589a90-ce5f-42da-829d-a7c9e4a80f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.280935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957208e4-c11f-412a-a46d-45692999ec9e admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.281050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3589a90-ce5f-42da-829d-a7c9e4a80f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.282621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3589a90-ce5f-42da-829d-a7c9e4a80f61 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.286056 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b400b-287f-4d41-b269-08caf53211cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.286761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b400b-287f-4d41-b269-08caf53211cd admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.287052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b400b-287f-4d41-b269-08caf53211cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.287336 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b400b-287f-4d41-b269-08caf53211cd admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.288072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b400b-287f-4d41-b269-08caf53211cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.291168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b400b-287f-4d41-b269-08caf53211cd admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.293900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 812/1593] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:43.294787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3589a90-ce5f-42da-829d-a7c9e4a80f61 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.304892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3589a90-ce5f-42da-829d-a7c9e4a80f61 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.309994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 782/1594] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:43.311180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7c60e-7f1f-43cd-ab21-33137026e44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.311332 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b400b-287f-4d41-b269-08caf53211cd admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.311918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7c60e-7f1f-43cd-ab21-33137026e44d admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.312260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7c60e-7f1f-43cd-ab21-33137026e44d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.312769 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7c60e-7f1f-43cd-ab21-33137026e44d admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.313283 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7c60e-7f1f-43cd-ab21-33137026e44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.315027 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7c60e-7f1f-43cd-ab21-33137026e44d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.323309 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b400b-287f-4d41-b269-08caf53211cd admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.328264 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b6d48-ca7c-4b01-81af-ede85669f4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.328726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 813/1595] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:43.329134 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b6d48-ca7c-4b01-81af-ede85669f4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.329418 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b6d48-ca7c-4b01-81af-ede85669f4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.329602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7c60e-7f1f-43cd-ab21-33137026e44d admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.329753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b6d48-ca7c-4b01-81af-ede85669f4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.330523 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b6d48-ca7c-4b01-81af-ede85669f4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.332147 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b6d48-ca7c-4b01-81af-ede85669f4d6 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.340504 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7c60e-7f1f-43cd-ab21-33137026e44d admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.343080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 783/1596] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:43.344321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b431f-d7bf-4059-b1de-397f8648a469 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.344617 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b431f-d7bf-4059-b1de-397f8648a469 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.344901 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b431f-d7bf-4059-b1de-397f8648a469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.348442 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f90509-88f3-432d-9ac0-87539d681971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.349094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f90509-88f3-432d-9ac0-87539d681971 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.349382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f90509-88f3-432d-9ac0-87539d681971 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.349660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f90509-88f3-432d-9ac0-87539d681971 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.350418 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f90509-88f3-432d-9ac0-87539d681971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.352057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f90509-88f3-432d-9ac0-87539d681971 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.362804 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-6f3b431f-d7bf-4059-b1de-397f8648a469 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:43.362985 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 814/1597] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:43.363737 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f90509-88f3-432d-9ac0-87539d681971 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.364330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-6f3b431f-d7bf-4059-b1de-397f8648a469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:43.376618 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 784/1598] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:43.376618 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b431f-d7bf-4059-b1de-397f8648a469 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.376931 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f90509-88f3-432d-9ac0-87539d681971 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.387795 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3da30f-882a-4984-b097-d06e75c0d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.390152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b431f-d7bf-4059-b1de-397f8648a469 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.390294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3da30f-882a-4984-b097-d06e75c0d2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.390294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3da30f-882a-4984-b097-d06e75c0d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.390294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3da30f-882a-4984-b097-d06e75c0d2fd admin admin] PATH_INFO: `/v3/projects/237d903492de434ab6240b90291ff1e2/users/e3667bac6fe34a0bb29cdf7c9fc556f6/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.393209 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0b157-c51f-4b14-bedd-2fac6ef57ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.393899 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0b157-c51f-4b14-bedd-2fac6ef57ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.394194 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0b157-c51f-4b14-bedd-2fac6ef57ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.394515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0b157-c51f-4b14-bedd-2fac6ef57ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.395256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0b157-c51f-4b14-bedd-2fac6ef57ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.397224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0b157-c51f-4b14-bedd-2fac6ef57ba5 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.407951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3da30f-882a-4984-b097-d06e75c0d2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=237d903492de434ab6240b90291ff1e2, user_id=e3667bac6fe34a0bb29cdf7c9fc556f6, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.410706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3da30f-882a-4984-b097-d06e75c0d2fd admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.473112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 785/1599] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:43 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:43.473937 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0b157-c51f-4b14-bedd-2fac6ef57ba5 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.486499 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0b157-c51f-4b14-bedd-2fac6ef57ba5 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.491541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1ef83-b56d-4567-9b4a-14531bfec36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.493696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:43.493820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1ef83-b56d-4567-9b4a-14531bfec36d admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.493820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1ef83-b56d-4567-9b4a-14531bfec36d admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.493820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1ef83-b56d-4567-9b4a-14531bfec36d admin admin] PATH_INFO: `/v3/projects/24afd32cbb424e1d88101bfcf9e6df7f/users/4445523345704277ba223e61b27c557c/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.497342 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 815/1600] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:43 2022] PUT /identity/v3/projects/237d903492de434ab6240b90291ff1e2/users/e3667bac6fe34a0bb29cdf7c9fc556f6/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:43.498166 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3da30f-882a-4984-b097-d06e75c0d2fd admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.509677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1ef83-b56d-4567-9b4a-14531bfec36d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24afd32cbb424e1d88101bfcf9e6df7f, user_id=4445523345704277ba223e61b27c557c, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.513048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1ef83-b56d-4567-9b4a-14531bfec36d admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.559630 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3da30f-882a-4984-b097-d06e75c0d2fd admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.564232 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37f5d-9a90-469f-9a1b-1e73c654f022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.564899 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37f5d-9a90-469f-9a1b-1e73c654f022 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.565186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37f5d-9a90-469f-9a1b-1e73c654f022 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.565465 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f37f5d-9a90-469f-9a1b-1e73c654f022 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.566324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f37f5d-9a90-469f-9a1b-1e73c654f022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.567990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f37f5d-9a90-469f-9a1b-1e73c654f022 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.578164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 816/1601] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:43.579102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37f5d-9a90-469f-9a1b-1e73c654f022 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.588452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f37f5d-9a90-469f-9a1b-1e73c654f022 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.593155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7d3b1-f80a-4556-87a6-ade6be6cb19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.594004 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7d3b1-f80a-4556-87a6-ade6be6cb19b admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.594292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7d3b1-f80a-4556-87a6-ade6be6cb19b admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.594615 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7d3b1-f80a-4556-87a6-ade6be6cb19b admin admin] PATH_INFO: `/v3/projects/6e6ac8cbb8d6499db210b28768be7e0d/users/e1211379f3c64a08857e84802e8d7126/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.608609 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7d3b1-f80a-4556-87a6-ade6be6cb19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e6ac8cbb8d6499db210b28768be7e0d, user_id=e1211379f3c64a08857e84802e8d7126, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.611304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7d3b1-f80a-4556-87a6-ade6be6cb19b admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.616389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 786/1602] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:43 2022] PUT /identity/v3/projects/24afd32cbb424e1d88101bfcf9e6df7f/users/4445523345704277ba223e61b27c557c/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:43.617224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1ef83-b56d-4567-9b4a-14531bfec36d admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.638529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:43.676927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1ef83-b56d-4567-9b4a-14531bfec36d admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.681488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40657aa-5a62-4277-b02a-7542b87dac87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.682688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40657aa-5a62-4277-b02a-7542b87dac87 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.683328 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40657aa-5a62-4277-b02a-7542b87dac87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.683328 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40657aa-5a62-4277-b02a-7542b87dac87 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.684033 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40657aa-5a62-4277-b02a-7542b87dac87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.685005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 817/1603] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:43 2022] PUT /identity/v3/projects/6e6ac8cbb8d6499db210b28768be7e0d/users/e1211379f3c64a08857e84802e8d7126/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:43.685649 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40657aa-5a62-4277-b02a-7542b87dac87 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.696121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 787/1604] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:43.696325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7d3b1-f80a-4556-87a6-ade6be6cb19b admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.696868 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40657aa-5a62-4277-b02a-7542b87dac87 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.698619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d40657aa-5a62-4277-b02a-7542b87dac87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:43.765857 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40657aa-5a62-4277-b02a-7542b87dac87 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.766148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7d3b1-f80a-4556-87a6-ade6be6cb19b admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.770834 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a77766-332c-47f9-bd27-facd131e9660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.771725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a77766-332c-47f9-bd27-facd131e9660 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.772011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a77766-332c-47f9-bd27-facd131e9660 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.772291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a77766-332c-47f9-bd27-facd131e9660 admin admin] PATH_INFO: `/v3/projects/88e6484c33674834b0e40d98972ede64/users/ff0b03feea7f4fd8bb8e2ff9677bdb24/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.789450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a77766-332c-47f9-bd27-facd131e9660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88e6484c33674834b0e40d98972ede64, user_id=ff0b03feea7f4fd8bb8e2ff9677bdb24, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.792907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a77766-332c-47f9-bd27-facd131e9660 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.814202 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9240879-0e62-4fba-9812-75014ecc902b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.814816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9240879-0e62-4fba-9812-75014ecc902b service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.815106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9240879-0e62-4fba-9812-75014ecc902b service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.815384 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9240879-0e62-4fba-9812-75014ecc902b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.824545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9240879-0e62-4fba-9812-75014ecc902b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.825960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9240879-0e62-4fba-9812-75014ecc902b service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.835559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 788/1605] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:43.836343 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9240879-0e62-4fba-9812-75014ecc902b service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.846849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9240879-0e62-4fba-9812-75014ecc902b service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.851909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac224f-5782-470b-b939-9baa429d1ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.852576 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac224f-5782-470b-b939-9baa429d1ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.852886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac224f-5782-470b-b939-9baa429d1ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.853171 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac224f-5782-470b-b939-9baa429d1ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.854521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac224f-5782-470b-b939-9baa429d1ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.856254 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac224f-5782-470b-b939-9baa429d1ab1 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.867145 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 818/1606] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:43 2022] PUT /identity/v3/projects/88e6484c33674834b0e40d98972ede64/users/ff0b03feea7f4fd8bb8e2ff9677bdb24/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:43.871084 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 789/1607] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:43.871218 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65989fbb-e3a6-49c5-82da-a212b00b0958 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.871218 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65989fbb-e3a6-49c5-82da-a212b00b0958 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.871431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac224f-5782-470b-b939-9baa429d1ab1 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:43.871531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65989fbb-e3a6-49c5-82da-a212b00b0958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.883965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac224f-5782-470b-b939-9baa429d1ab1 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:43.890390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-65989fbb-e3a6-49c5-82da-a212b00b0958 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:43.891599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-65989fbb-e3a6-49c5-82da-a212b00b0958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:43.941404 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b0686-74c2-4dc1-a480-89e715f150ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:43.942280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:43.942801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b0686-74c2-4dc1-a480-89e715f150ae admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.942801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b0686-74c2-4dc1-a480-89e715f150ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.942989 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b0686-74c2-4dc1-a480-89e715f150ae admin admin] PATH_INFO: `/v3/projects/4f46fbd999a9447db488abf47b64ce82/users/d286359e301245bcac282d598b652f45/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.951581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:43.957376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 819/1608] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:43.958977 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b0686-74c2-4dc1-a480-89e715f150ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f46fbd999a9447db488abf47b64ce82, user_id=d286359e301245bcac282d598b652f45, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:43.959210 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f68e6d-abaf-4538-9d0f-3076c91f62b8 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.959561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f68e6d-abaf-4538-9d0f-3076c91f62b8 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.959912 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f68e6d-abaf-4538-9d0f-3076c91f62b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:43.962962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b0686-74c2-4dc1-a480-89e715f150ae admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:43.985752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-70f68e6d-abaf-4538-9d0f-3076c91f62b8 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:43.987109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-70f68e6d-abaf-4538-9d0f-3076c91f62b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:43.995143 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 820/1609] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:43.996652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b60a11-49ad-4c1d-ae32-b320c414e348 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:43.996784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b60a11-49ad-4c1d-ae32-b320c414e348 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:43.997060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b60a11-49ad-4c1d-ae32-b320c414e348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:44.027576 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 790/1610] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:43 2022] PUT /identity/v3/projects/4f46fbd999a9447db488abf47b64ce82/users/d286359e301245bcac282d598b652f45/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:44.028592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b0686-74c2-4dc1-a480-89e715f150ae admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:44.030367 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-94b60a11-49ad-4c1d-ae32-b320c414e348 None None] MFA Rules not processed for user `e1211379f3c64a08857e84802e8d7126`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:44.031668 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-94b60a11-49ad-4c1d-ae32-b320c414e348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:44.098305 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b0686-74c2-4dc1-a480-89e715f150ae admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:44.100097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 821/1611] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:43 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:44.100935 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b60a11-49ad-4c1d-ae32-b320c414e348 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:44.103356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06bdce7-d717-4dc7-8767-022e9aa56477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:44.104288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bdce7-d717-4dc7-8767-022e9aa56477 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:44.104577 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bdce7-d717-4dc7-8767-022e9aa56477 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:44.104860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bdce7-d717-4dc7-8767-022e9aa56477 admin admin] PATH_INFO: `/v3/projects/215b516cde5a40c6acc830b6b15e7638/users/a611257ac46548a89b9a0d37b282bcf0/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:44.120225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b60a11-49ad-4c1d-ae32-b320c414e348 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:44.121451 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bdce7-d717-4dc7-8767-022e9aa56477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=215b516cde5a40c6acc830b6b15e7638, user_id=a611257ac46548a89b9a0d37b282bcf0, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:44.124547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06bdce7-d717-4dc7-8767-022e9aa56477 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:44.125521 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898bd70-0624-4a59-b1af-a7a7622fa2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:44.126472 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898bd70-0624-4a59-b1af-a7a7622fa2fe admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:44.127274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898bd70-0624-4a59-b1af-a7a7622fa2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:44.127274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898bd70-0624-4a59-b1af-a7a7622fa2fe admin admin] PATH_INFO: `/v3/projects/168dd97011a145a398e2ba989cc07b50/users/be25dd2f95cc4048b49c71d8815160a7/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:44.144054 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898bd70-0624-4a59-b1af-a7a7622fa2fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=168dd97011a145a398e2ba989cc07b50, user_id=be25dd2f95cc4048b49c71d8815160a7, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:44.147003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898bd70-0624-4a59-b1af-a7a7622fa2fe admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:44.211803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 791/1612] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:44 2022] PUT /identity/v3/projects/215b516cde5a40c6acc830b6b15e7638/users/a611257ac46548a89b9a0d37b282bcf0/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:44.211803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134e0df-ff28-4794-b444-93b22684cc37 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:44.211803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134e0df-ff28-4794-b444-93b22684cc37 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:44.211803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134e0df-ff28-4794-b444-93b22684cc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:44.236932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 822/1613] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:44 2022] PUT /identity/v3/projects/168dd97011a145a398e2ba989cc07b50/users/be25dd2f95cc4048b49c71d8815160a7/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:44.240257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-0134e0df-ff28-4794-b444-93b22684cc37 None None] MFA Rules not processed for user `ff0b03feea7f4fd8bb8e2ff9677bdb24`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:44.240393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898bd70-0624-4a59-b1af-a7a7622fa2fe admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:44.240516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-0134e0df-ff28-4794-b444-93b22684cc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:44.294933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898bd70-0624-4a59-b1af-a7a7622fa2fe admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:44.299932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865548b-673d-4279-a236-ebac8841ea17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:44.300669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865548b-673d-4279-a236-ebac8841ea17 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:44.300917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865548b-673d-4279-a236-ebac8841ea17 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:44.301475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865548b-673d-4279-a236-ebac8841ea17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:44.304913 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 792/1614] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:44.305654 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134e0df-ff28-4794-b444-93b22684cc37 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:44.316232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134e0df-ff28-4794-b444-93b22684cc37 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:44.320619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5d137-087d-4c38-8379-309acfbc1179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:44.320619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5d137-087d-4c38-8379-309acfbc1179 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:44.320985 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5d137-087d-4c38-8379-309acfbc1179 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:44.321197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5d137-087d-4c38-8379-309acfbc1179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:44.392916 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:44.393537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865548b-673d-4279-a236-ebac8841ea17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:44.396632 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5d137-087d-4c38-8379-309acfbc1179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:44.400543 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865548b-673d-4279-a236-ebac8841ea17 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:44.400663 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5d137-087d-4c38-8379-309acfbc1179 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:44.409245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 793/1615] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:44.410623 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8d2d6-e030-4dad-9b57-fa8f5884b510 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:44.410923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8d2d6-e030-4dad-9b57-fa8f5884b510 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:44.411210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce8d2d6-e030-4dad-9b57-fa8f5884b510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:44.414621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 823/1616] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:44.423714 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865548b-673d-4279-a236-ebac8841ea17 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:44.433209 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:44.441012 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865548b-673d-4279-a236-ebac8841ea17 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:44.443510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-7ce8d2d6-e030-4dad-9b57-fa8f5884b510 None None] MFA Rules not processed for user `d286359e301245bcac282d598b652f45`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:44.444607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-7ce8d2d6-e030-4dad-9b57-fa8f5884b510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:44.447122 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050d4f5-45ed-449c-8b72-4e20895502a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:44.448552 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050d4f5-45ed-449c-8b72-4e20895502a4 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:44.448970 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050d4f5-45ed-449c-8b72-4e20895502a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:44.449462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050d4f5-45ed-449c-8b72-4e20895502a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:44.451247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050d4f5-45ed-449c-8b72-4e20895502a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:44.453966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050d4f5-45ed-449c-8b72-4e20895502a4 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:44.519540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 794/1617] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:44.520859 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d08403-2a12-4398-aedb-2eed436a3883 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:44.521202 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d08403-2a12-4398-aedb-2eed436a3883 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:44.521491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d08403-2a12-4398-aedb-2eed436a3883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:44.537980 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 824/1618] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:44 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:44.538933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050d4f5-45ed-449c-8b72-4e20895502a4 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:44.543590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-82d08403-2a12-4398-aedb-2eed436a3883 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:44.544795 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-82d08403-2a12-4398-aedb-2eed436a3883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:44.620535 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 795/1619] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:44.620535 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c08fc5-59f0-441b-8a5e-1ccff5e02635 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:44.620535 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c08fc5-59f0-441b-8a5e-1ccff5e02635 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:44.620535 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c08fc5-59f0-441b-8a5e-1ccff5e02635 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:44.622667 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 796/1620] 10.222.0.15 () {54 vars in 961 bytes} [Fri May 27 19:59:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:59:44.623682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c08fc5-59f0-441b-8a5e-1ccff5e02635 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:44.701066 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c08fc5-59f0-441b-8a5e-1ccff5e02635 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:44.705892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a272820-f56d-4e77-92b8-d2ef97986ed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:44.707478 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a272820-f56d-4e77-92b8-d2ef97986ed4 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:44.707770 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a272820-f56d-4e77-92b8-d2ef97986ed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:44.708056 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a272820-f56d-4e77-92b8-d2ef97986ed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:44.762305 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:44.762779 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050d4f5-45ed-449c-8b72-4e20895502a4 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:44.767801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dd8f6-08b9-4646-a48f-a5a3e9588e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:44.768713 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dd8f6-08b9-4646-a48f-a5a3e9588e34 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:44.768841 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dd8f6-08b9-4646-a48f-a5a3e9588e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:44.769044 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dd8f6-08b9-4646-a48f-a5a3e9588e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:44.769755 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dd8f6-08b9-4646-a48f-a5a3e9588e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:44.771420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dd8f6-08b9-4646-a48f-a5a3e9588e34 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:44.782385 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a272820-f56d-4e77-92b8-d2ef97986ed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:44.785554 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 825/1621] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:44.785554 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dd8f6-08b9-4646-a48f-a5a3e9588e34 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:44.785751 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a272820-f56d-4e77-92b8-d2ef97986ed4 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:44.793353 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 797/1622] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:44.794462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dd8f6-08b9-4646-a48f-a5a3e9588e34 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:44.794609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a54c8-a4c1-4948-ab29-bf07c3f0b650 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:44.794830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a54c8-a4c1-4948-ab29-bf07c3f0b650 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:44.795117 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a54c8-a4c1-4948-ab29-bf07c3f0b650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:44.799566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b0d62-9148-4816-a24b-be3162286b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:44.800236 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b0d62-9148-4816-a24b-be3162286b49 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:44.800844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b0d62-9148-4816-a24b-be3162286b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:44.800844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b0d62-9148-4816-a24b-be3162286b49 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:44.801707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b0d62-9148-4816-a24b-be3162286b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:44.804578 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b0d62-9148-4816-a24b-be3162286b49 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:44.823467 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-6c9a54c8-a4c1-4948-ab29-bf07c3f0b650 None None] MFA Rules not processed for user `105353b6b1a941ac81df7ad35567ba7c`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:44.824705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-6c9a54c8-a4c1-4948-ab29-bf07c3f0b650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:44.903292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 826/1623] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:44 2022] POST /identity/v3/users => generated 308 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:44.904524 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b0d62-9148-4816-a24b-be3162286b49 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:44.926151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 798/1624] 10.222.0.15 () {58 vars in 1058 bytes} [Fri May 27 19:59:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:44.927179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a54c8-a4c1-4948-ab29-bf07c3f0b650 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:44.944303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a54c8-a4c1-4948-ab29-bf07c3f0b650 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:44.950990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51477550-3df0-4c76-8fb6-102ca9103837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:44.951982 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477550-3df0-4c76-8fb6-102ca9103837 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:44.952376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477550-3df0-4c76-8fb6-102ca9103837 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:44.952668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51477550-3df0-4c76-8fb6-102ca9103837 admin admin] PATH_INFO: `/v3/projects/168dd97011a145a398e2ba989cc07b50/users/be25dd2f95cc4048b49c71d8815160a7/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:44.955610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51477550-3df0-4c76-8fb6-102ca9103837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=168dd97011a145a398e2ba989cc07b50, user_id=be25dd2f95cc4048b49c71d8815160a7, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:44.958809 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51477550-3df0-4c76-8fb6-102ca9103837 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:44.984069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 799/1625] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:44 2022] PUT /identity/v3/projects/168dd97011a145a398e2ba989cc07b50/users/be25dd2f95cc4048b49c71d8815160a7/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:44.984069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51477550-3df0-4c76-8fb6-102ca9103837 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:44.985441 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b0d62-9148-4816-a24b-be3162286b49 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:45.070632 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51477550-3df0-4c76-8fb6-102ca9103837 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:45.076100 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdfa29-d27b-4ee0-8dec-34c0b693bc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:45.076892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdfa29-d27b-4ee0-8dec-34c0b693bc09 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:45.077077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdfa29-d27b-4ee0-8dec-34c0b693bc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:45.077353 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdfa29-d27b-4ee0-8dec-34c0b693bc09 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:45.078226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdfa29-d27b-4ee0-8dec-34c0b693bc09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:45.080418 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdfa29-d27b-4ee0-8dec-34c0b693bc09 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:45.092929 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 800/1626] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:45.097093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdfa29-d27b-4ee0-8dec-34c0b693bc09 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:45.109430 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527091b-954b-47a9-9d85-2166128f98ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:45.110106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527091b-954b-47a9-9d85-2166128f98ce service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:45.110417 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527091b-954b-47a9-9d85-2166128f98ce service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:45.110699 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527091b-954b-47a9-9d85-2166128f98ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:45.133708 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527091b-954b-47a9-9d85-2166128f98ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:45.135340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527091b-954b-47a9-9d85-2166128f98ce service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:45.157377 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 827/1627] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:45.161447 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c7c24-b9db-436c-887a-9ad5b675ad85 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:45.161760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c7c24-b9db-436c-887a-9ad5b675ad85 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:45.162038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c7c24-b9db-436c-887a-9ad5b675ad85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:45.186351 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:45.221197 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-066c7c24-b9db-436c-887a-9ad5b675ad85 None None] MFA Rules not processed for user `be25dd2f95cc4048b49c71d8815160a7`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:45.230196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-066c7c24-b9db-436c-887a-9ad5b675ad85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:45.230375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdfa29-d27b-4ee0-8dec-34c0b693bc09 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:45.240445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710b7c2-b662-4ee0-852d-19ff4ec2adac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:45.243282 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:45.243887 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710b7c2-b662-4ee0-852d-19ff4ec2adac service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:45.245414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710b7c2-b662-4ee0-852d-19ff4ec2adac service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:45.246687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710b7c2-b662-4ee0-852d-19ff4ec2adac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:45.339179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 828/1628] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:45.339179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c7c24-b9db-436c-887a-9ad5b675ad85 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:45.354878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c7c24-b9db-436c-887a-9ad5b675ad85 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:45.365447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710b7c2-b662-4ee0-852d-19ff4ec2adac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:45.367770 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710b7c2-b662-4ee0-852d-19ff4ec2adac service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:45.370656 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7109e-2746-47ed-b5eb-9695ed66d4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:45.372341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7109e-2746-47ed-b5eb-9695ed66d4e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:45.372812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7109e-2746-47ed-b5eb-9695ed66d4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:45.373276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7109e-2746-47ed-b5eb-9695ed66d4e6 admin admin] PATH_INFO: `/v3/projects/70be0b6d525547c1bd629069cdbf30ce/users/9036c08831784f5693e5895f15ed941f/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:45.381728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 801/1629] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:45.382886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710b7c2-b662-4ee0-852d-19ff4ec2adac service nova] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:45.404317 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7109e-2746-47ed-b5eb-9695ed66d4e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70be0b6d525547c1bd629069cdbf30ce, user_id=9036c08831784f5693e5895f15ed941f, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:45.408788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e7109e-2746-47ed-b5eb-9695ed66d4e6 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:45.486998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710b7c2-b662-4ee0-852d-19ff4ec2adac service nova] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:45.496401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b08211-237b-406b-8e5d-8ee6c33e8f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:45.497136 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b08211-237b-406b-8e5d-8ee6c33e8f05 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:45.497440 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b08211-237b-406b-8e5d-8ee6c33e8f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:45.497726 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b08211-237b-406b-8e5d-8ee6c33e8f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:45.516049 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 829/1630] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:45 2022] PUT /identity/v3/projects/70be0b6d525547c1bd629069cdbf30ce/users/9036c08831784f5693e5895f15ed941f/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:45.519714 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7109e-2746-47ed-b5eb-9695ed66d4e6 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:45.521018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b08211-237b-406b-8e5d-8ee6c33e8f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:45.522648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b08211-237b-406b-8e5d-8ee6c33e8f05 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:45.543250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 802/1631] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:45.678001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e7109e-2746-47ed-b5eb-9695ed66d4e6 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:45.684986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9a987-558b-44b0-823c-84aad9a3c33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:45.685797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a987-558b-44b0-823c-84aad9a3c33a admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:45.686096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a987-558b-44b0-823c-84aad9a3c33a admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:45.686433 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9a987-558b-44b0-823c-84aad9a3c33a admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:45.688321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9a987-558b-44b0-823c-84aad9a3c33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:45.691416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9a987-558b-44b0-823c-84aad9a3c33a admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:45.709296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 830/1632] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:45.714640 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b08211-237b-406b-8e5d-8ee6c33e8f05 service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:45.731169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b08211-237b-406b-8e5d-8ee6c33e8f05 service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:45.738999 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b353e2b-30ca-484d-b7bd-dc127a6f8373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:45.740799 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b353e2b-30ca-484d-b7bd-dc127a6f8373 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:45.741324 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b353e2b-30ca-484d-b7bd-dc127a6f8373 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:45.741879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b353e2b-30ca-484d-b7bd-dc127a6f8373 admin admin] PATH_INFO: `/v3/projects/70be0b6d525547c1bd629069cdbf30ce/users/9036c08831784f5693e5895f15ed941f/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:45.745260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b353e2b-30ca-484d-b7bd-dc127a6f8373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70be0b6d525547c1bd629069cdbf30ce, user_id=9036c08831784f5693e5895f15ed941f, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:45.749433 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b353e2b-30ca-484d-b7bd-dc127a6f8373 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:45.778989 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 803/1633] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:45 2022] PUT /identity/v3/projects/70be0b6d525547c1bd629069cdbf30ce/users/9036c08831784f5693e5895f15ed941f/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:45.781893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e92858-fe5b-4258-a886-aa791b9feb21 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:45.782871 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e92858-fe5b-4258-a886-aa791b9feb21 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:45.783255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e92858-fe5b-4258-a886-aa791b9feb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:45.848591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-f5e92858-fe5b-4258-a886-aa791b9feb21 None None] MFA Rules not processed for user `9036c08831784f5693e5895f15ed941f`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:45.850134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f5e92858-fe5b-4258-a886-aa791b9feb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:45.937151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 831/1634] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:45 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:46.086921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b353e2b-30ca-484d-b7bd-dc127a6f8373 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:46.234078 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b353e2b-30ca-484d-b7bd-dc127a6f8373 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:46.247120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993b1ad-1a44-4472-99d6-d005aae8d99f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:46.255712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993b1ad-1a44-4472-99d6-d005aae8d99f service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:46.255712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993b1ad-1a44-4472-99d6-d005aae8d99f service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:46.255712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993b1ad-1a44-4472-99d6-d005aae8d99f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:46.265566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e954d7c-08a3-41d7-a9e0-b63fd563bf58 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:46.266065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e954d7c-08a3-41d7-a9e0-b63fd563bf58 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:46.266168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e954d7c-08a3-41d7-a9e0-b63fd563bf58 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:46.267726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 832/1635] 10.222.0.15 () {54 vars in 961 bytes} [Fri May 27 19:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:59:46.271282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993b1ad-1a44-4472-99d6-d005aae8d99f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:46.272746 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993b1ad-1a44-4472-99d6-d005aae8d99f service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:46.288919 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271afcf4-d57f-46e5-aa3b-c8bf867678f6 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:46.289398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271afcf4-d57f-46e5-aa3b-c8bf867678f6 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:46.289980 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271afcf4-d57f-46e5-aa3b-c8bf867678f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:46.301752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:46.318558 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 804/1636] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:46 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:46.326684 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-271afcf4-d57f-46e5-aa3b-c8bf867678f6 None None] MFA Rules not processed for user `105353b6b1a941ac81df7ad35567ba7c`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:46.327753 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-271afcf4-d57f-46e5-aa3b-c8bf867678f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:46.456110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 833/1637] 10.222.0.15 () {58 vars in 1058 bytes} [Fri May 27 19:59:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:46.457250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec757a6-1f13-4167-86a8-260d96a91e6c None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:46.457552 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec757a6-1f13-4167-86a8-260d96a91e6c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:46.457861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec757a6-1f13-4167-86a8-260d96a91e6c None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:46.459969 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 805/1638] 10.222.0.15 () {54 vars in 912 bytes} [Fri May 27 19:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:59:46.468500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076304df-3e8e-483d-a6a7-1864e9c96ce7 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:46.469484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076304df-3e8e-483d-a6a7-1864e9c96ce7 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:46.470529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076304df-3e8e-483d-a6a7-1864e9c96ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:46.505625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-076304df-3e8e-483d-a6a7-1864e9c96ce7 None None] MFA Rules not processed for user `105353b6b1a941ac81df7ad35567ba7c`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:46.507376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-076304df-3e8e-483d-a6a7-1864e9c96ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:46.534969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 834/1639] 10.222.0.15 () {58 vars in 1009 bytes} [Fri May 27 19:59:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:46.571252 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec757a6-1f13-4167-86a8-260d96a91e6c None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:46.603911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec757a6-1f13-4167-86a8-260d96a91e6c None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:46.608856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d6c29-cdd8-47c7-9237-300a5242f467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:46.856550 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d6c29-cdd8-47c7-9237-300a5242f467 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:46.856550 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d6c29-cdd8-47c7-9237-300a5242f467 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:46.856550 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d6c29-cdd8-47c7-9237-300a5242f467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:46.856550 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d6c29-cdd8-47c7-9237-300a5242f467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:46.856550 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d6c29-cdd8-47c7-9237-300a5242f467 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:46.856550 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 806/1640] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:46.860066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076304df-3e8e-483d-a6a7-1864e9c96ce7 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:46.860066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076304df-3e8e-483d-a6a7-1864e9c96ce7 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:46.860066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefaca8-b28e-432f-ac28-f09993388679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:46.860066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefaca8-b28e-432f-ac28-f09993388679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:46.862234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefaca8-b28e-432f-ac28-f09993388679 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:46.862234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefaca8-b28e-432f-ac28-f09993388679 admin admin] PATH_INFO: `/v3/users/e1211379f3c64a08857e84802e8d7126` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:46.862234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefaca8-b28e-432f-ac28-f09993388679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1211379f3c64a08857e84802e8d7126)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:46.862234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: WARNING py.warnings [None req-3fefaca8-b28e-432f-ac28-f09993388679 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 19:59:46.862234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: warnings.warn(msg) May 27 19:59:46.862234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: May 27 19:59:46.862234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefaca8-b28e-432f-ac28-f09993388679 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:46.890719 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450672c7-2788-413f-b231-f217d3a202c8 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:46.890719 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450672c7-2788-413f-b231-f217d3a202c8 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:46.892861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450672c7-2788-413f-b231-f217d3a202c8 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:46.894508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 807/1641] 10.222.0.15 () {54 vars in 912 bytes} [Fri May 27 19:59:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 19:59:46.912497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b9ad5-8191-488c-ad64-098d3934db72 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:46.912873 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b9ad5-8191-488c-ad64-098d3934db72 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:46.913262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b9ad5-8191-488c-ad64-098d3934db72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:46.939439 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b46b9ad5-8191-488c-ad64-098d3934db72 None None] MFA Rules not processed for user `105353b6b1a941ac81df7ad35567ba7c`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:46.940970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b46b9ad5-8191-488c-ad64-098d3934db72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:46.959756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 808/1642] 10.222.0.15 () {58 vars in 1009 bytes} [Fri May 27 19:59:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:59:46.975131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b9ad5-8191-488c-ad64-098d3934db72 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:46.981167 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:46.990733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b9ad5-8191-488c-ad64-098d3934db72 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:47.001548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80815a1-5fba-448d-9fe6-08a02c56ea89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:47.002423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80815a1-5fba-448d-9fe6-08a02c56ea89 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:47.002846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80815a1-5fba-448d-9fe6-08a02c56ea89 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:47.003133 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80815a1-5fba-448d-9fe6-08a02c56ea89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:47.018465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80815a1-5fba-448d-9fe6-08a02c56ea89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:47.019809 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80815a1-5fba-448d-9fe6-08a02c56ea89 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:47.032751 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 809/1643] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 19:59:47.107421 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3fefaca8-b28e-432f-ac28-f09993388679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1211379f3c64a08857e84802e8d7126'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:47.153156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80815a1-5fba-448d-9fe6-08a02c56ea89 service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:47.173813 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80815a1-5fba-448d-9fe6-08a02c56ea89 service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:47.187237 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60e3da-80e7-4ff4-aac5-eecafa05bbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:47.188521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e3da-80e7-4ff4-aac5-eecafa05bbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:47.189003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e3da-80e7-4ff4-aac5-eecafa05bbed admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:47.189800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e3da-80e7-4ff4-aac5-eecafa05bbed admin admin] PATH_INFO: `/v3/users/ff0b03feea7f4fd8bb8e2ff9677bdb24` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:47.191991 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60e3da-80e7-4ff4-aac5-eecafa05bbed admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff0b03feea7f4fd8bb8e2ff9677bdb24)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:47.197349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3fefaca8-b28e-432f-ac28-f09993388679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1211379f3c64a08857e84802e8d7126'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:47.198227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3fefaca8-b28e-432f-ac28-f09993388679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1211379f3c64a08857e84802e8d7126'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:47.201498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60e3da-80e7-4ff4-aac5-eecafa05bbed admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:47.232357 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3fefaca8-b28e-432f-ac28-f09993388679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1211379f3c64a08857e84802e8d7126'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:47.298946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3fefaca8-b28e-432f-ac28-f09993388679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1211379f3c64a08857e84802e8d7126'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:47.308257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 835/1644] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 19:59:46 2022] DELETE /identity/v3/users/e1211379f3c64a08857e84802e8d7126 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:47.312755 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97f83b-9728-43e6-b7c9-473453b84923 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:47.313586 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97f83b-9728-43e6-b7c9-473453b84923 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:47.314930 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97f83b-9728-43e6-b7c9-473453b84923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:47.334935 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-8f97f83b-9728-43e6-b7c9-473453b84923 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:47.336530 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8f97f83b-9728-43e6-b7c9-473453b84923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:47.447794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 836/1645] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:47.450117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97f83b-9728-43e6-b7c9-473453b84923 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:47.452661 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8f97f83b-9728-43e6-b7c9-473453b84923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:47.517283 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97f83b-9728-43e6-b7c9-473453b84923 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:47.519459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-dc60e3da-80e7-4ff4-aac5-eecafa05bbed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff0b03feea7f4fd8bb8e2ff9677bdb24'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:47.521829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-dc60e3da-80e7-4ff4-aac5-eecafa05bbed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff0b03feea7f4fd8bb8e2ff9677bdb24'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:47.531592 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6e407-d43f-4b2c-835c-3f77a2ff6648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:47.535418 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e407-d43f-4b2c-835c-3f77a2ff6648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:47.535945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e407-d43f-4b2c-835c-3f77a2ff6648 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:47.536467 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6e407-d43f-4b2c-835c-3f77a2ff6648 admin admin] PATH_INFO: `/v3/users/0184375e869e4a9aac742ccb0b228218` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:47.538767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6e407-d43f-4b2c-835c-3f77a2ff6648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0184375e869e4a9aac742ccb0b228218)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:47.544900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6e407-d43f-4b2c-835c-3f77a2ff6648 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:47.615173 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-dc60e3da-80e7-4ff4-aac5-eecafa05bbed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff0b03feea7f4fd8bb8e2ff9677bdb24'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:47.633771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-dc60e3da-80e7-4ff4-aac5-eecafa05bbed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff0b03feea7f4fd8bb8e2ff9677bdb24'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:47.642158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-dc60e3da-80e7-4ff4-aac5-eecafa05bbed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff0b03feea7f4fd8bb8e2ff9677bdb24'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:47.661585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 810/1646] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 19:59:47 2022] DELETE /identity/v3/users/ff0b03feea7f4fd8bb8e2ff9677bdb24 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 19:59:47.661585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60e3da-80e7-4ff4-aac5-eecafa05bbed admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:47.661585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-dc60e3da-80e7-4ff4-aac5-eecafa05bbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:47.771424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60e3da-80e7-4ff4-aac5-eecafa05bbed admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:47.776228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a99a7a9-e592-43a5-a463-1cc858b2dd03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:47.778814 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99a7a9-e592-43a5-a463-1cc858b2dd03 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:47.780039 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99a7a9-e592-43a5-a463-1cc858b2dd03 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:47.781338 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a99a7a9-e592-43a5-a463-1cc858b2dd03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:47.787357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-1a99a7a9-e592-43a5-a463-1cc858b2dd03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:47.847371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-99a6e407-d43f-4b2c-835c-3f77a2ff6648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0184375e869e4a9aac742ccb0b228218'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:47.933916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-99a6e407-d43f-4b2c-835c-3f77a2ff6648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0184375e869e4a9aac742ccb0b228218'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:47.934753 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-99a6e407-d43f-4b2c-835c-3f77a2ff6648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0184375e869e4a9aac742ccb0b228218'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:47.947920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-99a6e407-d43f-4b2c-835c-3f77a2ff6648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0184375e869e4a9aac742ccb0b228218'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:47.948521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99a7a9-e592-43a5-a463-1cc858b2dd03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:47.951997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a99a7a9-e592-43a5-a463-1cc858b2dd03 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:47.969024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 811/1647] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:47.971657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bac9a-9a98-4edd-8c76-da3ccf7dd5f9 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:47.972251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bac9a-9a98-4edd-8c76-da3ccf7dd5f9 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:47.973372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bac9a-9a98-4edd-8c76-da3ccf7dd5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:47.973935 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-99a6e407-d43f-4b2c-835c-3f77a2ff6648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0184375e869e4a9aac742ccb0b228218'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:47.988471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 837/1648] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 19:59:47 2022] DELETE /identity/v3/users/0184375e869e4a9aac742ccb0b228218 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:47.990068 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dceb3c-af6e-43fc-a8d3-6aeadafbb04a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:47.990390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dceb3c-af6e-43fc-a8d3-6aeadafbb04a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:47.990713 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dceb3c-af6e-43fc-a8d3-6aeadafbb04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:48.004860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-369bac9a-9a98-4edd-8c76-da3ccf7dd5f9 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:48.006428 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-369bac9a-9a98-4edd-8c76-da3ccf7dd5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:48.033434 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-f4dceb3c-af6e-43fc-a8d3-6aeadafbb04a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:48.036087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f4dceb3c-af6e-43fc-a8d3-6aeadafbb04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:48.161726 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 812/1649] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:48.162911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b198a9-a687-4234-a654-cc9db60a2436 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:48.163218 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b198a9-a687-4234-a654-cc9db60a2436 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:48.165810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b198a9-a687-4234-a654-cc9db60a2436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:48.199649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:48.237225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-48b198a9-a687-4234-a654-cc9db60a2436 None None] MFA Rules not processed for user `a611257ac46548a89b9a0d37b282bcf0`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:48.240687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-48b198a9-a687-4234-a654-cc9db60a2436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:48.261076 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 838/1650] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:59:48.262067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dceb3c-af6e-43fc-a8d3-6aeadafbb04a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:48.264809 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f4dceb3c-af6e-43fc-a8d3-6aeadafbb04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:48.451025 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dceb3c-af6e-43fc-a8d3-6aeadafbb04a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:48.460274 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 813/1651] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:48.460541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c0df4-5508-428f-ae25-bd336657e55f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:48.460637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b198a9-a687-4234-a654-cc9db60a2436 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:48.460855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c0df4-5508-428f-ae25-bd336657e55f service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:48.461125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c0df4-5508-428f-ae25-bd336657e55f service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:48.461408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c0df4-5508-428f-ae25-bd336657e55f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:48.486174 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c0df4-5508-428f-ae25-bd336657e55f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:48.490582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c0df4-5508-428f-ae25-bd336657e55f service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:48.493976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b198a9-a687-4234-a654-cc9db60a2436 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:48.506457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dba46-720c-4b21-899a-aa7afcb7e2dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:48.507586 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dba46-720c-4b21-899a-aa7afcb7e2dd service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:48.507897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dba46-720c-4b21-899a-aa7afcb7e2dd service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:48.508189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66dba46-720c-4b21-899a-aa7afcb7e2dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:48.514155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 839/1652] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:48.515523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264974fe-39e5-4dd9-8827-bfa31084782b None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:48.515815 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264974fe-39e5-4dd9-8827-bfa31084782b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:48.516094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264974fe-39e5-4dd9-8827-bfa31084782b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:48.534002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66dba46-720c-4b21-899a-aa7afcb7e2dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:48.538942 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66dba46-720c-4b21-899a-aa7afcb7e2dd service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:48.564025 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-264974fe-39e5-4dd9-8827-bfa31084782b None None] MFA Rules not processed for user `a611257ac46548a89b9a0d37b282bcf0`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:48.564025 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-264974fe-39e5-4dd9-8827-bfa31084782b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:48.567670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 814/1653] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:48.581017 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 840/1654] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:48.595111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dba46-720c-4b21-899a-aa7afcb7e2dd service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:48.596839 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e66dba46-720c-4b21-899a-aa7afcb7e2dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:48.706402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:48.761711 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66dba46-720c-4b21-899a-aa7afcb7e2dd service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:48.771971 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0774eb7-19b7-4d66-8bd9-8b51fbc1732c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:48.772785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0774eb7-19b7-4d66-8bd9-8b51fbc1732c service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:48.773150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0774eb7-19b7-4d66-8bd9-8b51fbc1732c service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:48.773502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0774eb7-19b7-4d66-8bd9-8b51fbc1732c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:48.784377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0774eb7-19b7-4d66-8bd9-8b51fbc1732c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:48.786157 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0774eb7-19b7-4d66-8bd9-8b51fbc1732c service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:48.808326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 815/1655] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:49.880369 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264974fe-39e5-4dd9-8827-bfa31084782b None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:49.882282 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-264974fe-39e5-4dd9-8827-bfa31084782b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:49.907567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264974fe-39e5-4dd9-8827-bfa31084782b None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:49.918376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ccc54-48eb-447b-931e-113169a82e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:49.919255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ccc54-48eb-447b-931e-113169a82e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:49.919535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ccc54-48eb-447b-931e-113169a82e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:49.919806 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ccc54-48eb-447b-931e-113169a82e76 admin admin] PATH_INFO: `/v3/projects/6e6ac8cbb8d6499db210b28768be7e0d` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:49.926380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ccc54-48eb-447b-931e-113169a82e76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e6ac8cbb8d6499db210b28768be7e0d)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:49.928811 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ccc54-48eb-447b-931e-113169a82e76 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:50.087362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0774eb7-19b7-4d66-8bd9-8b51fbc1732c service nova] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:50.089095 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b0774eb7-19b7-4d66-8bd9-8b51fbc1732c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:50.113483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-462ccc54-48eb-447b-931e-113169a82e76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6ac8cbb8d6499db210b28768be7e0d', 'request_id': 'req-462ccc54-48eb-447b-931e-113169a82e76'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:50.123454 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0774eb7-19b7-4d66-8bd9-8b51fbc1732c service nova] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:50.149685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-462ccc54-48eb-447b-931e-113169a82e76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6ac8cbb8d6499db210b28768be7e0d', 'request_id': 'req-462ccc54-48eb-447b-931e-113169a82e76'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:50.168534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-462ccc54-48eb-447b-931e-113169a82e76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6ac8cbb8d6499db210b28768be7e0d', 'request_id': 'req-462ccc54-48eb-447b-931e-113169a82e76'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:50.251266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:50.264448 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-462ccc54-48eb-447b-931e-113169a82e76 admin admin] The token cache is being invalidate because project 6e6ac8cbb8d6499db210b28768be7e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 19:59:50.264994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-462ccc54-48eb-447b-931e-113169a82e76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:50.265906 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-462ccc54-48eb-447b-931e-113169a82e76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:50.274015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 841/1656] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 19:59:49 2022] DELETE /identity/v3/projects/6e6ac8cbb8d6499db210b28768be7e0d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:50.276614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ecd92-efab-4658-ba52-81944ab0a962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:50.278146 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ecd92-efab-4658-ba52-81944ab0a962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:50.278471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ecd92-efab-4658-ba52-81944ab0a962 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:50.278828 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edcc74-1c48-40eb-ada5-f25d41ac5104 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:50.278946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ecd92-efab-4658-ba52-81944ab0a962 admin admin] PATH_INFO: `/v3/projects/2c8924b178354b5e97abd9096ca7ea4b` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:50.280269 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ecd92-efab-4658-ba52-81944ab0a962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8924b178354b5e97abd9096ca7ea4b)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:50.280630 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edcc74-1c48-40eb-ada5-f25d41ac5104 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:50.281027 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edcc74-1c48-40eb-ada5-f25d41ac5104 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:50.281329 dv-cinder-839793-12-smb devstack@keystone.service[92146]: WARNING py.warnings [None req-5d9ecd92-efab-4658-ba52-81944ab0a962 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 19:59:50.281329 dv-cinder-839793-12-smb devstack@keystone.service[92146]: warnings.warn(msg) May 27 19:59:50.281329 dv-cinder-839793-12-smb devstack@keystone.service[92146]: May 27 19:59:50.282787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ecd92-efab-4658-ba52-81944ab0a962 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:50.286681 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 842/1657] 10.222.0.15 () {54 vars in 912 bytes} [Fri May 27 19:59:50 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:59:50.288403 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edcc74-1c48-40eb-ada5-f25d41ac5104 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:50.294680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e1edcc74-1c48-40eb-ada5-f25d41ac5104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:50.340267 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edcc74-1c48-40eb-ada5-f25d41ac5104 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:50.347611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449196e1-1f05-4c50-b43d-ff648dfd77b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:50.348619 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449196e1-1f05-4c50-b43d-ff648dfd77b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:50.349149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449196e1-1f05-4c50-b43d-ff648dfd77b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:50.349635 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449196e1-1f05-4c50-b43d-ff648dfd77b2 admin admin] PATH_INFO: `/v3/users/9036c08831784f5693e5895f15ed941f` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:50.351857 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449196e1-1f05-4c50-b43d-ff648dfd77b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9036c08831784f5693e5895f15ed941f)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:50.354687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449196e1-1f05-4c50-b43d-ff648dfd77b2 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:50.515837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5d9ecd92-efab-4658-ba52-81944ab0a962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8924b178354b5e97abd9096ca7ea4b', 'request_id': 'req-5d9ecd92-efab-4658-ba52-81944ab0a962'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:50.646020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5d9ecd92-efab-4658-ba52-81944ab0a962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8924b178354b5e97abd9096ca7ea4b', 'request_id': 'req-5d9ecd92-efab-4658-ba52-81944ab0a962'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:50.683693 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-449196e1-1f05-4c50-b43d-ff648dfd77b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9036c08831784f5693e5895f15ed941f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:50.686018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5d9ecd92-efab-4658-ba52-81944ab0a962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8924b178354b5e97abd9096ca7ea4b', 'request_id': 'req-5d9ecd92-efab-4658-ba52-81944ab0a962'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:50.709459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5d9ecd92-efab-4658-ba52-81944ab0a962 admin admin] The token cache is being invalidate because project 2c8924b178354b5e97abd9096ca7ea4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 19:59:50.709459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5d9ecd92-efab-4658-ba52-81944ab0a962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:50.709459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5d9ecd92-efab-4658-ba52-81944ab0a962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:50.709459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 816/1658] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 19:59:50 2022] DELETE /identity/v3/projects/2c8924b178354b5e97abd9096ca7ea4b => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 19:59:50.713365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8398d-9cd3-4b6a-9a37-caa51fda2f29 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:50.713365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8398d-9cd3-4b6a-9a37-caa51fda2f29 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:50.713365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8398d-9cd3-4b6a-9a37-caa51fda2f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:50.731904 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:50.804797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-449196e1-1f05-4c50-b43d-ff648dfd77b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9036c08831784f5693e5895f15ed941f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:50.805783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-449196e1-1f05-4c50-b43d-ff648dfd77b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9036c08831784f5693e5895f15ed941f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:50.819888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-449196e1-1f05-4c50-b43d-ff648dfd77b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9036c08831784f5693e5895f15ed941f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:50.870859 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-cbf8398d-9cd3-4b6a-9a37-caa51fda2f29 None None] MFA Rules not processed for user `af7e51b89f4c4dcc9963061e6e509eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:50.872876 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cbf8398d-9cd3-4b6a-9a37-caa51fda2f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:50.877413 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-449196e1-1f05-4c50-b43d-ff648dfd77b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9036c08831784f5693e5895f15ed941f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:50.900407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 843/1659] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 19:59:50 2022] DELETE /identity/v3/users/9036c08831784f5693e5895f15ed941f => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:50.904724 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449196e1-1f05-4c50-b43d-ff648dfd77b2 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:50.910829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-449196e1-1f05-4c50-b43d-ff648dfd77b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:50.956639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 817/1660] 10.222.0.15 () {58 vars in 1009 bytes} [Fri May 27 19:59:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:50.957897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8398d-9cd3-4b6a-9a37-caa51fda2f29 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:50.960977 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cbf8398d-9cd3-4b6a-9a37-caa51fda2f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:51.076090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449196e1-1f05-4c50-b43d-ff648dfd77b2 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:51.098819 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716655b2-3bb1-4950-b4e7-6583da3e9298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:51.103428 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716655b2-3bb1-4950-b4e7-6583da3e9298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:51.103844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716655b2-3bb1-4950-b4e7-6583da3e9298 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:51.104229 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716655b2-3bb1-4950-b4e7-6583da3e9298 admin admin] PATH_INFO: `/v3/users/be25dd2f95cc4048b49c71d8815160a7` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:51.106047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716655b2-3bb1-4950-b4e7-6583da3e9298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be25dd2f95cc4048b49c71d8815160a7)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:51.126612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716655b2-3bb1-4950-b4e7-6583da3e9298 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:51.135790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8398d-9cd3-4b6a-9a37-caa51fda2f29 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:51.158081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90050850-f5fa-4fda-aa11-715d9aae4582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:51.161089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90050850-f5fa-4fda-aa11-715d9aae4582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:51.161530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90050850-f5fa-4fda-aa11-715d9aae4582 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:51.162660 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90050850-f5fa-4fda-aa11-715d9aae4582 admin admin] PATH_INFO: `/v3/projects/88e6484c33674834b0e40d98972ede64` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:51.169463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90050850-f5fa-4fda-aa11-715d9aae4582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88e6484c33674834b0e40d98972ede64)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:51.179678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90050850-f5fa-4fda-aa11-715d9aae4582 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:51.474250 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:51.559865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-716655b2-3bb1-4950-b4e7-6583da3e9298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be25dd2f95cc4048b49c71d8815160a7'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:51.561618 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-90050850-f5fa-4fda-aa11-715d9aae4582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88e6484c33674834b0e40d98972ede64', 'request_id': 'req-90050850-f5fa-4fda-aa11-715d9aae4582'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:51.678108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-716655b2-3bb1-4950-b4e7-6583da3e9298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be25dd2f95cc4048b49c71d8815160a7'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:51.678860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-716655b2-3bb1-4950-b4e7-6583da3e9298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be25dd2f95cc4048b49c71d8815160a7'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:51.690195 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-716655b2-3bb1-4950-b4e7-6583da3e9298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be25dd2f95cc4048b49c71d8815160a7'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:51.748071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-90050850-f5fa-4fda-aa11-715d9aae4582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88e6484c33674834b0e40d98972ede64', 'request_id': 'req-90050850-f5fa-4fda-aa11-715d9aae4582'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:51.758397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-90050850-f5fa-4fda-aa11-715d9aae4582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88e6484c33674834b0e40d98972ede64', 'request_id': 'req-90050850-f5fa-4fda-aa11-715d9aae4582'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:51.765879 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-716655b2-3bb1-4950-b4e7-6583da3e9298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be25dd2f95cc4048b49c71d8815160a7'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:51.785774 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 844/1661] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 19:59:50 2022] DELETE /identity/v3/users/be25dd2f95cc4048b49c71d8815160a7 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:51.789574 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716655b2-3bb1-4950-b4e7-6583da3e9298 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:51.793137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-716655b2-3bb1-4950-b4e7-6583da3e9298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:51.818190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-90050850-f5fa-4fda-aa11-715d9aae4582 admin admin] The token cache is being invalidate because project 88e6484c33674834b0e40d98972ede64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 19:59:51.819079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-90050850-f5fa-4fda-aa11-715d9aae4582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:51.819971 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-90050850-f5fa-4fda-aa11-715d9aae4582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:51.822816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 818/1662] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 19:59:50 2022] DELETE /identity/v3/projects/88e6484c33674834b0e40d98972ede64 => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:51.832356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f12d9-283e-4f6c-8a30-22901c14de12 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:51.832356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f12d9-283e-4f6c-8a30-22901c14de12 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:51.832356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f12d9-283e-4f6c-8a30-22901c14de12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:51.864033 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-911f12d9-283e-4f6c-8a30-22901c14de12 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:51.865372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-911f12d9-283e-4f6c-8a30-22901c14de12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:51.924687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716655b2-3bb1-4950-b4e7-6583da3e9298 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:51.934791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3420ed-0155-48d3-bfb8-634684437192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:51.935474 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3420ed-0155-48d3-bfb8-634684437192 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:51.935760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3420ed-0155-48d3-bfb8-634684437192 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:51.936037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3420ed-0155-48d3-bfb8-634684437192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:51.943203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8a3420ed-0155-48d3-bfb8-634684437192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:51.966640 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3420ed-0155-48d3-bfb8-634684437192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:51.969077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3420ed-0155-48d3-bfb8-634684437192 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:51.989319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 845/1663] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:52.019024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 819/1664] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:52.027616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6989ef-395c-45e0-b37a-1e8834ae1a5c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:52.027909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6989ef-395c-45e0-b37a-1e8834ae1a5c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:52.028185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6989ef-395c-45e0-b37a-1e8834ae1a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:52.068769 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-4e6989ef-395c-45e0-b37a-1e8834ae1a5c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:52.069530 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4e6989ef-395c-45e0-b37a-1e8834ae1a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:52.085413 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 846/1665] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:52.090568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f12d9-283e-4f6c-8a30-22901c14de12 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:52.103781 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f12d9-283e-4f6c-8a30-22901c14de12 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:52.117156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328540f-051c-4b8e-9fe6-b57cfc80af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:52.121661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328540f-051c-4b8e-9fe6-b57cfc80af1e admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:52.121661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328540f-051c-4b8e-9fe6-b57cfc80af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:52.121661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328540f-051c-4b8e-9fe6-b57cfc80af1e admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:52.121661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328540f-051c-4b8e-9fe6-b57cfc80af1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:59:52.121661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328540f-051c-4b8e-9fe6-b57cfc80af1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:52.125585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328540f-051c-4b8e-9fe6-b57cfc80af1e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:52.153011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 820/1666] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 19:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:59:52.154446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6989ef-395c-45e0-b37a-1e8834ae1a5c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:52.169173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6989ef-395c-45e0-b37a-1e8834ae1a5c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:52.183259 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef02bf2-f93d-4328-b2f0-a19e6c78d1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:52.184566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef02bf2-f93d-4328-b2f0-a19e6c78d1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:52.185009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef02bf2-f93d-4328-b2f0-a19e6c78d1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:52.185690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef02bf2-f93d-4328-b2f0-a19e6c78d1a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:52.186607 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef02bf2-f93d-4328-b2f0-a19e6c78d1a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:52.191188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef02bf2-f93d-4328-b2f0-a19e6c78d1a7 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:52.317382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 847/1667] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:52 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 19:59:52.322906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328540f-051c-4b8e-9fe6-b57cfc80af1e admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:52.341966 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328540f-051c-4b8e-9fe6-b57cfc80af1e admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:52.435330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d2de2-73b9-4cff-b96d-dc870932ece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:52.436288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d2de2-73b9-4cff-b96d-dc870932ece4 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:52.436288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d2de2-73b9-4cff-b96d-dc870932ece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:52.436723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d2de2-73b9-4cff-b96d-dc870932ece4 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:52.437588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d2de2-73b9-4cff-b96d-dc870932ece4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:52.439981 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d2de2-73b9-4cff-b96d-dc870932ece4 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:52.529147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:52.541527 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 821/1668] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:52 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:52.542222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef02bf2-f93d-4328-b2f0-a19e6c78d1a7 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:52.560614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef02bf2-f93d-4328-b2f0-a19e6c78d1a7 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:52.568646 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a96cf4-498f-45ea-8e67-743bed6f15c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:52.570219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a96cf4-498f-45ea-8e67-743bed6f15c0 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:52.570674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a96cf4-498f-45ea-8e67-743bed6f15c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:52.575108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a96cf4-498f-45ea-8e67-743bed6f15c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:52.575108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a96cf4-498f-45ea-8e67-743bed6f15c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:52.577825 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a96cf4-498f-45ea-8e67-743bed6f15c0 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:52.629116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 848/1669] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:52.632990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d2de2-73b9-4cff-b96d-dc870932ece4 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:52.653121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d2de2-73b9-4cff-b96d-dc870932ece4 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:52.675291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff9d79-b23b-4afe-885f-7eb6258e525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:52.679757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff9d79-b23b-4afe-885f-7eb6258e525d admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:52.684107 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff9d79-b23b-4afe-885f-7eb6258e525d admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:52.684107 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff9d79-b23b-4afe-885f-7eb6258e525d admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:52.684107 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff9d79-b23b-4afe-885f-7eb6258e525d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:52.690445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ff9d79-b23b-4afe-885f-7eb6258e525d admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:52.711197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 822/1670] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:52.712169 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a96cf4-498f-45ea-8e67-743bed6f15c0 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:52.729195 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a96cf4-498f-45ea-8e67-743bed6f15c0 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:52.735135 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e8b4c-47c3-4e72-8a68-2617fafaac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:52.736226 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e8b4c-47c3-4e72-8a68-2617fafaac8f admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:52.737045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e8b4c-47c3-4e72-8a68-2617fafaac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:52.737667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e8b4c-47c3-4e72-8a68-2617fafaac8f admin admin] PATH_INFO: `/v3/projects/8c3bae0ba1bd47f7868e5ab56f5c8201/users/ad42ba6291f84bf6afa48576ae3c7c6a/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:52.780374 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e8b4c-47c3-4e72-8a68-2617fafaac8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3bae0ba1bd47f7868e5ab56f5c8201, user_id=ad42ba6291f84bf6afa48576ae3c7c6a, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:52.783071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e8b4c-47c3-4e72-8a68-2617fafaac8f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:52.909450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff9d79-b23b-4afe-885f-7eb6258e525d admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:52.912497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-39ff9d79-b23b-4afe-885f-7eb6258e525d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:52.918899 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 849/1671] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:52 2022] PUT /identity/v3/projects/8c3bae0ba1bd47f7868e5ab56f5c8201/users/ad42ba6291f84bf6afa48576ae3c7c6a/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:52.936590 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bb9fd-81d9-48de-b0fc-38d5272ef815 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:52.937186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bb9fd-81d9-48de-b0fc-38d5272ef815 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:52.937186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bb9fd-81d9-48de-b0fc-38d5272ef815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:52.950304 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff9d79-b23b-4afe-885f-7eb6258e525d admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:53.025085 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-3d8bb9fd-81d9-48de-b0fc-38d5272ef815 None None] MFA Rules not processed for user `ad42ba6291f84bf6afa48576ae3c7c6a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:53.025085 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-3d8bb9fd-81d9-48de-b0fc-38d5272ef815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:53.159895 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e74f2-f119-4dca-9e8f-51275cfd6669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:53.160798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e74f2-f119-4dca-9e8f-51275cfd6669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:53.160798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e74f2-f119-4dca-9e8f-51275cfd6669 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:53.161093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e74f2-f119-4dca-9e8f-51275cfd6669 admin admin] PATH_INFO: `/v3/projects/70be0b6d525547c1bd629069cdbf30ce` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:53.165894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e74f2-f119-4dca-9e8f-51275cfd6669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70be0b6d525547c1bd629069cdbf30ce)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:53.167916 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e74f2-f119-4dca-9e8f-51275cfd6669 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:53.180609 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 850/1672] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:53.182201 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bb9fd-81d9-48de-b0fc-38d5272ef815 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:53.202621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bb9fd-81d9-48de-b0fc-38d5272ef815 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:53.216362 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145b91f-0d3d-49c6-b6f9-4af8b4f40a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:53.217319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145b91f-0d3d-49c6-b6f9-4af8b4f40a27 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:53.217494 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145b91f-0d3d-49c6-b6f9-4af8b4f40a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:53.217762 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145b91f-0d3d-49c6-b6f9-4af8b4f40a27 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:53.218497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145b91f-0d3d-49c6-b6f9-4af8b4f40a27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:53.224314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145b91f-0d3d-49c6-b6f9-4af8b4f40a27 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:53.386420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 851/1673] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:53 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 19:59:53.386668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-155e74f2-f119-4dca-9e8f-51275cfd6669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70be0b6d525547c1bd629069cdbf30ce', 'request_id': 'req-155e74f2-f119-4dca-9e8f-51275cfd6669'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:53.391622 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b8ec8-3ebd-4abf-8538-0e0577e4bb63 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:53.392798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b8ec8-3ebd-4abf-8538-0e0577e4bb63 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:53.393231 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b8ec8-3ebd-4abf-8538-0e0577e4bb63 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:53.401109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 852/1674] 10.222.0.15 () {54 vars in 960 bytes} [Fri May 27 19:59:53 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 19:59:53.402331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b8ec8-3ebd-4abf-8538-0e0577e4bb63 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:53.466445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-155e74f2-f119-4dca-9e8f-51275cfd6669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70be0b6d525547c1bd629069cdbf30ce', 'request_id': 'req-155e74f2-f119-4dca-9e8f-51275cfd6669'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:53.480162 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b8ec8-3ebd-4abf-8538-0e0577e4bb63 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:53.481219 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-155e74f2-f119-4dca-9e8f-51275cfd6669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70be0b6d525547c1bd629069cdbf30ce', 'request_id': 'req-155e74f2-f119-4dca-9e8f-51275cfd6669'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:53.487305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7418c20e-8c8a-4d77-9e4a-c34027a3a00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:53.488080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418c20e-8c8a-4d77-9e4a-c34027a3a00e admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:53.488387 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418c20e-8c8a-4d77-9e4a-c34027a3a00e admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:53.488792 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418c20e-8c8a-4d77-9e4a-c34027a3a00e admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:53.489631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418c20e-8c8a-4d77-9e4a-c34027a3a00e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:53.492556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7418c20e-8c8a-4d77-9e4a-c34027a3a00e admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:53.511339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-155e74f2-f119-4dca-9e8f-51275cfd6669 admin admin] The token cache is being invalidate because project 70be0b6d525547c1bd629069cdbf30ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 19:59:53.511731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-155e74f2-f119-4dca-9e8f-51275cfd6669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:53.512635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-155e74f2-f119-4dca-9e8f-51275cfd6669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:53.518158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 823/1675] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 19:59:52 2022] DELETE /identity/v3/projects/70be0b6d525547c1bd629069cdbf30ce => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 19:59:53.519758 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a6450-130b-4709-a5f3-a99a5709c045 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:53.520169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a6450-130b-4709-a5f3-a99a5709c045 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:53.520544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a6450-130b-4709-a5f3-a99a5709c045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:53.544166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-a06a6450-130b-4709-a5f3-a99a5709c045 None None] MFA Rules not processed for user `394b43cef91f4990b4707cb7a6798068`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:53.545418 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-a06a6450-130b-4709-a5f3-a99a5709c045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:53.598777 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 853/1676] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:53 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:53.600367 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b5f7d-2a9b-4311-8cd0-c38dfe7d8d2e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:53.600817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b5f7d-2a9b-4311-8cd0-c38dfe7d8d2e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:53.601116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b5f7d-2a9b-4311-8cd0-c38dfe7d8d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:53.669007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-9e5b5f7d-2a9b-4311-8cd0-c38dfe7d8d2e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:53.673902 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9e5b5f7d-2a9b-4311-8cd0-c38dfe7d8d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:53.703723 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 854/1677] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:53.713547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b5f7d-2a9b-4311-8cd0-c38dfe7d8d2e None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:53.717955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9e5b5f7d-2a9b-4311-8cd0-c38dfe7d8d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:53.734470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 824/1678] 10.222.0.15 () {58 vars in 1057 bytes} [Fri May 27 19:59:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:53.736036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbeb6e-ad3c-48ee-a6d3-55fcba28aee5 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:53.736338 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbeb6e-ad3c-48ee-a6d3-55fcba28aee5 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:53.736623 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbeb6e-ad3c-48ee-a6d3-55fcba28aee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:53.769209 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5b5f7d-2a9b-4311-8cd0-c38dfe7d8d2e None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:53.782272 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-f3cbeb6e-ad3c-48ee-a6d3-55fcba28aee5 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:53.782494 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded5d3a-93d2-4273-819c-4d3242ba3afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:53.784190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f3cbeb6e-ad3c-48ee-a6d3-55fcba28aee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:53.784307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded5d3a-93d2-4273-819c-4d3242ba3afe admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:53.784864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded5d3a-93d2-4273-819c-4d3242ba3afe admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:53.785601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded5d3a-93d2-4273-819c-4d3242ba3afe admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:53.787322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded5d3a-93d2-4273-819c-4d3242ba3afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:53.792636 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded5d3a-93d2-4273-819c-4d3242ba3afe admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:53.809387 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 825/1679] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:53.810395 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbeb6e-ad3c-48ee-a6d3-55fcba28aee5 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:53.824266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 855/1680] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:53.824266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded5d3a-93d2-4273-819c-4d3242ba3afe admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:53.832715 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8ded5d3a-93d2-4273-819c-4d3242ba3afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:53.847709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbeb6e-ad3c-48ee-a6d3-55fcba28aee5 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:53.856063 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451606a4-4f92-4058-a34a-ccc6b06df7a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394b43cef91f4990b4707cb7a6798068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:53.856914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451606a4-4f92-4058-a34a-ccc6b06df7a4 service placement] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:53.857351 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451606a4-4f92-4058-a34a-ccc6b06df7a4 service placement] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:53.857759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451606a4-4f92-4058-a34a-ccc6b06df7a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:53.860346 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-451606a4-4f92-4058-a34a-ccc6b06df7a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:53.876265 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded5d3a-93d2-4273-819c-4d3242ba3afe admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:53.881074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:53.889231 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58538c-df4e-4ddd-91a5-c13849e68f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:53.892479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58538c-df4e-4ddd-91a5-c13849e68f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:53.892785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58538c-df4e-4ddd-91a5-c13849e68f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:53.893070 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58538c-df4e-4ddd-91a5-c13849e68f36 admin admin] PATH_INFO: `/v3/projects/168dd97011a145a398e2ba989cc07b50` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:53.898964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58538c-df4e-4ddd-91a5-c13849e68f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=168dd97011a145a398e2ba989cc07b50)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:53.902445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451606a4-4f92-4058-a34a-ccc6b06df7a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:53.904058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451606a4-4f92-4058-a34a-ccc6b06df7a4 service placement] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:53.905415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58538c-df4e-4ddd-91a5-c13849e68f36 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:53.939421 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 826/1681] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:53.941459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451606a4-4f92-4058-a34a-ccc6b06df7a4 service placement] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:53.960300 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451606a4-4f92-4058-a34a-ccc6b06df7a4 service placement] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:53.968026 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745211c-221e-426b-be5a-0daa1e10bb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:53.969043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745211c-221e-426b-be5a-0daa1e10bb73 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:53.969174 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745211c-221e-426b-be5a-0daa1e10bb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:53.970178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745211c-221e-426b-be5a-0daa1e10bb73 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:53.971946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745211c-221e-426b-be5a-0daa1e10bb73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:59:53.972534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745211c-221e-426b-be5a-0daa1e10bb73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:53.974931 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1745211c-221e-426b-be5a-0daa1e10bb73 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:53.997544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 827/1682] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 19:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:59:53.997544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745211c-221e-426b-be5a-0daa1e10bb73 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:54.034804 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745211c-221e-426b-be5a-0daa1e10bb73 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:54.047425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a23cd0-7d63-415e-aae4-c0012e718e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:54.048716 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23cd0-7d63-415e-aae4-c0012e718e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:54.049093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23cd0-7d63-415e-aae4-c0012e718e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:54.050922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a23cd0-7d63-415e-aae4-c0012e718e2a admin admin] PATH_INFO: `/v3/projects/b6c187101dce43d2b801cacd53600904/users/d5d6abe2222740b2bd0bb6b2454f87f5/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:54.082504 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fe58538c-df4e-4ddd-91a5-c13849e68f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '168dd97011a145a398e2ba989cc07b50', 'request_id': 'req-fe58538c-df4e-4ddd-91a5-c13849e68f36'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:54.092463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a23cd0-7d63-415e-aae4-c0012e718e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c187101dce43d2b801cacd53600904, user_id=d5d6abe2222740b2bd0bb6b2454f87f5, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:54.093919 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fe58538c-df4e-4ddd-91a5-c13849e68f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '168dd97011a145a398e2ba989cc07b50', 'request_id': 'req-fe58538c-df4e-4ddd-91a5-c13849e68f36'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:54.099526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a23cd0-7d63-415e-aae4-c0012e718e2a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:54.119741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fe58538c-df4e-4ddd-91a5-c13849e68f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '168dd97011a145a398e2ba989cc07b50', 'request_id': 'req-fe58538c-df4e-4ddd-91a5-c13849e68f36'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:54.211466 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 828/1683] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:53 2022] PUT /identity/v3/projects/b6c187101dce43d2b801cacd53600904/users/d5d6abe2222740b2bd0bb6b2454f87f5/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:54.212750 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a23cd0-7d63-415e-aae4-c0012e718e2a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:54.229836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fe58538c-df4e-4ddd-91a5-c13849e68f36 admin admin] The token cache is being invalidate because project 168dd97011a145a398e2ba989cc07b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 19:59:54.230136 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fe58538c-df4e-4ddd-91a5-c13849e68f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:54.235787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fe58538c-df4e-4ddd-91a5-c13849e68f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:54.240144 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 856/1684] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 19:59:53 2022] DELETE /identity/v3/projects/168dd97011a145a398e2ba989cc07b50 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:54.241170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58538c-df4e-4ddd-91a5-c13849e68f36 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:54.255746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-fe58538c-df4e-4ddd-91a5-c13849e68f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:54.435093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a23cd0-7d63-415e-aae4-c0012e718e2a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:54.447085 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9f52f-ef76-4181-a72f-42c2ba75c38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:54.450379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9f52f-ef76-4181-a72f-42c2ba75c38b admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:54.450885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9f52f-ef76-4181-a72f-42c2ba75c38b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:54.453407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9f52f-ef76-4181-a72f-42c2ba75c38b admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:54.454441 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9f52f-ef76-4181-a72f-42c2ba75c38b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:54.456715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9f52f-ef76-4181-a72f-42c2ba75c38b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:54.482384 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58538c-df4e-4ddd-91a5-c13849e68f36 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:54.508928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923cf0b-0c74-44f7-9e03-ef7cb6f3b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:54.510170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923cf0b-0c74-44f7-9e03-ef7cb6f3b598 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:54.510477 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923cf0b-0c74-44f7-9e03-ef7cb6f3b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:54.510994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923cf0b-0c74-44f7-9e03-ef7cb6f3b598 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:54.511861 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923cf0b-0c74-44f7-9e03-ef7cb6f3b598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:54.513644 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923cf0b-0c74-44f7-9e03-ef7cb6f3b598 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:54.549289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 857/1685] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:54.555985 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cb1b6-4bb9-446a-8c86-537663d85da1 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:54.556289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cb1b6-4bb9-446a-8c86-537663d85da1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:54.556628 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cb1b6-4bb9-446a-8c86-537663d85da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:54.614725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 829/1686] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:54 2022] POST /identity/v3/projects => generated 387 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:54.615013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9f52f-ef76-4181-a72f-42c2ba75c38b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:54.628266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-ab1cb1b6-4bb9-446a-8c86-537663d85da1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:54.630089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ab1cb1b6-4bb9-446a-8c86-537663d85da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:54.672948 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:54.722284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9f52f-ef76-4181-a72f-42c2ba75c38b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:54.729136 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35e86a-0707-427e-90dd-3fc2fd3dcc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:54.734605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35e86a-0707-427e-90dd-3fc2fd3dcc1f admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:54.734605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35e86a-0707-427e-90dd-3fc2fd3dcc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:54.734605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35e86a-0707-427e-90dd-3fc2fd3dcc1f admin admin] PATH_INFO: `/v3/projects/b6c187101dce43d2b801cacd53600904/users/d5d6abe2222740b2bd0bb6b2454f87f5/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:54.735120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35e86a-0707-427e-90dd-3fc2fd3dcc1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c187101dce43d2b801cacd53600904, user_id=d5d6abe2222740b2bd0bb6b2454f87f5, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:54.742561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35e86a-0707-427e-90dd-3fc2fd3dcc1f admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:54.762538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 858/1687] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:54.763518 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cb1b6-4bb9-446a-8c86-537663d85da1 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:54.768925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ab1cb1b6-4bb9-446a-8c86-537663d85da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:54.794514 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cb1b6-4bb9-446a-8c86-537663d85da1 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:54.821234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 830/1688] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:54 2022] PUT /identity/v3/projects/b6c187101dce43d2b801cacd53600904/users/d5d6abe2222740b2bd0bb6b2454f87f5/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:54.823213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f461-01a7-4571-9101-d834ed91fbfd None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:54.830981 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f461-01a7-4571-9101-d834ed91fbfd None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:54.830981 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f461-01a7-4571-9101-d834ed91fbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:54.859006 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-4c55f461-01a7-4571-9101-d834ed91fbfd None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:54.871989 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4c55f461-01a7-4571-9101-d834ed91fbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:55.001176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 831/1689] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:55.002908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212453b8-eb34-4b49-a6eb-fc6991f86ea0 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:55.004397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212453b8-eb34-4b49-a6eb-fc6991f86ea0 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:55.004974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212453b8-eb34-4b49-a6eb-fc6991f86ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:55.007436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec3622-4a23-4e73-a378-28f12d0476d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:55.009483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec3622-4a23-4e73-a378-28f12d0476d3 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:55.009483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec3622-4a23-4e73-a378-28f12d0476d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:55.009483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec3622-4a23-4e73-a378-28f12d0476d3 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:55.016834 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec3622-4a23-4e73-a378-28f12d0476d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:55.025721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec3622-4a23-4e73-a378-28f12d0476d3 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:55.079838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-212453b8-eb34-4b49-a6eb-fc6991f86ea0 None None] MFA Rules not processed for user `d5d6abe2222740b2bd0bb6b2454f87f5`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:55.081799 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-212453b8-eb34-4b49-a6eb-fc6991f86ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:55.181016 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 859/1690] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:54 2022] POST /identity/v3/users => generated 294 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:55.182027 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec3622-4a23-4e73-a378-28f12d0476d3 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:55.217194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec3622-4a23-4e73-a378-28f12d0476d3 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:55.222613 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e65bc2-cfcf-4cfa-89d1-e8037fe74b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:55.227800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e65bc2-cfcf-4cfa-89d1-e8037fe74b10 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:55.227800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e65bc2-cfcf-4cfa-89d1-e8037fe74b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:55.227800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e65bc2-cfcf-4cfa-89d1-e8037fe74b10 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:55.227800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e65bc2-cfcf-4cfa-89d1-e8037fe74b10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 19:59:55.227800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e65bc2-cfcf-4cfa-89d1-e8037fe74b10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:55.227800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e65bc2-cfcf-4cfa-89d1-e8037fe74b10 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:55.279972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 832/1691] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:55.280861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212453b8-eb34-4b49-a6eb-fc6991f86ea0 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:55.297640 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212453b8-eb34-4b49-a6eb-fc6991f86ea0 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:55.297764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 860/1692] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 19:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 19:59:55.297976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14414a5-6046-451e-91f8-13a3dee22a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:55.298625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e65bc2-cfcf-4cfa-89d1-e8037fe74b10 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:55.299132 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14414a5-6046-451e-91f8-13a3dee22a35 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:55.299559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14414a5-6046-451e-91f8-13a3dee22a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:55.299977 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14414a5-6046-451e-91f8-13a3dee22a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:55.300846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14414a5-6046-451e-91f8-13a3dee22a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:55.302652 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14414a5-6046-451e-91f8-13a3dee22a35 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:55.318484 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 833/1693] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:55.319559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14414a5-6046-451e-91f8-13a3dee22a35 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:55.324789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e65bc2-cfcf-4cfa-89d1-e8037fe74b10 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:55.326288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-a14414a5-6046-451e-91f8-13a3dee22a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:55.335894 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550606f4-f73a-4b57-82c8-c1053c6d3e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:55.339087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550606f4-f73a-4b57-82c8-c1053c6d3e8b admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:55.339558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550606f4-f73a-4b57-82c8-c1053c6d3e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:55.339994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550606f4-f73a-4b57-82c8-c1053c6d3e8b admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:55.341009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550606f4-f73a-4b57-82c8-c1053c6d3e8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:55.348023 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550606f4-f73a-4b57-82c8-c1053c6d3e8b admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:55.431818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14414a5-6046-451e-91f8-13a3dee22a35 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:55.435753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805b40c-00e6-4f0d-a97e-50ba92ed2e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:55.436584 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805b40c-00e6-4f0d-a97e-50ba92ed2e1c service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:55.436858 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805b40c-00e6-4f0d-a97e-50ba92ed2e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:55.437145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805b40c-00e6-4f0d-a97e-50ba92ed2e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:55.451098 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805b40c-00e6-4f0d-a97e-50ba92ed2e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:55.452616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805b40c-00e6-4f0d-a97e-50ba92ed2e1c service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:55.464903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 834/1694] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:55.469801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805b40c-00e6-4f0d-a97e-50ba92ed2e1c service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:55.485831 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805b40c-00e6-4f0d-a97e-50ba92ed2e1c service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:55.491640 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c0f31-5184-4d91-9c5c-a4334a8dde83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:55.492375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c0f31-5184-4d91-9c5c-a4334a8dde83 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:55.493323 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c0f31-5184-4d91-9c5c-a4334a8dde83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:55.493647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c0f31-5184-4d91-9c5c-a4334a8dde83 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:55.494411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c0f31-5184-4d91-9c5c-a4334a8dde83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:55.496965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c0f31-5184-4d91-9c5c-a4334a8dde83 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:55.510427 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 835/1695] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:55.516607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c0f31-5184-4d91-9c5c-a4334a8dde83 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:55.532510 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 861/1696] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:55 2022] POST /identity/v3/projects => generated 363 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:55.538324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550606f4-f73a-4b57-82c8-c1053c6d3e8b admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:55.564922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c0f31-5184-4d91-9c5c-a4334a8dde83 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:55.725510 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550606f4-f73a-4b57-82c8-c1053c6d3e8b admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:55.736933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44d7d9-cd74-4b80-9689-fd039aa8a72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:55.737737 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44d7d9-cd74-4b80-9689-fd039aa8a72f admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:55.738026 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44d7d9-cd74-4b80-9689-fd039aa8a72f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:55.738320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44d7d9-cd74-4b80-9689-fd039aa8a72f admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:55.739042 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44d7d9-cd74-4b80-9689-fd039aa8a72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:55.740703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d4741-89bc-49fd-a236-801a7e3afef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:55.741611 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d4741-89bc-49fd-a236-801a7e3afef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:55.741891 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d4741-89bc-49fd-a236-801a7e3afef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:55.742390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d4741-89bc-49fd-a236-801a7e3afef4 admin admin] PATH_INFO: `/v3/projects/f2756f2f2f364a8585fa454bcad3a145/users/3ed0e963abdf4faa923d3601bbbb2336/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:55.745659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e44d7d9-cd74-4b80-9689-fd039aa8a72f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:55.782688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d4741-89bc-49fd-a236-801a7e3afef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2756f2f2f364a8585fa454bcad3a145, user_id=3ed0e963abdf4faa923d3601bbbb2336, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:55.796458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d4741-89bc-49fd-a236-801a7e3afef4 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:55.904139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 862/1697] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:55 2022] POST /identity/v3/users => generated 282 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:55.904139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44d7d9-cd74-4b80-9689-fd039aa8a72f admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:55.906008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 836/1698] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:55 2022] PUT /identity/v3/projects/f2756f2f2f364a8585fa454bcad3a145/users/3ed0e963abdf4faa923d3601bbbb2336/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:55.907249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d4741-89bc-49fd-a236-801a7e3afef4 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:56.021785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:56.059375 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44d7d9-cd74-4b80-9689-fd039aa8a72f admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:56.113012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d4741-89bc-49fd-a236-801a7e3afef4 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:56.140849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021a06f-58fc-4f86-bc29-ebfbb143ced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:56.141577 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021a06f-58fc-4f86-bc29-ebfbb143ced5 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:56.152139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021a06f-58fc-4f86-bc29-ebfbb143ced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:56.152139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021a06f-58fc-4f86-bc29-ebfbb143ced5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:56.152139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021a06f-58fc-4f86-bc29-ebfbb143ced5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:56.158533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021a06f-58fc-4f86-bc29-ebfbb143ced5 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:56.189585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 837/1699] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:56.194508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6477f86-27a1-4d49-890f-e93b4db4d7ed None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:56.195547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6477f86-27a1-4d49-890f-e93b4db4d7ed None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:56.195855 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6477f86-27a1-4d49-890f-e93b4db4d7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:56.224203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58da24-f5c4-4499-85df-0dac7b13f221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:56.224706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58da24-f5c4-4499-85df-0dac7b13f221 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:56.225003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58da24-f5c4-4499-85df-0dac7b13f221 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:56.225299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58da24-f5c4-4499-85df-0dac7b13f221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:56.237932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-cd58da24-f5c4-4499-85df-0dac7b13f221 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:56.307992 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-d6477f86-27a1-4d49-890f-e93b4db4d7ed None None] MFA Rules not processed for user `3ed0e963abdf4faa923d3601bbbb2336`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:56.327514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d6477f86-27a1-4d49-890f-e93b4db4d7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:56.418840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58da24-f5c4-4499-85df-0dac7b13f221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:56.418840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58da24-f5c4-4499-85df-0dac7b13f221 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:56.440818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 863/1700] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:56.442214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58da24-f5c4-4499-85df-0dac7b13f221 service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:56.476641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58da24-f5c4-4499-85df-0dac7b13f221 service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:56.490974 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafd055-4af3-4401-90db-016ba7c2a835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:56.491847 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafd055-4af3-4401-90db-016ba7c2a835 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:56.492298 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafd055-4af3-4401-90db-016ba7c2a835 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:56.492758 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafd055-4af3-4401-90db-016ba7c2a835 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:56.493700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafd055-4af3-4401-90db-016ba7c2a835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:56.495544 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafd055-4af3-4401-90db-016ba7c2a835 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:56.529683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 864/1701] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:56.531170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafd055-4af3-4401-90db-016ba7c2a835 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:56.559464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafd055-4af3-4401-90db-016ba7c2a835 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:56.588644 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b379d63-e710-4b42-bd9f-84469925f406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:56.589587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b379d63-e710-4b42-bd9f-84469925f406 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:56.589879 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b379d63-e710-4b42-bd9f-84469925f406 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:56.590165 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b379d63-e710-4b42-bd9f-84469925f406 admin admin] PATH_INFO: `/v3/projects/18f79c70396e436d9e665f04b0834150/users/df649951de5d44ab8b98231041b8a065/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:56.599991 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 838/1702] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:56.602392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6477f86-27a1-4d49-890f-e93b4db4d7ed None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:56.645889 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6477f86-27a1-4d49-890f-e93b4db4d7ed None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:56.657232 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b379d63-e710-4b42-bd9f-84469925f406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18f79c70396e436d9e665f04b0834150, user_id=df649951de5d44ab8b98231041b8a065, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:56.662276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b379d63-e710-4b42-bd9f-84469925f406 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:56.666746 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605ec1a-a59a-4481-98a1-30ce34e35be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:56.673317 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605ec1a-a59a-4481-98a1-30ce34e35be0 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:56.673632 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605ec1a-a59a-4481-98a1-30ce34e35be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:56.673923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605ec1a-a59a-4481-98a1-30ce34e35be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:56.674699 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605ec1a-a59a-4481-98a1-30ce34e35be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:56.686745 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605ec1a-a59a-4481-98a1-30ce34e35be0 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:56.786494 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 865/1703] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:56 2022] PUT /identity/v3/projects/18f79c70396e436d9e665f04b0834150/users/df649951de5d44ab8b98231041b8a065/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:56.797692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc00a10-5209-41df-ad2f-ae172e31af8a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:56.798932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc00a10-5209-41df-ad2f-ae172e31af8a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:56.799183 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc00a10-5209-41df-ad2f-ae172e31af8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:56.831265 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 839/1704] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:56 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 19:59:56.835679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605ec1a-a59a-4481-98a1-30ce34e35be0 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:56.874587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-0cc00a10-5209-41df-ad2f-ae172e31af8a None None] MFA Rules not processed for user `df649951de5d44ab8b98231041b8a065`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:56.876117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-0cc00a10-5209-41df-ad2f-ae172e31af8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:57.029649 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605ec1a-a59a-4481-98a1-30ce34e35be0 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:57.036690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9d744-b5ec-4efb-91fc-9661fe3f5995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:57.038251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d744-b5ec-4efb-91fc-9661fe3f5995 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:57.038816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d744-b5ec-4efb-91fc-9661fe3f5995 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:57.039265 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9d744-b5ec-4efb-91fc-9661fe3f5995 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:57.040196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9d744-b5ec-4efb-91fc-9661fe3f5995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:57.043439 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9d744-b5ec-4efb-91fc-9661fe3f5995 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:57.049106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 866/1705] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:57.053860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc00a10-5209-41df-ad2f-ae172e31af8a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:57.102230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc00a10-5209-41df-ad2f-ae172e31af8a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:57.108655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799dd04-59bb-47e5-9ddd-af46dff396ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:57.114452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799dd04-59bb-47e5-9ddd-af46dff396ee admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:57.115212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799dd04-59bb-47e5-9ddd-af46dff396ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:57.115335 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799dd04-59bb-47e5-9ddd-af46dff396ee admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:57.117178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799dd04-59bb-47e5-9ddd-af46dff396ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:57.119887 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799dd04-59bb-47e5-9ddd-af46dff396ee admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:57.226663 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 840/1706] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:56 2022] POST /identity/v3/users => generated 294 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:57.231134 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b9813-d4fe-45c7-b94e-471528cd9a48 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:57.231649 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b9813-d4fe-45c7-b94e-471528cd9a48 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:57.232064 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b9813-d4fe-45c7-b94e-471528cd9a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:57.289101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 867/1707] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:57 2022] POST /identity/v3/projects => generated 365 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 19:59:57.289101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799dd04-59bb-47e5-9ddd-af46dff396ee admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:57.375206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:57.531682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799dd04-59bb-47e5-9ddd-af46dff396ee admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:57.546908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba5efc-b77c-4ab6-9899-c11f778fe6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:57.547857 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba5efc-b77c-4ab6-9899-c11f778fe6cb admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:57.548311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba5efc-b77c-4ab6-9899-c11f778fe6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:57.548598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba5efc-b77c-4ab6-9899-c11f778fe6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:57.549378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba5efc-b77c-4ab6-9899-c11f778fe6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:57.551100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba5efc-b77c-4ab6-9899-c11f778fe6cb admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:57.574860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 868/1708] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:57.574860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba5efc-b77c-4ab6-9899-c11f778fe6cb admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:57.579418 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba5efc-b77c-4ab6-9899-c11f778fe6cb admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:57.592575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fb3bf-c3f7-4d79-b246-20502b2b8482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:57.593211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fb3bf-c3f7-4d79-b246-20502b2b8482 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:57.593520 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fb3bf-c3f7-4d79-b246-20502b2b8482 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:57.593834 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fb3bf-c3f7-4d79-b246-20502b2b8482 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:57.594587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fb3bf-c3f7-4d79-b246-20502b2b8482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:57.596727 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125fb3bf-c3f7-4d79-b246-20502b2b8482 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:57.623569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-239b9813-d4fe-45c7-b94e-471528cd9a48 None None] MFA Rules not processed for user `4445523345704277ba223e61b27c557c`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:57.625449 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-239b9813-d4fe-45c7-b94e-471528cd9a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:57.697965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 841/1709] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:57.699142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b9813-d4fe-45c7-b94e-471528cd9a48 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:57.713285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b9813-d4fe-45c7-b94e-471528cd9a48 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:57.718500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 869/1710] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:57 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:57.719690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fb3bf-c3f7-4d79-b246-20502b2b8482 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:57.729404 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30432b26-126e-403c-abfe-9d08d3c4ab9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:57.730367 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30432b26-126e-403c-abfe-9d08d3c4ab9b admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:57.731169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30432b26-126e-403c-abfe-9d08d3c4ab9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:57.731491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-125fb3bf-c3f7-4d79-b246-20502b2b8482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:57.741527 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30432b26-126e-403c-abfe-9d08d3c4ab9b admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:57.743525 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30432b26-126e-403c-abfe-9d08d3c4ab9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:57.749068 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30432b26-126e-403c-abfe-9d08d3c4ab9b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:57.786110 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 842/1711] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:57.787020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30432b26-126e-403c-abfe-9d08d3c4ab9b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:57.831145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30432b26-126e-403c-abfe-9d08d3c4ab9b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:57.842677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1a00b-1bec-4eb8-b2a6-637764752962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:57.843694 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1a00b-1bec-4eb8-b2a6-637764752962 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:57.844133 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1a00b-1bec-4eb8-b2a6-637764752962 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:57.845179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1a00b-1bec-4eb8-b2a6-637764752962 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:57.846138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1a00b-1bec-4eb8-b2a6-637764752962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:57.848235 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1a00b-1bec-4eb8-b2a6-637764752962 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:57.865359 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 843/1712] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:57.869785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1a00b-1bec-4eb8-b2a6-637764752962 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:57.893183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1a00b-1bec-4eb8-b2a6-637764752962 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:57.908569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd16e2d-b05b-4d84-919a-b6df9e0579e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:57.909892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd16e2d-b05b-4d84-919a-b6df9e0579e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:57.910516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd16e2d-b05b-4d84-919a-b6df9e0579e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:57.910955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd16e2d-b05b-4d84-919a-b6df9e0579e8 admin admin] PATH_INFO: `/v3/projects/919dc474dea249e0863cb8cf66284eea/users/94f27b2c1fa445cf89a79dce9f0a51d3/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:57.942660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125fb3bf-c3f7-4d79-b246-20502b2b8482 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:57.948722 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd16e2d-b05b-4d84-919a-b6df9e0579e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919dc474dea249e0863cb8cf66284eea, user_id=94f27b2c1fa445cf89a79dce9f0a51d3, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:57.962981 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0148c9-4818-4ab0-b4f3-96ea46f6c2a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:57.963344 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0148c9-4818-4ab0-b4f3-96ea46f6c2a3 service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:57.963753 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0148c9-4818-4ab0-b4f3-96ea46f6c2a3 service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:57.964112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0148c9-4818-4ab0-b4f3-96ea46f6c2a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:57.972681 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd16e2d-b05b-4d84-919a-b6df9e0579e8 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:57.975565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0148c9-4818-4ab0-b4f3-96ea46f6c2a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:57.977280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0148c9-4818-4ab0-b4f3-96ea46f6c2a3 service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:57.990282 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 870/1713] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:57.991121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0148c9-4818-4ab0-b4f3-96ea46f6c2a3 service nova] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:58.003597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0148c9-4818-4ab0-b4f3-96ea46f6c2a3 service nova] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:58.009001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ad50a-31f9-4640-abc5-33b37fb0e6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:58.010007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ad50a-31f9-4640-abc5-33b37fb0e6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:58.010304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ad50a-31f9-4640-abc5-33b37fb0e6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:58.010721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ad50a-31f9-4640-abc5-33b37fb0e6b4 admin admin] PATH_INFO: `/v3/projects/120ff22b72f64c91b71dcab9741f7db2/users/37840fdb81174b3bac4505e05a633b00/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:58.040910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ad50a-31f9-4640-abc5-33b37fb0e6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120ff22b72f64c91b71dcab9741f7db2, user_id=37840fdb81174b3bac4505e05a633b00, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:58.045602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ad50a-31f9-4640-abc5-33b37fb0e6b4 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:58.089832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 844/1714] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:57 2022] PUT /identity/v3/projects/919dc474dea249e0863cb8cf66284eea/users/94f27b2c1fa445cf89a79dce9f0a51d3/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:58.105757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d746d-49ff-4258-8a73-7bc871ad458c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:58.106043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d746d-49ff-4258-8a73-7bc871ad458c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:58.106329 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d746d-49ff-4258-8a73-7bc871ad458c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:58.207857 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 871/1715] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:57 2022] PUT /identity/v3/projects/120ff22b72f64c91b71dcab9741f7db2/users/37840fdb81174b3bac4505e05a633b00/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:58.210840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ad50a-31f9-4640-abc5-33b37fb0e6b4 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:58.218223 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-7d2d746d-49ff-4258-8a73-7bc871ad458c None None] MFA Rules not processed for user `94f27b2c1fa445cf89a79dce9f0a51d3`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:58.219430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-7d2d746d-49ff-4258-8a73-7bc871ad458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:58.340633 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ad50a-31f9-4640-abc5-33b37fb0e6b4 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:58.346019 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3efa7-8f95-4e03-9b0b-7668caf46fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:58.346975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3efa7-8f95-4e03-9b0b-7668caf46fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:58.347264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3efa7-8f95-4e03-9b0b-7668caf46fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:58.347551 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3efa7-8f95-4e03-9b0b-7668caf46fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:58.348620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3efa7-8f95-4e03-9b0b-7668caf46fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:58.350268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3efa7-8f95-4e03-9b0b-7668caf46fa9 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:58.364688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 872/1716] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:58.394712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3efa7-8f95-4e03-9b0b-7668caf46fa9 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:58.413442 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3efa7-8f95-4e03-9b0b-7668caf46fa9 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:58.428503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 845/1717] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:58.434118 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069025f8-2049-449d-b2e7-c0e0d64f8296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:58.435816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069025f8-2049-449d-b2e7-c0e0d64f8296 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:58.436146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069025f8-2049-449d-b2e7-c0e0d64f8296 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:58.436530 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069025f8-2049-449d-b2e7-c0e0d64f8296 admin admin] PATH_INFO: `/v3/projects/120ff22b72f64c91b71dcab9741f7db2/users/37840fdb81174b3bac4505e05a633b00/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:58.439375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d746d-49ff-4258-8a73-7bc871ad458c None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:58.444882 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069025f8-2049-449d-b2e7-c0e0d64f8296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120ff22b72f64c91b71dcab9741f7db2, user_id=37840fdb81174b3bac4505e05a633b00, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:58.456562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d746d-49ff-4258-8a73-7bc871ad458c None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:58.457701 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069025f8-2049-449d-b2e7-c0e0d64f8296 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:58.464374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b4717-ff4e-4f53-9545-a8ad4195fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:58.465778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b4717-ff4e-4f53-9545-a8ad4195fe8e admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:58.466287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b4717-ff4e-4f53-9545-a8ad4195fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:58.466801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b4717-ff4e-4f53-9545-a8ad4195fe8e admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:58.467874 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b4717-ff4e-4f53-9545-a8ad4195fe8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:58.470430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b4717-ff4e-4f53-9545-a8ad4195fe8e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:58.521618 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 873/1718] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:58 2022] PUT /identity/v3/projects/120ff22b72f64c91b71dcab9741f7db2/users/37840fdb81174b3bac4505e05a633b00/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:58.536549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15926c-3618-4c55-8e57-887989a19006 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:58.536862 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15926c-3618-4c55-8e57-887989a19006 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:58.537152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15926c-3618-4c55-8e57-887989a19006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:58.658256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 846/1719] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 19:59:58 2022] POST /identity/v3/projects => generated 387 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:58.662453 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-ce15926c-3618-4c55-8e57-887989a19006 None None] MFA Rules not processed for user `37840fdb81174b3bac4505e05a633b00`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:58.664038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ce15926c-3618-4c55-8e57-887989a19006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:58.664393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b4717-ff4e-4f53-9545-a8ad4195fe8e admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:58.847869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b4717-ff4e-4f53-9545-a8ad4195fe8e admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:58.866159 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b25a6-f7d5-4eb1-b858-a209f0594bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:58.870454 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b25a6-f7d5-4eb1-b858-a209f0594bdf admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:58.872239 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b25a6-f7d5-4eb1-b858-a209f0594bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:58.873126 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b25a6-f7d5-4eb1-b858-a209f0594bdf admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:58.881777 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b25a6-f7d5-4eb1-b858-a209f0594bdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:58.885253 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b25a6-f7d5-4eb1-b858-a209f0594bdf admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:58.903346 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 874/1720] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:59:58.917718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15926c-3618-4c55-8e57-887989a19006 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:58.919577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ce15926c-3618-4c55-8e57-887989a19006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:59.025805 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15926c-3618-4c55-8e57-887989a19006 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:59.040691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de98db1-3570-48b2-b2d3-726e3409b776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:59.041864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de98db1-3570-48b2-b2d3-726e3409b776 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:59.042600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de98db1-3570-48b2-b2d3-726e3409b776 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:59.043187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de98db1-3570-48b2-b2d3-726e3409b776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:59.056294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de98db1-3570-48b2-b2d3-726e3409b776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:59.062119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de98db1-3570-48b2-b2d3-726e3409b776 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:59.078435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 847/1721] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 19:59:58 2022] POST /identity/v3/users => generated 300 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 19:59:59.081612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b25a6-f7d5-4eb1-b858-a209f0594bdf admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:59.093106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 875/1722] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 19:59:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 19:59:59.100492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b25a6-f7d5-4eb1-b858-a209f0594bdf admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:59.127646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136a318-cc39-46a6-acf8-197c652bc1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:59.128539 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a318-cc39-46a6-acf8-197c652bc1fc admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:59.128827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a318-cc39-46a6-acf8-197c652bc1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:59.129109 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136a318-cc39-46a6-acf8-197c652bc1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:59.129852 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136a318-cc39-46a6-acf8-197c652bc1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:59.132965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136a318-cc39-46a6-acf8-197c652bc1fc admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:59.171345 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 848/1723] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 19:59:59.173134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de98db1-3570-48b2-b2d3-726e3409b776 service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:59.194565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de98db1-3570-48b2-b2d3-726e3409b776 service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:59.200905 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fefbb-55df-472c-876d-eeacf5f877fd None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:59.201210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fefbb-55df-472c-876d-eeacf5f877fd None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:59.201492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fefbb-55df-472c-876d-eeacf5f877fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:59.203046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25211cd-364a-4feb-8f94-7cb6215d6a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:59.204581 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25211cd-364a-4feb-8f94-7cb6215d6a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:59.245286 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25211cd-364a-4feb-8f94-7cb6215d6a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:59.251636 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25211cd-364a-4feb-8f94-7cb6215d6a72 admin admin] PATH_INFO: `/v3/projects/7ce0699e938b43ebb6d369dc3abdcbd3/users/9975885df18946f8ab9cac75f9dbc767/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:59.271269 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-678fefbb-55df-472c-876d-eeacf5f877fd None None] MFA Rules not processed for user `9cbadf27b0054737bc798f8500dd661f`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:59.272994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-678fefbb-55df-472c-876d-eeacf5f877fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:59.286982 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25211cd-364a-4feb-8f94-7cb6215d6a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce0699e938b43ebb6d369dc3abdcbd3, user_id=9975885df18946f8ab9cac75f9dbc767, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:59.290920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25211cd-364a-4feb-8f94-7cb6215d6a72 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:59.379476 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 876/1724] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 19:59:59 2022] PUT /identity/v3/projects/7ce0699e938b43ebb6d369dc3abdcbd3/users/9975885df18946f8ab9cac75f9dbc767/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 19:59:59.379476 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb7051-4048-4f4f-829e-cac906f7f4fa None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:59.379476 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb7051-4048-4f4f-829e-cac906f7f4fa None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:59.380230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb7051-4048-4f4f-829e-cac906f7f4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:59.403097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 849/1725] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 19:59:59.404278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fefbb-55df-472c-876d-eeacf5f877fd None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:59.406660 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-678fefbb-55df-472c-876d-eeacf5f877fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:59.422194 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fefbb-55df-472c-876d-eeacf5f877fd None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:59.498203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-2afb7051-4048-4f4f-829e-cac906f7f4fa None None] MFA Rules not processed for user `e3667bac6fe34a0bb29cdf7c9fc556f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:59.507128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2afb7051-4048-4f4f-829e-cac906f7f4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:59.588393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:59.633820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0644-801f-4811-8722-6c14b846edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:59.641034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 19:59:59.641669 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0644-801f-4811-8722-6c14b846edaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:59.641994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0644-801f-4811-8722-6c14b846edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:59.642280 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a0644-801f-4811-8722-6c14b846edaa admin admin] PATH_INFO: `/v3/users/d286359e301245bcac282d598b652f45` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:59.647123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a0644-801f-4811-8722-6c14b846edaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d286359e301245bcac282d598b652f45)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:59.656168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a0644-801f-4811-8722-6c14b846edaa admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:59.718916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 877/1726] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 19:59:59.720735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb7051-4048-4f4f-829e-cac906f7f4fa None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 19:59:59.760874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb7051-4048-4f4f-829e-cac906f7f4fa None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 19:59:59.789553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9e67c-8300-45e9-83d2-8e8200439f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 19:59:59.792123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9e67c-8300-45e9-83d2-8e8200439f1d admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:59.792579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9e67c-8300-45e9-83d2-8e8200439f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:59.793306 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9e67c-8300-45e9-83d2-8e8200439f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:59.796725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9e67c-8300-45e9-83d2-8e8200439f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 19:59:59.807816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9e67c-8300-45e9-83d2-8e8200439f1d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 19:59:59.841941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 878/1727] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 19:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 19:59:59.845232 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5923b89-ecd5-4906-bcbd-6ce56e332ab2 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 19:59:59.847444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5923b89-ecd5-4906-bcbd-6ce56e332ab2 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 19:59:59.847885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5923b89-ecd5-4906-bcbd-6ce56e332ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 19:59:59.901381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a5923b89-ecd5-4906-bcbd-6ce56e332ab2 None None] MFA Rules not processed for user `9cbadf27b0054737bc798f8500dd661f`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 19:59:59.902564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a5923b89-ecd5-4906-bcbd-6ce56e332ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 19:59:59.963497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6b2a0644-801f-4811-8722-6c14b846edaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd286359e301245bcac282d598b652f45'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 19:59:59.964395 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6b2a0644-801f-4811-8722-6c14b846edaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd286359e301245bcac282d598b652f45'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:00.029822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 879/1728] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 19:59:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:00.031626 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5923b89-ecd5-4906-bcbd-6ce56e332ab2 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:00.034549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a5923b89-ecd5-4906-bcbd-6ce56e332ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:00.083648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6b2a0644-801f-4811-8722-6c14b846edaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd286359e301245bcac282d598b652f45'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:00.115001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6b2a0644-801f-4811-8722-6c14b846edaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd286359e301245bcac282d598b652f45'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:00.146763 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6b2a0644-801f-4811-8722-6c14b846edaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd286359e301245bcac282d598b652f45'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:00.181487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 850/1729] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 19:59:59 2022] DELETE /identity/v3/users/d286359e301245bcac282d598b652f45 => generated 0 bytes in 778 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:00.182965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0644-801f-4811-8722-6c14b846edaa admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:00.189575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-6b2a0644-801f-4811-8722-6c14b846edaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:00.237380 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5923b89-ecd5-4906-bcbd-6ce56e332ab2 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:00.376427 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a0644-801f-4811-8722-6c14b846edaa admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:00.388326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf59225-5624-49ac-883d-5397142111a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:00.390301 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf59225-5624-49ac-883d-5397142111a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:00.390617 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf59225-5624-49ac-883d-5397142111a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:00.390898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf59225-5624-49ac-883d-5397142111a9 admin admin] PATH_INFO: `/v3/projects/7ce0699e938b43ebb6d369dc3abdcbd3/users/9975885df18946f8ab9cac75f9dbc767/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:00.395842 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf59225-5624-49ac-883d-5397142111a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce0699e938b43ebb6d369dc3abdcbd3, user_id=9975885df18946f8ab9cac75f9dbc767, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:00.402396 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf59225-5624-49ac-883d-5397142111a9 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:00.418182 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c8939-8b83-4628-aa20-dd21170cb23a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:00.420667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c8939-8b83-4628-aa20-dd21170cb23a service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:00.421048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c8939-8b83-4628-aa20-dd21170cb23a service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:00.421950 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c8939-8b83-4628-aa20-dd21170cb23a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:00.426136 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-405c8939-8b83-4628-aa20-dd21170cb23a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:00.438752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 851/1730] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:00 2022] PUT /identity/v3/projects/7ce0699e938b43ebb6d369dc3abdcbd3/users/9975885df18946f8ab9cac75f9dbc767/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:00.438752 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf59225-5624-49ac-883d-5397142111a9 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:00.448411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-ddf59225-5624-49ac-883d-5397142111a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:00.600555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c8939-8b83-4628-aa20-dd21170cb23a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:00.604112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c8939-8b83-4628-aa20-dd21170cb23a service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:00.628048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 880/1731] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:00.628048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fcdd5-cc12-4219-98a2-7541043c5749 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:00.628048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fcdd5-cc12-4219-98a2-7541043c5749 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:00.628048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fcdd5-cc12-4219-98a2-7541043c5749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:00.672381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a27fcdd5-cc12-4219-98a2-7541043c5749 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:00.674102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a27fcdd5-cc12-4219-98a2-7541043c5749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:00.678673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf59225-5624-49ac-883d-5397142111a9 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:00.686622 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00373ccb-7684-4c69-a636-e3b9ff1d5a45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:00.697233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00373ccb-7684-4c69-a636-e3b9ff1d5a45 service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:00.697531 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00373ccb-7684-4c69-a636-e3b9ff1d5a45 service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:00.697828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00373ccb-7684-4c69-a636-e3b9ff1d5a45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:00.703348 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-00373ccb-7684-4c69-a636-e3b9ff1d5a45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:00.844567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 881/1732] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:00.851566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f5c05-c22a-4f33-9636-5a70b02c8c9f None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:00.853939 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f5c05-c22a-4f33-9636-5a70b02c8c9f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:00.854235 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f5c05-c22a-4f33-9636-5a70b02c8c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:00.880589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00373ccb-7684-4c69-a636-e3b9ff1d5a45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:00.887605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00373ccb-7684-4c69-a636-e3b9ff1d5a45 service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:00.909800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 852/1733] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:00.916208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1641b-2432-44a7-9bc3-de11e6591de4 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:00.916447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1641b-2432-44a7-9bc3-de11e6591de4 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:00.917242 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1641b-2432-44a7-9bc3-de11e6591de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:00.923956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a86f5c05-c22a-4f33-9636-5a70b02c8c9f None None] MFA Rules not processed for user `9975885df18946f8ab9cac75f9dbc767`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:00.925174 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a86f5c05-c22a-4f33-9636-5a70b02c8c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:00.956173 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-92c1641b-2432-44a7-9bc3-de11e6591de4 None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:00.957416 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-92c1641b-2432-44a7-9bc3-de11e6591de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:01.166160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 882/1734] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:01.167443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f5c05-c22a-4f33-9636-5a70b02c8c9f None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:01.170124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 853/1735] 10.222.0.15 () {58 vars in 1009 bytes} [Fri May 27 20:00:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:01.171072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1641b-2432-44a7-9bc3-de11e6591de4 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:01.179590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-92c1641b-2432-44a7-9bc3-de11e6591de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:01.184867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a86f5c05-c22a-4f33-9636-5a70b02c8c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:01.208677 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f5c05-c22a-4f33-9636-5a70b02c8c9f None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:01.234206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa4598-c829-4438-a6cc-48bc6eda0d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:01.235082 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa4598-c829-4438-a6cc-48bc6eda0d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:01.235377 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa4598-c829-4438-a6cc-48bc6eda0d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:01.238389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa4598-c829-4438-a6cc-48bc6eda0d50 admin admin] PATH_INFO: `/v3/users/df649951de5d44ab8b98231041b8a065` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:01.242028 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa4598-c829-4438-a6cc-48bc6eda0d50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df649951de5d44ab8b98231041b8a065)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:01.247995 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa4598-c829-4438-a6cc-48bc6eda0d50 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:01.277066 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1641b-2432-44a7-9bc3-de11e6591de4 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:01.282790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29733330-b5e8-4d4b-8601-c37e39a08cbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:01.282790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29733330-b5e8-4d4b-8601-c37e39a08cbb service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:01.282790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29733330-b5e8-4d4b-8601-c37e39a08cbb service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:01.283087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29733330-b5e8-4d4b-8601-c37e39a08cbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:01.296676 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29733330-b5e8-4d4b-8601-c37e39a08cbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:01.297998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29733330-b5e8-4d4b-8601-c37e39a08cbb service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:01.340627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 854/1736] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:01.342690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29733330-b5e8-4d4b-8601-c37e39a08cbb service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:01.346236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:01.348997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-29733330-b5e8-4d4b-8601-c37e39a08cbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:01.559147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4cfa4598-c829-4438-a6cc-48bc6eda0d50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df649951de5d44ab8b98231041b8a065'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:01.560815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29733330-b5e8-4d4b-8601-c37e39a08cbb service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:01.576949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078da582-4f23-4bff-9915-eff2ead8997f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:01.576949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078da582-4f23-4bff-9915-eff2ead8997f service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:01.577369 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078da582-4f23-4bff-9915-eff2ead8997f service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:01.577819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078da582-4f23-4bff-9915-eff2ead8997f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:01.589383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078da582-4f23-4bff-9915-eff2ead8997f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:01.591651 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078da582-4f23-4bff-9915-eff2ead8997f service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:01.609915 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 855/1737] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:01.642694 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078da582-4f23-4bff-9915-eff2ead8997f service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:01.645173 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-078da582-4f23-4bff-9915-eff2ead8997f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:01.714257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4cfa4598-c829-4438-a6cc-48bc6eda0d50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df649951de5d44ab8b98231041b8a065'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:01.717171 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4cfa4598-c829-4438-a6cc-48bc6eda0d50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df649951de5d44ab8b98231041b8a065'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:01.737224 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4cfa4598-c829-4438-a6cc-48bc6eda0d50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df649951de5d44ab8b98231041b8a065'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:01.795436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4cfa4598-c829-4438-a6cc-48bc6eda0d50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df649951de5d44ab8b98231041b8a065'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:01.814920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 883/1738] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:01 2022] DELETE /identity/v3/users/df649951de5d44ab8b98231041b8a065 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:01.819671 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0be3c-dc92-4df5-8e80-be1d44f3ee67 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:01.820177 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0be3c-dc92-4df5-8e80-be1d44f3ee67 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:01.821710 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0be3c-dc92-4df5-8e80-be1d44f3ee67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:01.888009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-31c0be3c-dc92-4df5-8e80-be1d44f3ee67 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:01.890218 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-31c0be3c-dc92-4df5-8e80-be1d44f3ee67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:01.911291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078da582-4f23-4bff-9915-eff2ead8997f service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:02.118301 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 884/1739] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:02.127086 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9d2ae-090c-43f8-aca5-237c8241fb01 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:02.129662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9d2ae-090c-43f8-aca5-237c8241fb01 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:02.132074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9d2ae-090c-43f8-aca5-237c8241fb01 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:02.136389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 885/1740] 10.222.0.15 () {54 vars in 912 bytes} [Fri May 27 20:00:02 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 20:00:02.144529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c1c18-dc53-4261-a44b-c47dd9c6f0d0 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:02.145303 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c1c18-dc53-4261-a44b-c47dd9c6f0d0 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:02.145303 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c1c18-dc53-4261-a44b-c47dd9c6f0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:02.150513 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c14e8b-451f-4205-9ef0-6ee3789da5d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:02.151368 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c14e8b-451f-4205-9ef0-6ee3789da5d4 service swift] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:02.151581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c14e8b-451f-4205-9ef0-6ee3789da5d4 service swift] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:02.151872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c14e8b-451f-4205-9ef0-6ee3789da5d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:02.156675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-02c14e8b-451f-4205-9ef0-6ee3789da5d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:02.192565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a65c1c18-dc53-4261-a44b-c47dd9c6f0d0 None None] MFA Rules not processed for user `af7e51b89f4c4dcc9963061e6e509eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:02.199909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a65c1c18-dc53-4261-a44b-c47dd9c6f0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:02.385381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c14e8b-451f-4205-9ef0-6ee3789da5d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:02.391858 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c14e8b-451f-4205-9ef0-6ee3789da5d4 service swift] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:02.417988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 886/1741] 10.222.0.15 () {58 vars in 1009 bytes} [Fri May 27 20:00:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:02.419070 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c1c18-dc53-4261-a44b-c47dd9c6f0d0 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:02.424149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a65c1c18-dc53-4261-a44b-c47dd9c6f0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:02.442557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 856/1742] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:00:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 800 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 20:00:02.458287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c14e8b-451f-4205-9ef0-6ee3789da5d4 service swift] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:02.467931 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:02.501789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c1c18-dc53-4261-a44b-c47dd9c6f0d0 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:02.513378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe3202-f956-4873-8724-93541b23ccfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:02.515111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe3202-f956-4873-8724-93541b23ccfc service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:02.515610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe3202-f956-4873-8724-93541b23ccfc service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:02.516355 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe3202-f956-4873-8724-93541b23ccfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:02.518616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c14e8b-451f-4205-9ef0-6ee3789da5d4 service swift] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:02.538759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444beb8-4380-4ee3-af10-70f6264217e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:02.539647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444beb8-4380-4ee3-af10-70f6264217e3 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:02.542191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444beb8-4380-4ee3-af10-70f6264217e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:02.544204 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444beb8-4380-4ee3-af10-70f6264217e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:02.548468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe3202-f956-4873-8724-93541b23ccfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:02.554109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe3202-f956-4873-8724-93541b23ccfc service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:02.584033 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 887/1743] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:02.585005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444beb8-4380-4ee3-af10-70f6264217e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:02.594355 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:02.606808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444beb8-4380-4ee3-af10-70f6264217e3 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:02.653743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 857/1744] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:00:03.300615 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f498c9-8720-4d3f-9757-cd1b696fb78b None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:03.301000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f498c9-8720-4d3f-9757-cd1b696fb78b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:03.301289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f498c9-8720-4d3f-9757-cd1b696fb78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:03.375399 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-96f498c9-8720-4d3f-9757-cd1b696fb78b None None] MFA Rules not processed for user `af7e51b89f4c4dcc9963061e6e509eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:03.385466 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-96f498c9-8720-4d3f-9757-cd1b696fb78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:03.413391 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 888/1745] 10.222.0.24 () {58 vars in 1015 bytes} [Fri May 27 20:00:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:03.464144 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444beb8-4380-4ee3-af10-70f6264217e3 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:03.464144 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d444beb8-4380-4ee3-af10-70f6264217e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:03.503580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444beb8-4380-4ee3-af10-70f6264217e3 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:03.518901 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbc213-6596-4cf9-94f4-1c3b8b54b07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:03.521324 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbc213-6596-4cf9-94f4-1c3b8b54b07e service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:03.521324 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbc213-6596-4cf9-94f4-1c3b8b54b07e service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:03.524825 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbc213-6596-4cf9-94f4-1c3b8b54b07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:03.568003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbc213-6596-4cf9-94f4-1c3b8b54b07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:03.573938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbc213-6596-4cf9-94f4-1c3b8b54b07e service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:03.611169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 858/1746] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:00:03.735363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f498c9-8720-4d3f-9757-cd1b696fb78b None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:03.737572 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-96f498c9-8720-4d3f-9757-cd1b696fb78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:03.842479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f498c9-8720-4d3f-9757-cd1b696fb78b None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:03.842479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df7b9a-c40c-43f1-9224-ab2495204d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:03.842479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df7b9a-c40c-43f1-9224-ab2495204d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:03.842479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df7b9a-c40c-43f1-9224-ab2495204d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:03.844168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df7b9a-c40c-43f1-9224-ab2495204d83 admin admin] PATH_INFO: `/v3/projects/4f46fbd999a9447db488abf47b64ce82` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:03.844168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df7b9a-c40c-43f1-9224-ab2495204d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f46fbd999a9447db488abf47b64ce82)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:03.844168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df7b9a-c40c-43f1-9224-ab2495204d83 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:03.877529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbc213-6596-4cf9-94f4-1c3b8b54b07e service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:03.881023 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-76bbc213-6596-4cf9-94f4-1c3b8b54b07e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:04.056962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbc213-6596-4cf9-94f4-1c3b8b54b07e service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:04.072186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c8b65-cb24-4a13-8909-ccfdda042ab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:04.073156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c8b65-cb24-4a13-8909-ccfdda042ab0 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:04.073601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c8b65-cb24-4a13-8909-ccfdda042ab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:04.074081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c8b65-cb24-4a13-8909-ccfdda042ab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:04.076733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-772c8b65-cb24-4a13-8909-ccfdda042ab0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:04.256956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-58df7b9a-c40c-43f1-9224-ab2495204d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f46fbd999a9447db488abf47b64ce82', 'request_id': 'req-58df7b9a-c40c-43f1-9224-ab2495204d83'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:04.275004 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c8b65-cb24-4a13-8909-ccfdda042ab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:04.278472 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c8b65-cb24-4a13-8909-ccfdda042ab0 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:04.289379 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-58df7b9a-c40c-43f1-9224-ab2495204d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f46fbd999a9447db488abf47b64ce82', 'request_id': 'req-58df7b9a-c40c-43f1-9224-ab2495204d83'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:04.317496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 859/1747] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:00:04.326282 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-58df7b9a-c40c-43f1-9224-ab2495204d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f46fbd999a9447db488abf47b64ce82', 'request_id': 'req-58df7b9a-c40c-43f1-9224-ab2495204d83'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:04.395426 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:04.452900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-58df7b9a-c40c-43f1-9224-ab2495204d83 admin admin] The token cache is being invalidate because project 4f46fbd999a9447db488abf47b64ce82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:04.453234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-58df7b9a-c40c-43f1-9224-ab2495204d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:04.458836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-58df7b9a-c40c-43f1-9224-ab2495204d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:04.460602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 889/1748] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:03 2022] DELETE /identity/v3/projects/4f46fbd999a9447db488abf47b64ce82 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:04.482893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cfa2a-b1f8-47c1-80f4-bdb577071044 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:04.482893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cfa2a-b1f8-47c1-80f4-bdb577071044 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:04.494287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cfa2a-b1f8-47c1-80f4-bdb577071044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:04.539011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:04.566790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-762cfa2a-b1f8-47c1-80f4-bdb577071044 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:04.570425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-762cfa2a-b1f8-47c1-80f4-bdb577071044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:04.751988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aa529-2ce1-4787-9df4-7c06e7857d53 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:04.751988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aa529-2ce1-4787-9df4-7c06e7857d53 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:04.752421 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aa529-2ce1-4787-9df4-7c06e7857d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:04.787395 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 860/1749] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:04.797744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36cc31-5b58-41d8-b28a-9cf561259bb8 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:04.799241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36cc31-5b58-41d8-b28a-9cf561259bb8 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:04.799723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36cc31-5b58-41d8-b28a-9cf561259bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:04.824571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-bb5aa529-2ce1-4787-9df4-7c06e7857d53 None None] MFA Rules not processed for user `4445523345704277ba223e61b27c557c`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:04.829395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-bb5aa529-2ce1-4787-9df4-7c06e7857d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:04.876826 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-4e36cc31-5b58-41d8-b28a-9cf561259bb8 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:04.885193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4e36cc31-5b58-41d8-b28a-9cf561259bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:04.918269 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 861/1750] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:04.922802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36cc31-5b58-41d8-b28a-9cf561259bb8 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:04.952665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36cc31-5b58-41d8-b28a-9cf561259bb8 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:05.004813 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9adab-405d-41e6-887e-5bd5499829fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:05.005988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9adab-405d-41e6-887e-5bd5499829fc admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:05.006749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9adab-405d-41e6-887e-5bd5499829fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:05.007196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9adab-405d-41e6-887e-5bd5499829fc admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:05.008319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9adab-405d-41e6-887e-5bd5499829fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:05.010101 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9adab-405d-41e6-887e-5bd5499829fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:05.012130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9adab-405d-41e6-887e-5bd5499829fc admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:05.060245 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 890/1751] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:05.062053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c57ac-e0f0-43f2-a2a2-a74fa04f7c59 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:05.063695 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c57ac-e0f0-43f2-a2a2-a74fa04f7c59 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:05.068150 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c57ac-e0f0-43f2-a2a2-a74fa04f7c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:05.120070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 862/1752] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:00:05.125412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9adab-405d-41e6-887e-5bd5499829fc admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:05.144271 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-f10c57ac-e0f0-43f2-a2a2-a74fa04f7c59 None None] MFA Rules not processed for user `9cbadf27b0054737bc798f8500dd661f`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:05.146371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f10c57ac-e0f0-43f2-a2a2-a74fa04f7c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:05.159519 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9adab-405d-41e6-887e-5bd5499829fc admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:05.169972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884713c-65e7-46fd-9a8e-f72fe4a5851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:05.170921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884713c-65e7-46fd-9a8e-f72fe4a5851e admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:05.172267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884713c-65e7-46fd-9a8e-f72fe4a5851e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:05.172718 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884713c-65e7-46fd-9a8e-f72fe4a5851e admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:05.183878 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884713c-65e7-46fd-9a8e-f72fe4a5851e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:05.191662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884713c-65e7-46fd-9a8e-f72fe4a5851e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:05.406758 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 863/1753] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:05 2022] POST /identity/v3/projects => generated 365 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:05.408588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884713c-65e7-46fd-9a8e-f72fe4a5851e admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:05.466617 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 891/1754] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:05.661127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884713c-65e7-46fd-9a8e-f72fe4a5851e admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:05.672529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bab07f-9895-433a-925b-1dfaf0baa503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:05.672529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bab07f-9895-433a-925b-1dfaf0baa503 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:05.672529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bab07f-9895-433a-925b-1dfaf0baa503 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:05.672529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bab07f-9895-433a-925b-1dfaf0baa503 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:05.672884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bab07f-9895-433a-925b-1dfaf0baa503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:05.681030 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bab07f-9895-433a-925b-1dfaf0baa503 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:05.829973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 864/1755] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:05 2022] POST /identity/v3/users => generated 283 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:05.834223 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c57ac-e0f0-43f2-a2a2-a74fa04f7c59 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:05.858872 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c57ac-e0f0-43f2-a2a2-a74fa04f7c59 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:05.869780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:05.879579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a2ab6-e9e5-426a-b5d5-a993267515f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:05.879579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a2ab6-e9e5-426a-b5d5-a993267515f4 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:05.879579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a2ab6-e9e5-426a-b5d5-a993267515f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:05.883968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a2ab6-e9e5-426a-b5d5-a993267515f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:05.884891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a2ab6-e9e5-426a-b5d5-a993267515f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:05.919724 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a2ab6-e9e5-426a-b5d5-a993267515f4 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:05.937824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 892/1756] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:05.939809 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bab07f-9895-433a-925b-1dfaf0baa503 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:05.958389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bab07f-9895-433a-925b-1dfaf0baa503 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:05.971793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761746f4-7ccf-49bf-b000-ea6d881fa98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:05.972871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761746f4-7ccf-49bf-b000-ea6d881fa98e admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:05.974505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761746f4-7ccf-49bf-b000-ea6d881fa98e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:05.975973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761746f4-7ccf-49bf-b000-ea6d881fa98e admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:05.979768 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761746f4-7ccf-49bf-b000-ea6d881fa98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:05.983845 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761746f4-7ccf-49bf-b000-ea6d881fa98e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:06.015759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 865/1757] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:06.020426 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a2ab6-e9e5-426a-b5d5-a993267515f4 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:06.022487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:06.046637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a2ab6-e9e5-426a-b5d5-a993267515f4 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:06.064389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd7914-9fb6-4ec5-90c4-337a69629067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:06.065373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd7914-9fb6-4ec5-90c4-337a69629067 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:06.065666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd7914-9fb6-4ec5-90c4-337a69629067 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:06.065981 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd7914-9fb6-4ec5-90c4-337a69629067 admin admin] PATH_INFO: `/v3/projects/9aa90ce982b94089bb8b52b12ca250ac/users/2521d29b71804d738c00c5edbdce2842/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:06.106297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd7914-9fb6-4ec5-90c4-337a69629067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa90ce982b94089bb8b52b12ca250ac, user_id=2521d29b71804d738c00c5edbdce2842, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:06.120342 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cd7914-9fb6-4ec5-90c4-337a69629067 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:06.236487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a2e61-d567-4249-89fe-2dcaf9b31630 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:06.236790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a2e61-d567-4249-89fe-2dcaf9b31630 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:06.237154 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a2e61-d567-4249-89fe-2dcaf9b31630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:06.258864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 893/1758] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:06 2022] PUT /identity/v3/projects/9aa90ce982b94089bb8b52b12ca250ac/users/2521d29b71804d738c00c5edbdce2842/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:06.361276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-f65a2e61-d567-4249-89fe-2dcaf9b31630 None None] MFA Rules not processed for user `2521d29b71804d738c00c5edbdce2842`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:06.362631 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f65a2e61-d567-4249-89fe-2dcaf9b31630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:06.479282 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd7914-9fb6-4ec5-90c4-337a69629067 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:06.481401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f9cd7914-9fb6-4ec5-90c4-337a69629067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:06.584818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 866/1759] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:06.589733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a2e61-d567-4249-89fe-2dcaf9b31630 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:06.684286 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd7914-9fb6-4ec5-90c4-337a69629067 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:06.717557 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13596987-7b55-43d2-b870-7db710f6ac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:06.721411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13596987-7b55-43d2-b870-7db710f6ac09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:06.721992 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13596987-7b55-43d2-b870-7db710f6ac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:06.722615 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13596987-7b55-43d2-b870-7db710f6ac09 admin admin] PATH_INFO: `/v3/projects/18f79c70396e436d9e665f04b0834150` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:06.724713 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13596987-7b55-43d2-b870-7db710f6ac09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18f79c70396e436d9e665f04b0834150)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:06.730114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13596987-7b55-43d2-b870-7db710f6ac09 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:06.796678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a2e61-d567-4249-89fe-2dcaf9b31630 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:06.803349 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c8fb3-99f1-43df-96b5-8478f8d91831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:06.804732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c8fb3-99f1-43df-96b5-8478f8d91831 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:06.805826 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c8fb3-99f1-43df-96b5-8478f8d91831 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:06.806536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c8fb3-99f1-43df-96b5-8478f8d91831 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:06.807425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c8fb3-99f1-43df-96b5-8478f8d91831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:06.810780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c8fb3-99f1-43df-96b5-8478f8d91831 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:06.872179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-13596987-7b55-43d2-b870-7db710f6ac09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18f79c70396e436d9e665f04b0834150', 'request_id': 'req-13596987-7b55-43d2-b870-7db710f6ac09'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:06.885654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-13596987-7b55-43d2-b870-7db710f6ac09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18f79c70396e436d9e665f04b0834150', 'request_id': 'req-13596987-7b55-43d2-b870-7db710f6ac09'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:06.940738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 867/1760] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:06 2022] POST /identity/v3/projects => generated 363 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:06.942028 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c8fb3-99f1-43df-96b5-8478f8d91831 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:06.942562 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-13596987-7b55-43d2-b870-7db710f6ac09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18f79c70396e436d9e665f04b0834150', 'request_id': 'req-13596987-7b55-43d2-b870-7db710f6ac09'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:07.074203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-13596987-7b55-43d2-b870-7db710f6ac09 admin admin] The token cache is being invalidate because project 18f79c70396e436d9e665f04b0834150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:07.074203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-13596987-7b55-43d2-b870-7db710f6ac09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:07.077240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-13596987-7b55-43d2-b870-7db710f6ac09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:07.106446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 894/1761] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:06 2022] DELETE /identity/v3/projects/18f79c70396e436d9e665f04b0834150 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:07.113669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13596987-7b55-43d2-b870-7db710f6ac09 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:07.127379 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-13596987-7b55-43d2-b870-7db710f6ac09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:07.242730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c8fb3-99f1-43df-96b5-8478f8d91831 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:07.290979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e334bd4-85cb-4732-a88a-429c12639dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:07.293631 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e334bd4-85cb-4732-a88a-429c12639dec admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:07.294053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e334bd4-85cb-4732-a88a-429c12639dec admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:07.297340 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e334bd4-85cb-4732-a88a-429c12639dec admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:07.297340 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e334bd4-85cb-4732-a88a-429c12639dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:07.305893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e334bd4-85cb-4732-a88a-429c12639dec admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:07.395810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13596987-7b55-43d2-b870-7db710f6ac09 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:07.433316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1924d-2772-4e8f-9011-fab9ddff1b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:07.434264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1924d-2772-4e8f-9011-fab9ddff1b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:07.435240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1924d-2772-4e8f-9011-fab9ddff1b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:07.435240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1924d-2772-4e8f-9011-fab9ddff1b75 admin admin] PATH_INFO: `/v3/users/37840fdb81174b3bac4505e05a633b00` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:07.439027 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 868/1762] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:06 2022] POST /identity/v3/users => generated 288 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:07.443894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e334bd4-85cb-4732-a88a-429c12639dec admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:07.444716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1924d-2772-4e8f-9011-fab9ddff1b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37840fdb81174b3bac4505e05a633b00)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:07.447358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1924d-2772-4e8f-9011-fab9ddff1b75 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:07.448238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2e334bd4-85cb-4732-a88a-429c12639dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:07.493577 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e334bd4-85cb-4732-a88a-429c12639dec admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:07.507322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839b271-95af-4c60-ac00-82ac156bdf89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:07.511497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839b271-95af-4c60-ac00-82ac156bdf89 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:07.511921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839b271-95af-4c60-ac00-82ac156bdf89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:07.512377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839b271-95af-4c60-ac00-82ac156bdf89 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:07.514572 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839b271-95af-4c60-ac00-82ac156bdf89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:07.517894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839b271-95af-4c60-ac00-82ac156bdf89 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:07.550822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:07.563502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 869/1763] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:07.566187 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839b271-95af-4c60-ac00-82ac156bdf89 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:07.598921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839b271-95af-4c60-ac00-82ac156bdf89 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:07.622373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb2fdc-1484-4005-8c03-293c13129773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:07.644533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb2fdc-1484-4005-8c03-293c13129773 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:07.644885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb2fdc-1484-4005-8c03-293c13129773 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:07.645431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb2fdc-1484-4005-8c03-293c13129773 admin admin] PATH_INFO: `/v3/projects/e8c5a96231894d36b268b042a4d005ab/users/ea44cf34090a48cc98394ea3cf1e0038/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:07.648405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:07.717752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b7b1924d-2772-4e8f-9011-fab9ddff1b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37840fdb81174b3bac4505e05a633b00'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:07.737548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb2fdc-1484-4005-8c03-293c13129773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c5a96231894d36b268b042a4d005ab, user_id=ea44cf34090a48cc98394ea3cf1e0038, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:07.740277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb2fdc-1484-4005-8c03-293c13129773 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:07.819938 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b7b1924d-2772-4e8f-9011-fab9ddff1b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37840fdb81174b3bac4505e05a633b00'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:07.821609 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b7b1924d-2772-4e8f-9011-fab9ddff1b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37840fdb81174b3bac4505e05a633b00'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:07.851134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b7b1924d-2772-4e8f-9011-fab9ddff1b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37840fdb81174b3bac4505e05a633b00'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:07.910601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 870/1764] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:07 2022] PUT /identity/v3/projects/e8c5a96231894d36b268b042a4d005ab/users/ea44cf34090a48cc98394ea3cf1e0038/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:07.914622 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b7b1924d-2772-4e8f-9011-fab9ddff1b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37840fdb81174b3bac4505e05a633b00'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:07.915952 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb2fdc-1484-4005-8c03-293c13129773 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:07.939986 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e7fb2fdc-1484-4005-8c03-293c13129773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:07.947874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 895/1765] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:07 2022] DELETE /identity/v3/users/37840fdb81174b3bac4505e05a633b00 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:08.353455 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb2fdc-1484-4005-8c03-293c13129773 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:08.515126 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce868b-5970-42a1-a5f8-df9177d3adcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:08.526830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce868b-5970-42a1-a5f8-df9177d3adcd admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:08.527123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce868b-5970-42a1-a5f8-df9177d3adcd admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:08.529973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce868b-5970-42a1-a5f8-df9177d3adcd admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:08.533378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce868b-5970-42a1-a5f8-df9177d3adcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:08.537610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce868b-5970-42a1-a5f8-df9177d3adcd admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:08.615533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 871/1766] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:07 2022] GET /identity/v3/roles => generated 1420 bytes in 699 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:00:08.617947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1924d-2772-4e8f-9011-fab9ddff1b75 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:08.645930 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1924d-2772-4e8f-9011-fab9ddff1b75 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:08.664879 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b8bbe-2af2-4426-a252-5aeeedd33052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:08.665819 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b8bbe-2af2-4426-a252-5aeeedd33052 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:08.670044 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b8bbe-2af2-4426-a252-5aeeedd33052 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:08.673272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b8bbe-2af2-4426-a252-5aeeedd33052 admin admin] PATH_INFO: `/v3/projects/e8c5a96231894d36b268b042a4d005ab/users/ea44cf34090a48cc98394ea3cf1e0038/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:08.680530 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b8bbe-2af2-4426-a252-5aeeedd33052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c5a96231894d36b268b042a4d005ab, user_id=ea44cf34090a48cc98394ea3cf1e0038, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:08.697897 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b8bbe-2af2-4426-a252-5aeeedd33052 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:08.716133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 896/1767] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:08 2022] PUT /identity/v3/projects/e8c5a96231894d36b268b042a4d005ab/users/ea44cf34090a48cc98394ea3cf1e0038/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:08.727798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686794f3-bedb-494e-b263-3c1284c92a86 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:08.728338 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686794f3-bedb-494e-b263-3c1284c92a86 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:08.728854 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686794f3-bedb-494e-b263-3c1284c92a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:08.785945 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-686794f3-bedb-494e-b263-3c1284c92a86 None None] MFA Rules not processed for user `ea44cf34090a48cc98394ea3cf1e0038`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:08.788333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-686794f3-bedb-494e-b263-3c1284c92a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:09.053175 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 872/1768] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:08 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:09.156040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b8bbe-2af2-4426-a252-5aeeedd33052 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:09.159005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-206b8bbe-2af2-4426-a252-5aeeedd33052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:09.336663 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b8bbe-2af2-4426-a252-5aeeedd33052 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:09.345034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b878df-47c6-4622-a0ae-ae640d403513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:09.346947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b878df-47c6-4622-a0ae-ae640d403513 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:09.347211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b878df-47c6-4622-a0ae-ae640d403513 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:09.349315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b878df-47c6-4622-a0ae-ae640d403513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:09.373180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686794f3-bedb-494e-b263-3c1284c92a86 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:09.374577 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-686794f3-bedb-494e-b263-3c1284c92a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:09.401636 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b878df-47c6-4622-a0ae-ae640d403513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:09.403187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b878df-47c6-4622-a0ae-ae640d403513 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:09.444499 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 897/1769] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:09 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:09.515333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686794f3-bedb-494e-b263-3c1284c92a86 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:09.520869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dd4e9-d451-4719-bde3-f8d9f66019fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:09.522594 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dd4e9-d451-4719-bde3-f8d9f66019fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:09.523050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dd4e9-d451-4719-bde3-f8d9f66019fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:09.523476 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dd4e9-d451-4719-bde3-f8d9f66019fe admin admin] PATH_INFO: `/v3/projects/120ff22b72f64c91b71dcab9741f7db2` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:09.525035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18dd4e9-d451-4719-bde3-f8d9f66019fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=120ff22b72f64c91b71dcab9741f7db2)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:09.528879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18dd4e9-d451-4719-bde3-f8d9f66019fe admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:09.699600 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c18dd4e9-d451-4719-bde3-f8d9f66019fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120ff22b72f64c91b71dcab9741f7db2', 'request_id': 'req-c18dd4e9-d451-4719-bde3-f8d9f66019fe'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:09.822851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c18dd4e9-d451-4719-bde3-f8d9f66019fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120ff22b72f64c91b71dcab9741f7db2', 'request_id': 'req-c18dd4e9-d451-4719-bde3-f8d9f66019fe'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:09.839383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c18dd4e9-d451-4719-bde3-f8d9f66019fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120ff22b72f64c91b71dcab9741f7db2', 'request_id': 'req-c18dd4e9-d451-4719-bde3-f8d9f66019fe'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:09.871217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c18dd4e9-d451-4719-bde3-f8d9f66019fe admin admin] The token cache is being invalidate because project 120ff22b72f64c91b71dcab9741f7db2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:09.871532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c18dd4e9-d451-4719-bde3-f8d9f66019fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:09.878812 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c18dd4e9-d451-4719-bde3-f8d9f66019fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:09.883760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 873/1770] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:09 2022] DELETE /identity/v3/projects/120ff22b72f64c91b71dcab9741f7db2 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:09.888923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca6c0a-a279-4b84-b8fc-8f50cfb8d4f4 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:09.890104 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca6c0a-a279-4b84-b8fc-8f50cfb8d4f4 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:09.890104 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca6c0a-a279-4b84-b8fc-8f50cfb8d4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:09.924802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dd4e9-d451-4719-bde3-f8d9f66019fe admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:09.934851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c18dd4e9-d451-4719-bde3-f8d9f66019fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:09.974539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:09.982256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-3bca6c0a-a279-4b84-b8fc-8f50cfb8d4f4 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:09.986946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-3bca6c0a-a279-4b84-b8fc-8f50cfb8d4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:10.186502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18dd4e9-d451-4719-bde3-f8d9f66019fe admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:10.205237 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59dbed-0279-4449-8c92-e39c2138d8d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:10.207074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59dbed-0279-4449-8c92-e39c2138d8d0 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:10.208067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59dbed-0279-4449-8c92-e39c2138d8d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:10.208509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59dbed-0279-4449-8c92-e39c2138d8d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:10.219005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-bd59dbed-0279-4449-8c92-e39c2138d8d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:10.338709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 898/1771] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:10.347100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df03df-eb43-433e-aa08-0e43f5415ed3 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:10.347522 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df03df-eb43-433e-aa08-0e43f5415ed3 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:10.349425 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df03df-eb43-433e-aa08-0e43f5415ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:10.447653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-25df03df-eb43-433e-aa08-0e43f5415ed3 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:10.466697 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-25df03df-eb43-433e-aa08-0e43f5415ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:10.493683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 899/1772] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:10.498574 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df03df-eb43-433e-aa08-0e43f5415ed3 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:10.539711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df03df-eb43-433e-aa08-0e43f5415ed3 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:10.546210 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8efd4-8c5f-4dd6-a1ff-78d1a4f06b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:10.547301 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8efd4-8c5f-4dd6-a1ff-78d1a4f06b70 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:10.548195 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8efd4-8c5f-4dd6-a1ff-78d1a4f06b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:10.549248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8efd4-8c5f-4dd6-a1ff-78d1a4f06b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:10.550384 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8efd4-8c5f-4dd6-a1ff-78d1a4f06b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:10.551069 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8efd4-8c5f-4dd6-a1ff-78d1a4f06b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:10.553029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8efd4-8c5f-4dd6-a1ff-78d1a4f06b70 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:10.573730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 900/1773] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:00:10.576400 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8efd4-8c5f-4dd6-a1ff-78d1a4f06b70 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:10.605530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59dbed-0279-4449-8c92-e39c2138d8d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:10.607077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59dbed-0279-4449-8c92-e39c2138d8d0 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:10.609162 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8efd4-8c5f-4dd6-a1ff-78d1a4f06b70 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:10.637883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c208e1-6c2e-4dda-9e4b-7388b96c7b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:10.638581 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c208e1-6c2e-4dda-9e4b-7388b96c7b35 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:10.643180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c208e1-6c2e-4dda-9e4b-7388b96c7b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:10.643639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c208e1-6c2e-4dda-9e4b-7388b96c7b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:10.644232 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c208e1-6c2e-4dda-9e4b-7388b96c7b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:10.666847 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 874/1774] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 745 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:10.668049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59dbed-0279-4449-8c92-e39c2138d8d0 service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:10.669869 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c208e1-6c2e-4dda-9e4b-7388b96c7b35 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:10.671807 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-bd59dbed-0279-4449-8c92-e39c2138d8d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:10.716783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59dbed-0279-4449-8c92-e39c2138d8d0 service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:10.726088 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cba7ac-9560-4f4a-82e2-ab33e42b956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:10.727076 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cba7ac-9560-4f4a-82e2-ab33e42b956a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:10.727447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cba7ac-9560-4f4a-82e2-ab33e42b956a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:10.727733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cba7ac-9560-4f4a-82e2-ab33e42b956a admin admin] PATH_INFO: `/v3/users/ad42ba6291f84bf6afa48576ae3c7c6a` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:10.730581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cba7ac-9560-4f4a-82e2-ab33e42b956a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad42ba6291f84bf6afa48576ae3c7c6a)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:10.732679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cba7ac-9560-4f4a-82e2-ab33e42b956a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:10.832956 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:10.852430 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 901/1775] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:10 2022] POST /identity/v3/projects => generated 369 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:10.859290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e38cc-fa58-425d-8175-9b95d1239b35 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:10.860854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e38cc-fa58-425d-8175-9b95d1239b35 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:10.861168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e38cc-fa58-425d-8175-9b95d1239b35 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:10.865330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 902/1776] 10.222.0.15 () {54 vars in 921 bytes} [Fri May 27 20:00:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 20:00:10.869035 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e38cc-fa58-425d-8175-9b95d1239b35 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:11.012459 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e38cc-fa58-425d-8175-9b95d1239b35 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:11.034986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107317d-7faf-41c6-8082-65ac139a4567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:11.037078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107317d-7faf-41c6-8082-65ac139a4567 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:11.038771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-32cba7ac-9560-4f4a-82e2-ab33e42b956a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad42ba6291f84bf6afa48576ae3c7c6a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:11.039895 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107317d-7faf-41c6-8082-65ac139a4567 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:11.041646 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107317d-7faf-41c6-8082-65ac139a4567 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:11.042746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107317d-7faf-41c6-8082-65ac139a4567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:11.043624 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-32cba7ac-9560-4f4a-82e2-ab33e42b956a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad42ba6291f84bf6afa48576ae3c7c6a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:11.051488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107317d-7faf-41c6-8082-65ac139a4567 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:11.126034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:11.155996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-32cba7ac-9560-4f4a-82e2-ab33e42b956a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad42ba6291f84bf6afa48576ae3c7c6a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:11.167885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 903/1777] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:10 2022] POST /identity/v3/users => generated 285 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:11.172458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c2575-856f-4d2d-a3a8-713992281d55 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:11.175908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c2575-856f-4d2d-a3a8-713992281d55 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:11.176357 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c2575-856f-4d2d-a3a8-713992281d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:11.190653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-32cba7ac-9560-4f4a-82e2-ab33e42b956a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad42ba6291f84bf6afa48576ae3c7c6a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:11.219084 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-32cba7ac-9560-4f4a-82e2-ab33e42b956a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad42ba6291f84bf6afa48576ae3c7c6a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:11.228302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-0d6c2575-856f-4d2d-a3a8-713992281d55 None None] MFA Rules not processed for user `105353b6b1a941ac81df7ad35567ba7c`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:11.229564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-0d6c2575-856f-4d2d-a3a8-713992281d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:11.239760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 875/1778] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:10 2022] DELETE /identity/v3/users/ad42ba6291f84bf6afa48576ae3c7c6a => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:11.241560 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cba7ac-9560-4f4a-82e2-ab33e42b956a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:11.247994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-32cba7ac-9560-4f4a-82e2-ab33e42b956a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:11.406049 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 904/1779] 10.222.0.15 () {58 vars in 1018 bytes} [Fri May 27 20:00:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:11.407675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a814a-3c85-4063-b3f0-93d1c7c71a02 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:11.408377 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a814a-3c85-4063-b3f0-93d1c7c71a02 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:11.408377 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a814a-3c85-4063-b3f0-93d1c7c71a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:11.489097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-626a814a-3c85-4063-b3f0-93d1c7c71a02 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:11.489714 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-626a814a-3c85-4063-b3f0-93d1c7c71a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:11.566130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cba7ac-9560-4f4a-82e2-ab33e42b956a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:11.618987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d9370-6158-4f12-9174-48adbd1d9c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:11.622167 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d9370-6158-4f12-9174-48adbd1d9c5a admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:11.623931 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d9370-6158-4f12-9174-48adbd1d9c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:11.624431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d9370-6158-4f12-9174-48adbd1d9c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:11.645617 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d9370-6158-4f12-9174-48adbd1d9c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:11.648292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 905/1780] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:11.649884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a814a-3c85-4063-b3f0-93d1c7c71a02 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:11.651414 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-626a814a-3c85-4063-b3f0-93d1c7c71a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:11.657830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d9370-6158-4f12-9174-48adbd1d9c5a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:11.672416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a814a-3c85-4063-b3f0-93d1c7c71a02 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:11.680699 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3f707-e8c1-4857-9a74-d804bb5f9524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:11.682076 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3f707-e8c1-4857-9a74-d804bb5f9524 service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:11.682467 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3f707-e8c1-4857-9a74-d804bb5f9524 service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:11.682811 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3f707-e8c1-4857-9a74-d804bb5f9524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:11.694278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3f707-e8c1-4857-9a74-d804bb5f9524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:11.697273 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3f707-e8c1-4857-9a74-d804bb5f9524 service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:11.712290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 906/1781] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:11.713223 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3f707-e8c1-4857-9a74-d804bb5f9524 service nova] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:11.715058 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-1ac3f707-e8c1-4857-9a74-d804bb5f9524 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:11.741010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 876/1782] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 499 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:11.742870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d9370-6158-4f12-9174-48adbd1d9c5a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:11.771792 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d9370-6158-4f12-9174-48adbd1d9c5a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:11.777123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:11.793070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12c5da-d9e3-441c-817e-32d72417a26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:11.794657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12c5da-d9e3-441c-817e-32d72417a26b admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:11.795164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12c5da-d9e3-441c-817e-32d72417a26b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:11.795634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12c5da-d9e3-441c-817e-32d72417a26b admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:11.796569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12c5da-d9e3-441c-817e-32d72417a26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:11.798809 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12c5da-d9e3-441c-817e-32d72417a26b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:11.809355 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3f707-e8c1-4857-9a74-d804bb5f9524 service nova] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:11.813769 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc597071-118e-4a0b-8cd6-9b66a62f36eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:11.814488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc597071-118e-4a0b-8cd6-9b66a62f36eb service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:11.814804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc597071-118e-4a0b-8cd6-9b66a62f36eb service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:11.814991 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 877/1783] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:11.815133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc597071-118e-4a0b-8cd6-9b66a62f36eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:11.819147 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12c5da-d9e3-441c-817e-32d72417a26b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:11.826722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc597071-118e-4a0b-8cd6-9b66a62f36eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:11.828636 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc597071-118e-4a0b-8cd6-9b66a62f36eb service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:11.833534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12c5da-d9e3-441c-817e-32d72417a26b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:11.840354 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b3d7d-219e-4661-a82e-4307da880495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:11.843079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b3d7d-219e-4661-a82e-4307da880495 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:11.843695 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b3d7d-219e-4661-a82e-4307da880495 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:11.844224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b3d7d-219e-4661-a82e-4307da880495 admin admin] PATH_INFO: `/v3/projects/dc1d79add7b746cd9e403d9f1ef80364/users/73a1dc9942fc4212bdbb43646698ca4c/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:11.893333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b3d7d-219e-4661-a82e-4307da880495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1d79add7b746cd9e403d9f1ef80364, user_id=73a1dc9942fc4212bdbb43646698ca4c, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:11.899085 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 907/1784] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:11.911183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b3d7d-219e-4661-a82e-4307da880495 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:12.036524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 878/1785] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:11 2022] PUT /identity/v3/projects/dc1d79add7b746cd9e403d9f1ef80364/users/73a1dc9942fc4212bdbb43646698ca4c/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:12.038152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc597071-118e-4a0b-8cd6-9b66a62f36eb service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:12.042509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-cc597071-118e-4a0b-8cd6-9b66a62f36eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:12.055144 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df92f4-15b1-4fae-8e6e-70859ed58478 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:12.057836 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df92f4-15b1-4fae-8e6e-70859ed58478 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:12.058318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df92f4-15b1-4fae-8e6e-70859ed58478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:12.138204 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-37df92f4-15b1-4fae-8e6e-70859ed58478 None None] MFA Rules not processed for user `73a1dc9942fc4212bdbb43646698ca4c`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:12.139697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-37df92f4-15b1-4fae-8e6e-70859ed58478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:12.215174 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc597071-118e-4a0b-8cd6-9b66a62f36eb service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:12.330938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 879/1786] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:12.334762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb6330-da24-41c4-875e-7e57bbc4e0cf None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:12.335049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb6330-da24-41c4-875e-7e57bbc4e0cf None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:12.335337 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb6330-da24-41c4-875e-7e57bbc4e0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:12.369861 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083c6d1-6524-4950-a58a-c4fca7454704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:12.372242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083c6d1-6524-4950-a58a-c4fca7454704 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:12.377255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083c6d1-6524-4950-a58a-c4fca7454704 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:12.377255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083c6d1-6524-4950-a58a-c4fca7454704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:12.379502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-6dcb6330-da24-41c4-875e-7e57bbc4e0cf None None] MFA Rules not processed for user `e3667bac6fe34a0bb29cdf7c9fc556f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:12.380392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d083c6d1-6524-4950-a58a-c4fca7454704 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:12.385137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-6dcb6330-da24-41c4-875e-7e57bbc4e0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:12.506051 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 880/1787] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:12.506051 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb6330-da24-41c4-875e-7e57bbc4e0cf None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:12.512288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083c6d1-6524-4950-a58a-c4fca7454704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:12.513993 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083c6d1-6524-4950-a58a-c4fca7454704 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:12.582375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:12.594312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 908/1788] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:12.818607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb6330-da24-41c4-875e-7e57bbc4e0cf None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:12.845744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c963bd8-667b-4738-b9c1-fe44e6072f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:12.846898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c963bd8-667b-4738-b9c1-fe44e6072f74 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:12.847420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c963bd8-667b-4738-b9c1-fe44e6072f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:12.847863 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c963bd8-667b-4738-b9c1-fe44e6072f74 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:12.848882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c963bd8-667b-4738-b9c1-fe44e6072f74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:12.851124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c963bd8-667b-4738-b9c1-fe44e6072f74 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:12.950213 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:12.967848 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083c6d1-6524-4950-a58a-c4fca7454704 service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:12.968709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 881/1789] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:12 2022] POST /identity/v3/projects => generated 369 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:12.997134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083c6d1-6524-4950-a58a-c4fca7454704 service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:13.202111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd171ad-92c8-4bbf-bf0a-e985f9a7da3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:13.202915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd171ad-92c8-4bbf-bf0a-e985f9a7da3d admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:13.204319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd171ad-92c8-4bbf-bf0a-e985f9a7da3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:13.204836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd171ad-92c8-4bbf-bf0a-e985f9a7da3d admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:13.206692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd171ad-92c8-4bbf-bf0a-e985f9a7da3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:13.212243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd171ad-92c8-4bbf-bf0a-e985f9a7da3d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:13.345687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 909/1790] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:12 2022] POST /identity/v3/users => generated 291 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:13.348961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c963bd8-667b-4738-b9c1-fe44e6072f74 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:13.367625 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c963bd8-667b-4738-b9c1-fe44e6072f74 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:13.378485 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49169bd-c5b7-4e1b-b627-be88ae490283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:13.379281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49169bd-c5b7-4e1b-b627-be88ae490283 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:13.390646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49169bd-c5b7-4e1b-b627-be88ae490283 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:13.392324 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49169bd-c5b7-4e1b-b627-be88ae490283 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:13.394140 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49169bd-c5b7-4e1b-b627-be88ae490283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:13.398232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49169bd-c5b7-4e1b-b627-be88ae490283 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:13.436591 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 882/1791] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:13.447195 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd171ad-92c8-4bbf-bf0a-e985f9a7da3d admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:13.515204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd171ad-92c8-4bbf-bf0a-e985f9a7da3d admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:13.541191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0e7c3-d9ca-45b4-84ac-450058a00c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:13.542176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0e7c3-d9ca-45b4-84ac-450058a00c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:13.542675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0e7c3-d9ca-45b4-84ac-450058a00c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:13.543027 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0e7c3-d9ca-45b4-84ac-450058a00c0f admin admin] PATH_INFO: `/v3/projects/0282fe1b0cec4b6bb99b608e0e0adabb/users/82687997bc8f407b82f1025d89e0e0cc/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:13.594502 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0e7c3-d9ca-45b4-84ac-450058a00c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0282fe1b0cec4b6bb99b608e0e0adabb, user_id=82687997bc8f407b82f1025d89e0e0cc, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:13.598029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0e7c3-d9ca-45b4-84ac-450058a00c0f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:13.738571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 910/1792] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:13 2022] PUT /identity/v3/projects/0282fe1b0cec4b6bb99b608e0e0adabb/users/82687997bc8f407b82f1025d89e0e0cc/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:13.743252 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49169bd-c5b7-4e1b-b627-be88ae490283 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:13.758786 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49169bd-c5b7-4e1b-b627-be88ae490283 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:13.838169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4220bf-1cb8-4075-b575-4b51b483a730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:13.839181 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4220bf-1cb8-4075-b575-4b51b483a730 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:13.839714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4220bf-1cb8-4075-b575-4b51b483a730 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:13.840307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4220bf-1cb8-4075-b575-4b51b483a730 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:13.841191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4220bf-1cb8-4075-b575-4b51b483a730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:13.843674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4220bf-1cb8-4075-b575-4b51b483a730 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:13.856496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 883/1793] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:13 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:13.862395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0e7c3-d9ca-45b4-84ac-450058a00c0f admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:13.888966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0e7c3-d9ca-45b4-84ac-450058a00c0f admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:13.900322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafe7a0-2016-45e7-a0ed-8018582a0249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:13.903014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafe7a0-2016-45e7-a0ed-8018582a0249 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:13.903014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafe7a0-2016-45e7-a0ed-8018582a0249 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:13.903014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafe7a0-2016-45e7-a0ed-8018582a0249 admin admin] PATH_INFO: `/v3/projects/0282fe1b0cec4b6bb99b608e0e0adabb/users/82687997bc8f407b82f1025d89e0e0cc/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:13.904924 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafe7a0-2016-45e7-a0ed-8018582a0249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0282fe1b0cec4b6bb99b608e0e0adabb, user_id=82687997bc8f407b82f1025d89e0e0cc, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:13.908297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafe7a0-2016-45e7-a0ed-8018582a0249 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:13.928021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 911/1794] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:13 2022] PUT /identity/v3/projects/0282fe1b0cec4b6bb99b608e0e0adabb/users/82687997bc8f407b82f1025d89e0e0cc/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:13.939538 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f39d-57ea-49bb-938f-d1e4d4aa7a4f None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:13.940206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f39d-57ea-49bb-938f-d1e4d4aa7a4f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:13.940714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f39d-57ea-49bb-938f-d1e4d4aa7a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:13.997461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-bdb3f39d-57ea-49bb-938f-d1e4d4aa7a4f None None] MFA Rules not processed for user `82687997bc8f407b82f1025d89e0e0cc`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:13.999075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-bdb3f39d-57ea-49bb-938f-d1e4d4aa7a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:14.183048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:14.198796 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 884/1795] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:14.212061 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafe7a0-2016-45e7-a0ed-8018582a0249 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:14.214215 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4bafe7a0-2016-45e7-a0ed-8018582a0249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:14.356895 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafe7a0-2016-45e7-a0ed-8018582a0249 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:14.361423 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a83ff0-9af4-4de1-b358-6349c0a5da30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:14.362389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a83ff0-9af4-4de1-b358-6349c0a5da30 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:14.362878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a83ff0-9af4-4de1-b358-6349c0a5da30 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:14.363447 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a83ff0-9af4-4de1-b358-6349c0a5da30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:14.378598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a83ff0-9af4-4de1-b358-6349c0a5da30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:14.380319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a83ff0-9af4-4de1-b358-6349c0a5da30 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:14.413178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 912/1796] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:14 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:00:14.426960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3f39d-57ea-49bb-938f-d1e4d4aa7a4f None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:14.429545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-bdb3f39d-57ea-49bb-938f-d1e4d4aa7a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:14.692225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3f39d-57ea-49bb-938f-d1e4d4aa7a4f None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:14.698822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd5ad4-e767-45db-bf9a-269e1a73070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:14.699837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd5ad4-e767-45db-bf9a-269e1a73070f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:14.700226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd5ad4-e767-45db-bf9a-269e1a73070f admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:14.700568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd5ad4-e767-45db-bf9a-269e1a73070f admin admin] PATH_INFO: `/v3/projects/8c3bae0ba1bd47f7868e5ab56f5c8201` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:14.711743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd5ad4-e767-45db-bf9a-269e1a73070f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3bae0ba1bd47f7868e5ab56f5c8201)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:14.714541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd5ad4-e767-45db-bf9a-269e1a73070f admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:14.897358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-27dd5ad4-e767-45db-bf9a-269e1a73070f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3bae0ba1bd47f7868e5ab56f5c8201', 'request_id': 'req-27dd5ad4-e767-45db-bf9a-269e1a73070f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:15.031153 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-27dd5ad4-e767-45db-bf9a-269e1a73070f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3bae0ba1bd47f7868e5ab56f5c8201', 'request_id': 'req-27dd5ad4-e767-45db-bf9a-269e1a73070f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:15.038951 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-27dd5ad4-e767-45db-bf9a-269e1a73070f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3bae0ba1bd47f7868e5ab56f5c8201', 'request_id': 'req-27dd5ad4-e767-45db-bf9a-269e1a73070f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:15.075522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-27dd5ad4-e767-45db-bf9a-269e1a73070f admin admin] The token cache is being invalidate because project 8c3bae0ba1bd47f7868e5ab56f5c8201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:15.075835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-27dd5ad4-e767-45db-bf9a-269e1a73070f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:15.082410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-27dd5ad4-e767-45db-bf9a-269e1a73070f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:15.086693 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 885/1797] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:14 2022] DELETE /identity/v3/projects/8c3bae0ba1bd47f7868e5ab56f5c8201 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:15.090574 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a83ff0-9af4-4de1-b358-6349c0a5da30 service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:15.106236 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a83ff0-9af4-4de1-b358-6349c0a5da30 service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:15.243429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369af36-2994-46a2-ac70-002a237c6bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:15.249518 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369af36-2994-46a2-ac70-002a237c6bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:15.250420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369af36-2994-46a2-ac70-002a237c6bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:15.251015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369af36-2994-46a2-ac70-002a237c6bdb admin admin] PATH_INFO: `/v3/users/d5d6abe2222740b2bd0bb6b2454f87f5` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:15.253871 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369af36-2994-46a2-ac70-002a237c6bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d6abe2222740b2bd0bb6b2454f87f5)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:15.256510 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369af36-2994-46a2-ac70-002a237c6bdb admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:15.265625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:15.413740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:15.600514 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7369af36-2994-46a2-ac70-002a237c6bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d6abe2222740b2bd0bb6b2454f87f5'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:15.749129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7369af36-2994-46a2-ac70-002a237c6bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d6abe2222740b2bd0bb6b2454f87f5'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:15.750774 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7369af36-2994-46a2-ac70-002a237c6bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d6abe2222740b2bd0bb6b2454f87f5'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:15.781950 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7369af36-2994-46a2-ac70-002a237c6bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d6abe2222740b2bd0bb6b2454f87f5'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:15.804860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7369af36-2994-46a2-ac70-002a237c6bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d6abe2222740b2bd0bb6b2454f87f5'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:15.815911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 913/1798] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:15 2022] DELETE /identity/v3/users/d5d6abe2222740b2bd0bb6b2454f87f5 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:16.689666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a95b4-67bb-4c1f-9d22-2c554dcf9596 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:16.691606 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a95b4-67bb-4c1f-9d22-2c554dcf9596 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:16.692216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a95b4-67bb-4c1f-9d22-2c554dcf9596 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:16.696043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 886/1799] 10.222.0.15 () {54 vars in 921 bytes} [Fri May 27 20:00:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 20:00:16.779186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924e38d-23c7-4af7-b73d-487704e42564 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:16.781160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924e38d-23c7-4af7-b73d-487704e42564 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:16.781745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924e38d-23c7-4af7-b73d-487704e42564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:16.858500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-7924e38d-23c7-4af7-b73d-487704e42564 None None] MFA Rules not processed for user `105353b6b1a941ac81df7ad35567ba7c`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:16.861452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-7924e38d-23c7-4af7-b73d-487704e42564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:16.871754 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:17.089789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 914/1800] 10.222.0.15 () {58 vars in 1018 bytes} [Fri May 27 20:00:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:17.131651 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a95b4-67bb-4c1f-9d22-2c554dcf9596 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:17.135801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-3f8a95b4-67bb-4c1f-9d22-2c554dcf9596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:17.219481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a95b4-67bb-4c1f-9d22-2c554dcf9596 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:17.230444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a5f53-71ec-4b90-bfc7-5dce292351a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:17.231069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a5f53-71ec-4b90-bfc7-5dce292351a5 service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:17.231360 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a5f53-71ec-4b90-bfc7-5dce292351a5 service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:17.231643 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a5f53-71ec-4b90-bfc7-5dce292351a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:17.258640 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a5f53-71ec-4b90-bfc7-5dce292351a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:17.261140 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a5f53-71ec-4b90-bfc7-5dce292351a5 service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:17.302770 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 887/1801] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:17.385318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:18.386088 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924e38d-23c7-4af7-b73d-487704e42564 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:18.388282 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-7924e38d-23c7-4af7-b73d-487704e42564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:18.582302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924e38d-23c7-4af7-b73d-487704e42564 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:18.599004 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb520786-19a8-44cb-b27b-66d2dd91814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:18.600066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb520786-19a8-44cb-b27b-66d2dd91814f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:18.600340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb520786-19a8-44cb-b27b-66d2dd91814f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:18.600818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb520786-19a8-44cb-b27b-66d2dd91814f admin admin] PATH_INFO: `/v3/projects/b6c187101dce43d2b801cacd53600904` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:18.603362 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb520786-19a8-44cb-b27b-66d2dd91814f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c187101dce43d2b801cacd53600904)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:18.616728 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb520786-19a8-44cb-b27b-66d2dd91814f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:18.827982 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fb520786-19a8-44cb-b27b-66d2dd91814f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c187101dce43d2b801cacd53600904', 'request_id': 'req-fb520786-19a8-44cb-b27b-66d2dd91814f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:18.837542 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fb520786-19a8-44cb-b27b-66d2dd91814f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c187101dce43d2b801cacd53600904', 'request_id': 'req-fb520786-19a8-44cb-b27b-66d2dd91814f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:18.846126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fb520786-19a8-44cb-b27b-66d2dd91814f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c187101dce43d2b801cacd53600904', 'request_id': 'req-fb520786-19a8-44cb-b27b-66d2dd91814f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:18.977115 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fb520786-19a8-44cb-b27b-66d2dd91814f admin admin] The token cache is being invalidate because project b6c187101dce43d2b801cacd53600904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:18.977440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fb520786-19a8-44cb-b27b-66d2dd91814f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:18.978452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fb520786-19a8-44cb-b27b-66d2dd91814f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:18.983074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 915/1802] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:18 2022] DELETE /identity/v3/projects/b6c187101dce43d2b801cacd53600904 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:18.984713 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c20b27-69c9-42f4-9ba9-f9ce4d5bfd6c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:18.985242 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c20b27-69c9-42f4-9ba9-f9ce4d5bfd6c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:18.985324 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c20b27-69c9-42f4-9ba9-f9ce4d5bfd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:19.015605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-f5c20b27-69c9-42f4-9ba9-f9ce4d5bfd6c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:19.017065 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f5c20b27-69c9-42f4-9ba9-f9ce4d5bfd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:19.107119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 888/1803] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:19.109302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b021e-6f1d-4824-b3ea-23a17d021bfd None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:19.112762 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b021e-6f1d-4824-b3ea-23a17d021bfd None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:19.112762 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b021e-6f1d-4824-b3ea-23a17d021bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:19.185789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-b32b021e-6f1d-4824-b3ea-23a17d021bfd None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:19.187139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b32b021e-6f1d-4824-b3ea-23a17d021bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:19.208529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 916/1804] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:19.212690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c20b27-69c9-42f4-9ba9-f9ce4d5bfd6c None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:19.226631 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c20b27-69c9-42f4-9ba9-f9ce4d5bfd6c None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:19.232793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358e368-5b15-4fa7-8997-e15b90a8516e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:19.238283 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358e368-5b15-4fa7-8997-e15b90a8516e admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:19.238283 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358e368-5b15-4fa7-8997-e15b90a8516e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:19.238283 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358e368-5b15-4fa7-8997-e15b90a8516e admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:19.238283 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358e368-5b15-4fa7-8997-e15b90a8516e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:19.238283 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358e368-5b15-4fa7-8997-e15b90a8516e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:19.238283 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358e368-5b15-4fa7-8997-e15b90a8516e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:19.275546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b021e-6f1d-4824-b3ea-23a17d021bfd None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:19.290467 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 889/1805] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:00:19.291080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b021e-6f1d-4824-b3ea-23a17d021bfd None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:19.310102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9cf7d-47f6-4571-8dbc-39ac24ddab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:19.311827 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9cf7d-47f6-4571-8dbc-39ac24ddab6c admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:19.312927 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9cf7d-47f6-4571-8dbc-39ac24ddab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:19.313234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9cf7d-47f6-4571-8dbc-39ac24ddab6c admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:19.315096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9cf7d-47f6-4571-8dbc-39ac24ddab6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:19.326558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9cf7d-47f6-4571-8dbc-39ac24ddab6c admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:19.492560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 917/1806] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:19 2022] POST /identity/v3/projects => generated 355 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:00:19.493205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358e368-5b15-4fa7-8997-e15b90a8516e admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:19.514747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358e368-5b15-4fa7-8997-e15b90a8516e admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:19.601633 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b00b3-6246-42b4-9820-9156c0be5a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:19.602463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b00b3-6246-42b4-9820-9156c0be5a7f admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:19.602826 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b00b3-6246-42b4-9820-9156c0be5a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:19.603299 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b00b3-6246-42b4-9820-9156c0be5a7f admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:19.604106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b00b3-6246-42b4-9820-9156c0be5a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:19.606272 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b00b3-6246-42b4-9820-9156c0be5a7f admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:19.731668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 890/1807] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:19 2022] POST /identity/v3/users => generated 278 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:00:19.738313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9cf7d-47f6-4571-8dbc-39ac24ddab6c admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:19.754531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9cf7d-47f6-4571-8dbc-39ac24ddab6c admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:19.763873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ba621-0963-4ba2-82c0-49836ad9bd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:19.763873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ba621-0963-4ba2-82c0-49836ad9bd05 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:19.763873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ba621-0963-4ba2-82c0-49836ad9bd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:19.764661 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ba621-0963-4ba2-82c0-49836ad9bd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:19.765768 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ba621-0963-4ba2-82c0-49836ad9bd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:19.767877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ba621-0963-4ba2-82c0-49836ad9bd05 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:19.793286 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 918/1808] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:19.801220 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b00b3-6246-42b4-9820-9156c0be5a7f admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:19.811303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b00b3-6246-42b4-9820-9156c0be5a7f admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:19.817066 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758099be-cb1d-4ec1-82c8-5daacdf79c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:19.817931 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758099be-cb1d-4ec1-82c8-5daacdf79c0a admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:19.818224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758099be-cb1d-4ec1-82c8-5daacdf79c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:19.818564 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758099be-cb1d-4ec1-82c8-5daacdf79c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:19.819629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758099be-cb1d-4ec1-82c8-5daacdf79c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:19.821751 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758099be-cb1d-4ec1-82c8-5daacdf79c0a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:19.836505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 891/1809] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:19.845436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ba621-0963-4ba2-82c0-49836ad9bd05 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:19.856892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ba621-0963-4ba2-82c0-49836ad9bd05 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:19.861528 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcc212-9af6-4f0e-899b-c3bc6bb6adcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:19.862511 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcc212-9af6-4f0e-899b-c3bc6bb6adcf admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:19.863115 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcc212-9af6-4f0e-899b-c3bc6bb6adcf admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:19.863553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcc212-9af6-4f0e-899b-c3bc6bb6adcf admin admin] PATH_INFO: `/v3/projects/50302481979e40a597945973b1e01835/users/387d44d2bf164072897de8a791bf7af1/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:19.865461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:19.887668 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcc212-9af6-4f0e-899b-c3bc6bb6adcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=50302481979e40a597945973b1e01835, user_id=387d44d2bf164072897de8a791bf7af1, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:19.891749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcc212-9af6-4f0e-899b-c3bc6bb6adcf admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:19.980300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 919/1810] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:19 2022] PUT /identity/v3/projects/50302481979e40a597945973b1e01835/users/387d44d2bf164072897de8a791bf7af1/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:19.984677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3702b-ddf6-484e-9278-3a3fa752ccbb None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:19.984989 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3702b-ddf6-484e-9278-3a3fa752ccbb None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:19.985570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3702b-ddf6-484e-9278-3a3fa752ccbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:20.024473 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-03f3702b-ddf6-484e-9278-3a3fa752ccbb None None] MFA Rules not processed for user `387d44d2bf164072897de8a791bf7af1`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:20.025788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-03f3702b-ddf6-484e-9278-3a3fa752ccbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:20.101444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 892/1811] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:19 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:20.109603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcc212-9af6-4f0e-899b-c3bc6bb6adcf admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:20.111422 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3702b-ddf6-484e-9278-3a3fa752ccbb None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:20.111553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-6fdcc212-9af6-4f0e-899b-c3bc6bb6adcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:20.181091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcc212-9af6-4f0e-899b-c3bc6bb6adcf admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:20.187160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20452a-80c2-41eb-b4ce-3432c83bc7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:20.188044 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20452a-80c2-41eb-b4ce-3432c83bc7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:20.188378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20452a-80c2-41eb-b4ce-3432c83bc7be admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:20.188613 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20452a-80c2-41eb-b4ce-3432c83bc7be admin admin] PATH_INFO: `/v3/users/3ed0e963abdf4faa923d3601bbbb2336` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:20.189273 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3702b-ddf6-484e-9278-3a3fa752ccbb None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:20.189838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20452a-80c2-41eb-b4ce-3432c83bc7be admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed0e963abdf4faa923d3601bbbb2336)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:20.191818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20452a-80c2-41eb-b4ce-3432c83bc7be admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:20.194018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fa4de-5300-407b-8cc9-2562e9b2a045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:20.194793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fa4de-5300-407b-8cc9-2562e9b2a045 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:20.195080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fa4de-5300-407b-8cc9-2562e9b2a045 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:20.195368 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318fa4de-5300-407b-8cc9-2562e9b2a045 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:20.196069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fa4de-5300-407b-8cc9-2562e9b2a045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:20.197998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318fa4de-5300-407b-8cc9-2562e9b2a045 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:20.281784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:20.292491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 893/1812] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:20 2022] POST /identity/v3/projects => generated 357 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:00:20.296697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fa4de-5300-407b-8cc9-2562e9b2a045 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:20.387711 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318fa4de-5300-407b-8cc9-2562e9b2a045 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:20.387711 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048350ee-0d81-468e-8137-73b65e23fe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:20.387711 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048350ee-0d81-468e-8137-73b65e23fe86 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:20.387711 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048350ee-0d81-468e-8137-73b65e23fe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:20.388127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048350ee-0d81-468e-8137-73b65e23fe86 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:20.388897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048350ee-0d81-468e-8137-73b65e23fe86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:20.390941 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048350ee-0d81-468e-8137-73b65e23fe86 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:20.419096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4e20452a-80c2-41eb-b4ce-3432c83bc7be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed0e963abdf4faa923d3601bbbb2336'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:20.466382 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 894/1813] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:20 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:20.470042 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048350ee-0d81-468e-8137-73b65e23fe86 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:20.483546 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048350ee-0d81-468e-8137-73b65e23fe86 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:20.487131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4e20452a-80c2-41eb-b4ce-3432c83bc7be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed0e963abdf4faa923d3601bbbb2336'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:20.487965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4e20452a-80c2-41eb-b4ce-3432c83bc7be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed0e963abdf4faa923d3601bbbb2336'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:20.489206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8eec7-2709-461c-8bae-3cca3b2edfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:20.490017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8eec7-2709-461c-8bae-3cca3b2edfdd admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:20.490307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8eec7-2709-461c-8bae-3cca3b2edfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:20.490655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8eec7-2709-461c-8bae-3cca3b2edfdd admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:20.491384 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8eec7-2709-461c-8bae-3cca3b2edfdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:20.494175 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8eec7-2709-461c-8bae-3cca3b2edfdd admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:20.496324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4e20452a-80c2-41eb-b4ce-3432c83bc7be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed0e963abdf4faa923d3601bbbb2336'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:20.504552 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 895/1814] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:20.509716 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8eec7-2709-461c-8bae-3cca3b2edfdd admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:20.509961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4e20452a-80c2-41eb-b4ce-3432c83bc7be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed0e963abdf4faa923d3601bbbb2336'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:20.511402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-48e8eec7-2709-461c-8bae-3cca3b2edfdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:20.516288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 920/1815] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:20 2022] DELETE /identity/v3/users/3ed0e963abdf4faa923d3601bbbb2336 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:20.520566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28415b7-2d68-4c9b-8537-81571bb67d8a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:20.520862 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28415b7-2d68-4c9b-8537-81571bb67d8a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:20.521147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28415b7-2d68-4c9b-8537-81571bb67d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:20.525404 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8eec7-2709-461c-8bae-3cca3b2edfdd admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:20.539022 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c28415b7-2d68-4c9b-8537-81571bb67d8a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:20.540224 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c28415b7-2d68-4c9b-8537-81571bb67d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:20.591210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a551b9-aa01-4e2e-8fff-ee48e8e8b3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:20.594842 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a551b9-aa01-4e2e-8fff-ee48e8e8b3af admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:20.594842 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a551b9-aa01-4e2e-8fff-ee48e8e8b3af admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:20.594842 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a551b9-aa01-4e2e-8fff-ee48e8e8b3af admin admin] PATH_INFO: `/v3/projects/209049e64e2640c6afcff0807fbfd146/users/3b078e3631cf49f8b3672cd796163ae0/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:20.608846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a551b9-aa01-4e2e-8fff-ee48e8e8b3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=209049e64e2640c6afcff0807fbfd146, user_id=3b078e3631cf49f8b3672cd796163ae0, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:20.611727 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a551b9-aa01-4e2e-8fff-ee48e8e8b3af admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:20.627877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 921/1816] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:20.628907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28415b7-2d68-4c9b-8537-81571bb67d8a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:20.630247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c28415b7-2d68-4c9b-8537-81571bb67d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:20.642774 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28415b7-2d68-4c9b-8537-81571bb67d8a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:20.648171 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd53784-4eb6-4ed1-a155-80a03aca3054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:20.652696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd53784-4eb6-4ed1-a155-80a03aca3054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:20.652696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd53784-4eb6-4ed1-a155-80a03aca3054 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:20.652696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd53784-4eb6-4ed1-a155-80a03aca3054 admin admin] PATH_INFO: `/v3/users/73a1dc9942fc4212bdbb43646698ca4c` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:20.652696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd53784-4eb6-4ed1-a155-80a03aca3054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a1dc9942fc4212bdbb43646698ca4c)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:20.653498 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd53784-4eb6-4ed1-a155-80a03aca3054 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:20.705085 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 896/1817] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:20 2022] PUT /identity/v3/projects/209049e64e2640c6afcff0807fbfd146/users/3b078e3631cf49f8b3672cd796163ae0/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:00:20.706008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a551b9-aa01-4e2e-8fff-ee48e8e8b3af admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:20.711035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-01a551b9-aa01-4e2e-8fff-ee48e8e8b3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:20.768817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a551b9-aa01-4e2e-8fff-ee48e8e8b3af admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:20.772666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79e4e6-4ced-47f4-a2f2-1d2ebcd97226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:20.773421 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79e4e6-4ced-47f4-a2f2-1d2ebcd97226 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:20.773715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79e4e6-4ced-47f4-a2f2-1d2ebcd97226 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:20.773993 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79e4e6-4ced-47f4-a2f2-1d2ebcd97226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:20.842900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79e4e6-4ced-47f4-a2f2-1d2ebcd97226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:20.844393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79e4e6-4ced-47f4-a2f2-1d2ebcd97226 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:20.855431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 897/1818] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:20.856358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79e4e6-4ced-47f4-a2f2-1d2ebcd97226 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:20.865530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79e4e6-4ced-47f4-a2f2-1d2ebcd97226 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:20.871267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a9dcb-7a75-4de8-b409-45d0be514542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:20.871897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a9dcb-7a75-4de8-b409-45d0be514542 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:20.872139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a9dcb-7a75-4de8-b409-45d0be514542 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:20.872423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a9dcb-7a75-4de8-b409-45d0be514542 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:20.873206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a9dcb-7a75-4de8-b409-45d0be514542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:20.874861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a9dcb-7a75-4de8-b409-45d0be514542 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:20.890017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 898/1819] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:20.896002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a9dcb-7a75-4de8-b409-45d0be514542 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:20.905425 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9dd53784-4eb6-4ed1-a155-80a03aca3054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a1dc9942fc4212bdbb43646698ca4c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:20.906081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a9dcb-7a75-4de8-b409-45d0be514542 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:20.910801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e67c3-3a8e-4810-9cf0-da4c2fba3297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:20.911704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e67c3-3a8e-4810-9cf0-da4c2fba3297 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:20.911972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e67c3-3a8e-4810-9cf0-da4c2fba3297 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:20.912248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e67c3-3a8e-4810-9cf0-da4c2fba3297 admin admin] PATH_INFO: `/v3/projects/209049e64e2640c6afcff0807fbfd146/users/3b078e3631cf49f8b3672cd796163ae0/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:20.915793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e67c3-3a8e-4810-9cf0-da4c2fba3297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=209049e64e2640c6afcff0807fbfd146, user_id=3b078e3631cf49f8b3672cd796163ae0, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:20.918537 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e67c3-3a8e-4810-9cf0-da4c2fba3297 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:20.930315 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 899/1820] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:20 2022] PUT /identity/v3/projects/209049e64e2640c6afcff0807fbfd146/users/3b078e3631cf49f8b3672cd796163ae0/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:20.940243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c89d64-efea-48dc-a907-20079bcf8c57 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:20.940614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c89d64-efea-48dc-a907-20079bcf8c57 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:20.940901 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c89d64-efea-48dc-a907-20079bcf8c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:20.968682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-77c89d64-efea-48dc-a907-20079bcf8c57 None None] MFA Rules not processed for user `3b078e3631cf49f8b3672cd796163ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:20.969857 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-77c89d64-efea-48dc-a907-20079bcf8c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:20.979319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9dd53784-4eb6-4ed1-a155-80a03aca3054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a1dc9942fc4212bdbb43646698ca4c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:20.980655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9dd53784-4eb6-4ed1-a155-80a03aca3054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a1dc9942fc4212bdbb43646698ca4c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:20.992547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9dd53784-4eb6-4ed1-a155-80a03aca3054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a1dc9942fc4212bdbb43646698ca4c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:21.012498 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9dd53784-4eb6-4ed1-a155-80a03aca3054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a1dc9942fc4212bdbb43646698ca4c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:21.021590 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 922/1821] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:20 2022] DELETE /identity/v3/users/73a1dc9942fc4212bdbb43646698ca4c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:21.026654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029a6d7-b066-4c5e-acea-3f399718b15c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:21.026950 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029a6d7-b066-4c5e-acea-3f399718b15c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:21.027237 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029a6d7-b066-4c5e-acea-3f399718b15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:21.055496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 900/1822] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:20 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:21.063057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-6029a6d7-b066-4c5e-acea-3f399718b15c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:21.064374 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-6029a6d7-b066-4c5e-acea-3f399718b15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:21.067259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c89d64-efea-48dc-a907-20079bcf8c57 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:21.068860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-77c89d64-efea-48dc-a907-20079bcf8c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:21.178687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 923/1823] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:21.185429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c89d64-efea-48dc-a907-20079bcf8c57 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:21.219350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029a6d7-b066-4c5e-acea-3f399718b15c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:21.220745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-6029a6d7-b066-4c5e-acea-3f399718b15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:21.281981 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fa956-b10f-47e1-848d-f048d5544508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:21.285377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fa956-b10f-47e1-848d-f048d5544508 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:21.285377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fa956-b10f-47e1-848d-f048d5544508 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:21.285377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746fa956-b10f-47e1-848d-f048d5544508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:21.353286 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029a6d7-b066-4c5e-acea-3f399718b15c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:21.357777 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffcefe-9263-40e3-85e6-505de55da5b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:21.358567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffcefe-9263-40e3-85e6-505de55da5b9 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:21.359257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffcefe-9263-40e3-85e6-505de55da5b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:21.360310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffcefe-9263-40e3-85e6-505de55da5b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:21.372728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fa956-b10f-47e1-848d-f048d5544508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:21.372972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffcefe-9263-40e3-85e6-505de55da5b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:21.374509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746fa956-b10f-47e1-848d-f048d5544508 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:21.374891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffcefe-9263-40e3-85e6-505de55da5b9 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:21.389042 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 901/1824] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:21 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:00:21.407764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 924/1825] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:00:21.654798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fa956-b10f-47e1-848d-f048d5544508 service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:21.666579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746fa956-b10f-47e1-848d-f048d5544508 service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:21.675273 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03905c-4e57-4c72-9aea-0f29abcee561 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:21.676363 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03905c-4e57-4c72-9aea-0f29abcee561 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:21.676904 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03905c-4e57-4c72-9aea-0f29abcee561 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:21.677331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03905c-4e57-4c72-9aea-0f29abcee561 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:21.681877 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-fb03905c-4e57-4c72-9aea-0f29abcee561 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:21.789201 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03905c-4e57-4c72-9aea-0f29abcee561 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:21.789201 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb03905c-4e57-4c72-9aea-0f29abcee561 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:21.799665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 902/1826] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:21 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:00:21.837495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffcefe-9263-40e3-85e6-505de55da5b9 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:21.839004 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-71ffcefe-9263-40e3-85e6-505de55da5b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:21.859467 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffcefe-9263-40e3-85e6-505de55da5b9 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:21.865290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb7f3b-052e-4558-91e7-5e77fb936f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:21.867024 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb7f3b-052e-4558-91e7-5e77fb936f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:21.867471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb7f3b-052e-4558-91e7-5e77fb936f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:21.867938 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb7f3b-052e-4558-91e7-5e77fb936f1e admin admin] PATH_INFO: `/v3/users/2521d29b71804d738c00c5edbdce2842` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:21.873371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb7f3b-052e-4558-91e7-5e77fb936f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2521d29b71804d738c00c5edbdce2842)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:21.875680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb7f3b-052e-4558-91e7-5e77fb936f1e admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:21.923617 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03905c-4e57-4c72-9aea-0f29abcee561 service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:21.925774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-fb03905c-4e57-4c72-9aea-0f29abcee561 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:21.941465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03905c-4e57-4c72-9aea-0f29abcee561 service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:21.950630 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93e009-5c55-491a-8d09-5b41a651ae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:21.952357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93e009-5c55-491a-8d09-5b41a651ae6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:21.952661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93e009-5c55-491a-8d09-5b41a651ae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:21.952948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93e009-5c55-491a-8d09-5b41a651ae6d admin admin] PATH_INFO: `/v3/projects/f2756f2f2f364a8585fa454bcad3a145` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:21.954829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93e009-5c55-491a-8d09-5b41a651ae6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2756f2f2f364a8585fa454bcad3a145)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:21.957740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93e009-5c55-491a-8d09-5b41a651ae6d admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:22.076925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fadb7f3b-052e-4558-91e7-5e77fb936f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2521d29b71804d738c00c5edbdce2842'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.159193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-8a93e009-5c55-491a-8d09-5b41a651ae6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2756f2f2f364a8585fa454bcad3a145', 'request_id': 'req-8a93e009-5c55-491a-8d09-5b41a651ae6d'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.175042 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fadb7f3b-052e-4558-91e7-5e77fb936f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2521d29b71804d738c00c5edbdce2842'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.178829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fadb7f3b-052e-4558-91e7-5e77fb936f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2521d29b71804d738c00c5edbdce2842'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.187560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fadb7f3b-052e-4558-91e7-5e77fb936f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2521d29b71804d738c00c5edbdce2842'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.201732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:22.203077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fadb7f3b-052e-4558-91e7-5e77fb936f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2521d29b71804d738c00c5edbdce2842'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.212171 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 925/1827] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:21 2022] DELETE /identity/v3/users/2521d29b71804d738c00c5edbdce2842 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:22.213673 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0303142-887e-439d-ac28-7d643c2daa62 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:22.213968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0303142-887e-439d-ac28-7d643c2daa62 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:22.214252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0303142-887e-439d-ac28-7d643c2daa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:22.240817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e0303142-887e-439d-ac28-7d643c2daa62 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:22.240817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e0303142-887e-439d-ac28-7d643c2daa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:22.270940 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-8a93e009-5c55-491a-8d09-5b41a651ae6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2756f2f2f364a8585fa454bcad3a145', 'request_id': 'req-8a93e009-5c55-491a-8d09-5b41a651ae6d'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.284285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-8a93e009-5c55-491a-8d09-5b41a651ae6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2756f2f2f364a8585fa454bcad3a145', 'request_id': 'req-8a93e009-5c55-491a-8d09-5b41a651ae6d'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.321412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-8a93e009-5c55-491a-8d09-5b41a651ae6d admin admin] The token cache is being invalidate because project f2756f2f2f364a8585fa454bcad3a145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:22.321723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-8a93e009-5c55-491a-8d09-5b41a651ae6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.322799 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-8a93e009-5c55-491a-8d09-5b41a651ae6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.328399 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 903/1828] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:21 2022] DELETE /identity/v3/projects/f2756f2f2f364a8585fa454bcad3a145 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:22.332920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93e009-5c55-491a-8d09-5b41a651ae6d admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:22.336311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-8a93e009-5c55-491a-8d09-5b41a651ae6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:22.366585 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 926/1829] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:22.379382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0303142-887e-439d-ac28-7d643c2daa62 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:22.383375 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e0303142-887e-439d-ac28-7d643c2daa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:22.439634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93e009-5c55-491a-8d09-5b41a651ae6d admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:22.453834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1c586-6c82-4250-8306-c65893fc4f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:22.454819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1c586-6c82-4250-8306-c65893fc4f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:22.455100 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1c586-6c82-4250-8306-c65893fc4f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:22.455377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1c586-6c82-4250-8306-c65893fc4f51 admin admin] PATH_INFO: `/v3/users/94f27b2c1fa445cf89a79dce9f0a51d3` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:22.456604 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1c586-6c82-4250-8306-c65893fc4f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f27b2c1fa445cf89a79dce9f0a51d3)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:22.458830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1c586-6c82-4250-8306-c65893fc4f51 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:22.485190 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0303142-887e-439d-ac28-7d643c2daa62 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:22.489574 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07375a3-d648-4d38-9507-be1c7cae2a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:22.490319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07375a3-d648-4d38-9507-be1c7cae2a89 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:22.490681 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07375a3-d648-4d38-9507-be1c7cae2a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:22.491357 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07375a3-d648-4d38-9507-be1c7cae2a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:22.502052 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07375a3-d648-4d38-9507-be1c7cae2a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:22.503681 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07375a3-d648-4d38-9507-be1c7cae2a89 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:22.515411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 927/1830] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:00:22.593332 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07375a3-d648-4d38-9507-be1c7cae2a89 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:22.594888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c07375a3-d648-4d38-9507-be1c7cae2a89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:22.608453 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07375a3-d648-4d38-9507-be1c7cae2a89 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:22.613379 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671997f-1bfd-4980-897a-3b41fc07f298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:22.614251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671997f-1bfd-4980-897a-3b41fc07f298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:22.614576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671997f-1bfd-4980-897a-3b41fc07f298 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:22.614855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671997f-1bfd-4980-897a-3b41fc07f298 admin admin] PATH_INFO: `/v3/projects/dc1d79add7b746cd9e403d9f1ef80364` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:22.617185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671997f-1bfd-4980-897a-3b41fc07f298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1d79add7b746cd9e403d9f1ef80364)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:22.619181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671997f-1bfd-4980-897a-3b41fc07f298 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:22.704643 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-adf1c586-6c82-4250-8306-c65893fc4f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f27b2c1fa445cf89a79dce9f0a51d3'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.705407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-adf1c586-6c82-4250-8306-c65893fc4f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f27b2c1fa445cf89a79dce9f0a51d3'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.786715 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6671997f-1bfd-4980-897a-3b41fc07f298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1d79add7b746cd9e403d9f1ef80364', 'request_id': 'req-6671997f-1bfd-4980-897a-3b41fc07f298'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.796185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6671997f-1bfd-4980-897a-3b41fc07f298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1d79add7b746cd9e403d9f1ef80364', 'request_id': 'req-6671997f-1bfd-4980-897a-3b41fc07f298'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.797815 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:22.799636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-adf1c586-6c82-4250-8306-c65893fc4f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f27b2c1fa445cf89a79dce9f0a51d3'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.806530 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6671997f-1bfd-4980-897a-3b41fc07f298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1d79add7b746cd9e403d9f1ef80364', 'request_id': 'req-6671997f-1bfd-4980-897a-3b41fc07f298'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.824885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-adf1c586-6c82-4250-8306-c65893fc4f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f27b2c1fa445cf89a79dce9f0a51d3'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.833709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-adf1c586-6c82-4250-8306-c65893fc4f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f27b2c1fa445cf89a79dce9f0a51d3'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.848037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 904/1831] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:22 2022] DELETE /identity/v3/users/94f27b2c1fa445cf89a79dce9f0a51d3 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:22.915572 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6671997f-1bfd-4980-897a-3b41fc07f298 admin admin] The token cache is being invalidate because project dc1d79add7b746cd9e403d9f1ef80364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:22.916155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6671997f-1bfd-4980-897a-3b41fc07f298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.916584 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6671997f-1bfd-4980-897a-3b41fc07f298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:22.918257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 928/1832] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:22 2022] DELETE /identity/v3/projects/dc1d79add7b746cd9e403d9f1ef80364 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:00:22.922508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1c586-6c82-4250-8306-c65893fc4f51 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:22.923934 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-adf1c586-6c82-4250-8306-c65893fc4f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:22.999747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1c586-6c82-4250-8306-c65893fc4f51 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:23.009002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf9aef-cc85-49cb-afb6-069cacabbd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:23.012708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf9aef-cc85-49cb-afb6-069cacabbd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:23.018179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf9aef-cc85-49cb-afb6-069cacabbd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:23.018179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf9aef-cc85-49cb-afb6-069cacabbd34 admin admin] PATH_INFO: `/v3/users/82687997bc8f407b82f1025d89e0e0cc` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:23.018179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf9aef-cc85-49cb-afb6-069cacabbd34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82687997bc8f407b82f1025d89e0e0cc)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:23.018179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf9aef-cc85-49cb-afb6-069cacabbd34 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:23.122092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671997f-1bfd-4980-897a-3b41fc07f298 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:23.123561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-6671997f-1bfd-4980-897a-3b41fc07f298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:23.240575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671997f-1bfd-4980-897a-3b41fc07f298 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:23.251119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d33648-15b2-4932-b2b1-2a20cec56581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:23.252965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d33648-15b2-4932-b2b1-2a20cec56581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:23.291565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d33648-15b2-4932-b2b1-2a20cec56581 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:23.291565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d33648-15b2-4932-b2b1-2a20cec56581 admin admin] PATH_INFO: `/v3/projects/9aa90ce982b94089bb8b52b12ca250ac` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:23.291565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d33648-15b2-4932-b2b1-2a20cec56581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa90ce982b94089bb8b52b12ca250ac)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:23.291565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d33648-15b2-4932-b2b1-2a20cec56581 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:23.293273 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f5cf9aef-cc85-49cb-afb6-069cacabbd34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82687997bc8f407b82f1025d89e0e0cc'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:23.293745 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f5cf9aef-cc85-49cb-afb6-069cacabbd34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82687997bc8f407b82f1025d89e0e0cc'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.045457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f5cf9aef-cc85-49cb-afb6-069cacabbd34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82687997bc8f407b82f1025d89e0e0cc'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.063167 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f5cf9aef-cc85-49cb-afb6-069cacabbd34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82687997bc8f407b82f1025d89e0e0cc'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.064955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-68d33648-15b2-4932-b2b1-2a20cec56581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa90ce982b94089bb8b52b12ca250ac', 'request_id': 'req-68d33648-15b2-4932-b2b1-2a20cec56581'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.072365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-68d33648-15b2-4932-b2b1-2a20cec56581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa90ce982b94089bb8b52b12ca250ac', 'request_id': 'req-68d33648-15b2-4932-b2b1-2a20cec56581'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.075350 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f5cf9aef-cc85-49cb-afb6-069cacabbd34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82687997bc8f407b82f1025d89e0e0cc'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.082475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-68d33648-15b2-4932-b2b1-2a20cec56581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa90ce982b94089bb8b52b12ca250ac', 'request_id': 'req-68d33648-15b2-4932-b2b1-2a20cec56581'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.083369 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 905/1833] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:22 2022] DELETE /identity/v3/users/82687997bc8f407b82f1025d89e0e0cc => generated 0 bytes in 1161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:24.084440 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf9aef-cc85-49cb-afb6-069cacabbd34 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:24.086370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f5cf9aef-cc85-49cb-afb6-069cacabbd34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:24.166615 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf9aef-cc85-49cb-afb6-069cacabbd34 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:24.171898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee9148-997a-44ce-9aa3-336f427b4a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:24.173173 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee9148-997a-44ce-9aa3-336f427b4a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:24.174266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee9148-997a-44ce-9aa3-336f427b4a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:24.175177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee9148-997a-44ce-9aa3-336f427b4a08 admin admin] PATH_INFO: `/v3/projects/919dc474dea249e0863cb8cf66284eea` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:24.176603 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee9148-997a-44ce-9aa3-336f427b4a08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=919dc474dea249e0863cb8cf66284eea)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:24.179561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee9148-997a-44ce-9aa3-336f427b4a08 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:24.243235 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-68d33648-15b2-4932-b2b1-2a20cec56581 admin admin] The token cache is being invalidate because project 9aa90ce982b94089bb8b52b12ca250ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:24.243719 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-68d33648-15b2-4932-b2b1-2a20cec56581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.244737 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-68d33648-15b2-4932-b2b1-2a20cec56581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.248263 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 929/1834] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:23 2022] DELETE /identity/v3/projects/9aa90ce982b94089bb8b52b12ca250ac => generated 0 bytes in 1126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:00:24.252755 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d33648-15b2-4932-b2b1-2a20cec56581 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:24.255208 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-68d33648-15b2-4932-b2b1-2a20cec56581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:24.363490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6bee9148-997a-44ce-9aa3-336f427b4a08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919dc474dea249e0863cb8cf66284eea', 'request_id': 'req-6bee9148-997a-44ce-9aa3-336f427b4a08'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.403354 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d33648-15b2-4932-b2b1-2a20cec56581 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:24.472322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6bee9148-997a-44ce-9aa3-336f427b4a08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919dc474dea249e0863cb8cf66284eea', 'request_id': 'req-6bee9148-997a-44ce-9aa3-336f427b4a08'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.480193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6bee9148-997a-44ce-9aa3-336f427b4a08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919dc474dea249e0863cb8cf66284eea', 'request_id': 'req-6bee9148-997a-44ce-9aa3-336f427b4a08'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.490247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43606381-eab2-40d8-9c64-d9ae9ea20d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:24.491501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43606381-eab2-40d8-9c64-d9ae9ea20d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:24.491874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43606381-eab2-40d8-9c64-d9ae9ea20d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:24.495183 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43606381-eab2-40d8-9c64-d9ae9ea20d5c admin admin] PATH_INFO: `/v3/users/ea44cf34090a48cc98394ea3cf1e0038` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:24.495183 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43606381-eab2-40d8-9c64-d9ae9ea20d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea44cf34090a48cc98394ea3cf1e0038)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:24.498269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43606381-eab2-40d8-9c64-d9ae9ea20d5c admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:24.513392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6bee9148-997a-44ce-9aa3-336f427b4a08 admin admin] The token cache is being invalidate because project 919dc474dea249e0863cb8cf66284eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:24.513721 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6bee9148-997a-44ce-9aa3-336f427b4a08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.517595 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6bee9148-997a-44ce-9aa3-336f427b4a08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.519845 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 906/1835] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:24 2022] DELETE /identity/v3/projects/919dc474dea249e0863cb8cf66284eea => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:24.526376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee9148-997a-44ce-9aa3-336f427b4a08 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:24.530228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-6bee9148-997a-44ce-9aa3-336f427b4a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:24.567031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee9148-997a-44ce-9aa3-336f427b4a08 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:24.574720 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570ef8e-5545-416c-8990-115fe380bac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:24.582860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570ef8e-5545-416c-8990-115fe380bac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:24.583433 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570ef8e-5545-416c-8990-115fe380bac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:24.584121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570ef8e-5545-416c-8990-115fe380bac6 admin admin] PATH_INFO: `/v3/users/9975885df18946f8ab9cac75f9dbc767` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:24.585956 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570ef8e-5545-416c-8990-115fe380bac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9975885df18946f8ab9cac75f9dbc767)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:24.588930 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570ef8e-5545-416c-8990-115fe380bac6 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:24.859306 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-43606381-eab2-40d8-9c64-d9ae9ea20d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea44cf34090a48cc98394ea3cf1e0038'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.868911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f570ef8e-5545-416c-8990-115fe380bac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9975885df18946f8ab9cac75f9dbc767'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.869637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f570ef8e-5545-416c-8990-115fe380bac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9975885df18946f8ab9cac75f9dbc767'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.938844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-43606381-eab2-40d8-9c64-d9ae9ea20d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea44cf34090a48cc98394ea3cf1e0038'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.939722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-43606381-eab2-40d8-9c64-d9ae9ea20d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea44cf34090a48cc98394ea3cf1e0038'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.963327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-43606381-eab2-40d8-9c64-d9ae9ea20d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea44cf34090a48cc98394ea3cf1e0038'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.987978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-43606381-eab2-40d8-9c64-d9ae9ea20d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea44cf34090a48cc98394ea3cf1e0038'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:24.997941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 930/1836] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:24 2022] DELETE /identity/v3/users/ea44cf34090a48cc98394ea3cf1e0038 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:00:24.998588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43606381-eab2-40d8-9c64-d9ae9ea20d5c admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:24.999959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-43606381-eab2-40d8-9c64-d9ae9ea20d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:25.011735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f570ef8e-5545-416c-8990-115fe380bac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9975885df18946f8ab9cac75f9dbc767'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:25.035210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f570ef8e-5545-416c-8990-115fe380bac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9975885df18946f8ab9cac75f9dbc767'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:25.050912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f570ef8e-5545-416c-8990-115fe380bac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9975885df18946f8ab9cac75f9dbc767'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:25.062875 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 907/1837] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:24 2022] DELETE /identity/v3/users/9975885df18946f8ab9cac75f9dbc767 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:25.129489 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43606381-eab2-40d8-9c64-d9ae9ea20d5c admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:25.154378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:25.215266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af561eca-0ce0-457c-9625-9f9fade96083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:25.216692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af561eca-0ce0-457c-9625-9f9fade96083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:25.217189 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af561eca-0ce0-457c-9625-9f9fade96083 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:25.217450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af561eca-0ce0-457c-9625-9f9fade96083 admin admin] PATH_INFO: `/v3/projects/0282fe1b0cec4b6bb99b608e0e0adabb` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:25.219000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af561eca-0ce0-457c-9625-9f9fade96083 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0282fe1b0cec4b6bb99b608e0e0adabb)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:25.222193 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af561eca-0ce0-457c-9625-9f9fade96083 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:25.345311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-af561eca-0ce0-457c-9625-9f9fade96083 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0282fe1b0cec4b6bb99b608e0e0adabb', 'request_id': 'req-af561eca-0ce0-457c-9625-9f9fade96083'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:25.361992 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-af561eca-0ce0-457c-9625-9f9fade96083 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0282fe1b0cec4b6bb99b608e0e0adabb', 'request_id': 'req-af561eca-0ce0-457c-9625-9f9fade96083'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:25.369156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-af561eca-0ce0-457c-9625-9f9fade96083 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0282fe1b0cec4b6bb99b608e0e0adabb', 'request_id': 'req-af561eca-0ce0-457c-9625-9f9fade96083'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:25.442497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-af561eca-0ce0-457c-9625-9f9fade96083 admin admin] The token cache is being invalidate because project 0282fe1b0cec4b6bb99b608e0e0adabb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:25.443040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-af561eca-0ce0-457c-9625-9f9fade96083 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:25.445352 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-af561eca-0ce0-457c-9625-9f9fade96083 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:25.450440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 931/1838] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:24 2022] DELETE /identity/v3/projects/0282fe1b0cec4b6bb99b608e0e0adabb => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:25.452423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a4bcb-cb19-4e12-86df-53d55ffdb05c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:25.452864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a4bcb-cb19-4e12-86df-53d55ffdb05c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:25.453328 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a4bcb-cb19-4e12-86df-53d55ffdb05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:25.463034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:25.492479 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-d53a4bcb-cb19-4e12-86df-53d55ffdb05c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:25.493992 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d53a4bcb-cb19-4e12-86df-53d55ffdb05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:25.575113 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 908/1839] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:25.582978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dd950-c59f-41f8-b761-926caa5f58c1 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:25.583386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dd950-c59f-41f8-b761-926caa5f58c1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:25.583776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dd950-c59f-41f8-b761-926caa5f58c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:25.605540 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-d06dd950-c59f-41f8-b761-926caa5f58c1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:25.607465 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d06dd950-c59f-41f8-b761-926caa5f58c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:25.617292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 932/1840] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:25.623083 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a4bcb-cb19-4e12-86df-53d55ffdb05c None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:25.637125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a4bcb-cb19-4e12-86df-53d55ffdb05c None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:25.650580 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06dd950-c59f-41f8-b761-926caa5f58c1 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:25.654135 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d06dd950-c59f-41f8-b761-926caa5f58c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:25.655060 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b20428-4c1b-48cd-ac0c-7adb11eebc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:25.663840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b20428-4c1b-48cd-ac0c-7adb11eebc6c admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:25.663840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b20428-4c1b-48cd-ac0c-7adb11eebc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:25.663840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b20428-4c1b-48cd-ac0c-7adb11eebc6c admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:25.663840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b20428-4c1b-48cd-ac0c-7adb11eebc6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:25.663840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b20428-4c1b-48cd-ac0c-7adb11eebc6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:25.663840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b20428-4c1b-48cd-ac0c-7adb11eebc6c admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:25.681477 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06dd950-c59f-41f8-b761-926caa5f58c1 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:25.685616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 909/1841] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:00:25.692368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:25.693862 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:25.694919 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:25.695369 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4 admin admin] PATH_INFO: `/v3/projects/e8c5a96231894d36b268b042a4d005ab` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:25.698600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c5a96231894d36b268b042a4d005ab)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:25.700679 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:25.712080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b20428-4c1b-48cd-ac0c-7adb11eebc6c admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:25.731366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b20428-4c1b-48cd-ac0c-7adb11eebc6c admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:25.739994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c2ef6-5eaf-49e7-8024-d8df92c6f8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:25.740851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c2ef6-5eaf-49e7-8024-d8df92c6f8ae admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:25.741746 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c2ef6-5eaf-49e7-8024-d8df92c6f8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:25.742042 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c2ef6-5eaf-49e7-8024-d8df92c6f8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:25.742829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c2ef6-5eaf-49e7-8024-d8df92c6f8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:25.744955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c2ef6-5eaf-49e7-8024-d8df92c6f8ae admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:25.847801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 910/1842] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:25 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:25.852680 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c2ef6-5eaf-49e7-8024-d8df92c6f8ae admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:25.873061 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c5a96231894d36b268b042a4d005ab', 'request_id': 'req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:25.883676 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c5a96231894d36b268b042a4d005ab', 'request_id': 'req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:25.894881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c5a96231894d36b268b042a4d005ab', 'request_id': 'req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:25.978534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c2ef6-5eaf-49e7-8024-d8df92c6f8ae admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:25.989571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4 admin admin] The token cache is being invalidate because project e8c5a96231894d36b268b042a4d005ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:25.989885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:25.993323 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35089130-0598-470b-9c29-fea0faecab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:25.993725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:25.994187 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35089130-0598-470b-9c29-fea0faecab37 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:25.994510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35089130-0598-470b-9c29-fea0faecab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:25.994791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35089130-0598-470b-9c29-fea0faecab37 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:25.995493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35089130-0598-470b-9c29-fea0faecab37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:25.999804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 933/1843] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:25 2022] DELETE /identity/v3/projects/e8c5a96231894d36b268b042a4d005ab => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:25.999804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:26.000281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35089130-0598-470b-9c29-fea0faecab37 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:26.002551 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:26.098179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654cf0c-af36-4548-a4a5-dc5ebf9aa8c4 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:26.109537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb019d20-6bbd-4c47-821f-6cd2e836daaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:26.110557 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb019d20-6bbd-4c47-821f-6cd2e836daaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.110917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb019d20-6bbd-4c47-821f-6cd2e836daaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.112166 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb019d20-6bbd-4c47-821f-6cd2e836daaf admin admin] PATH_INFO: `/v3/projects/7ce0699e938b43ebb6d369dc3abdcbd3` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.114063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb019d20-6bbd-4c47-821f-6cd2e836daaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce0699e938b43ebb6d369dc3abdcbd3)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:26.116231 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb019d20-6bbd-4c47-821f-6cd2e836daaf admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:26.143099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 911/1844] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:25 2022] POST /identity/v3/users => generated 286 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:00:26.147602 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed28eb7-b07b-46c6-8e08-77127fd6f1c6 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.149285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed28eb7-b07b-46c6-8e08-77127fd6f1c6 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.149789 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed28eb7-b07b-46c6-8e08-77127fd6f1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.177820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-2ed28eb7-b07b-46c6-8e08-77127fd6f1c6 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:26.180131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2ed28eb7-b07b-46c6-8e08-77127fd6f1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:26.191352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 912/1845] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:26.192435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed28eb7-b07b-46c6-8e08-77127fd6f1c6 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:26.202302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2ed28eb7-b07b-46c6-8e08-77127fd6f1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:26.233918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed28eb7-b07b-46c6-8e08-77127fd6f1c6 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:26.245098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fb019d20-6bbd-4c47-821f-6cd2e836daaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce0699e938b43ebb6d369dc3abdcbd3', 'request_id': 'req-fb019d20-6bbd-4c47-821f-6cd2e836daaf'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:26.259043 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fb019d20-6bbd-4c47-821f-6cd2e836daaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce0699e938b43ebb6d369dc3abdcbd3', 'request_id': 'req-fb019d20-6bbd-4c47-821f-6cd2e836daaf'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:26.267159 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fb019d20-6bbd-4c47-821f-6cd2e836daaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce0699e938b43ebb6d369dc3abdcbd3', 'request_id': 'req-fb019d20-6bbd-4c47-821f-6cd2e836daaf'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:26.281799 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:26.323746 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf597b6-a92a-4442-bbbc-c03cb9365588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:26.324472 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf597b6-a92a-4442-bbbc-c03cb9365588 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.324724 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf597b6-a92a-4442-bbbc-c03cb9365588 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.325031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf597b6-a92a-4442-bbbc-c03cb9365588 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.325767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf597b6-a92a-4442-bbbc-c03cb9365588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:26.327444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf597b6-a92a-4442-bbbc-c03cb9365588 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:26.338578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 913/1846] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:26.340064 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cf065-7c8f-40ff-97de-ee4e18e9f981 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.340402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cf065-7c8f-40ff-97de-ee4e18e9f981 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.340685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cf065-7c8f-40ff-97de-ee4e18e9f981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.359437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-e26cf065-7c8f-40ff-97de-ee4e18e9f981 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:26.360654 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e26cf065-7c8f-40ff-97de-ee4e18e9f981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:26.372492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 914/1847] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:26.372492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cf065-7c8f-40ff-97de-ee4e18e9f981 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:26.382677 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fb019d20-6bbd-4c47-821f-6cd2e836daaf admin admin] The token cache is being invalidate because project 7ce0699e938b43ebb6d369dc3abdcbd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:26.385388 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fb019d20-6bbd-4c47-821f-6cd2e836daaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:26.385388 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fb019d20-6bbd-4c47-821f-6cd2e836daaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:26.385578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cf065-7c8f-40ff-97de-ee4e18e9f981 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:26.387377 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 934/1848] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:25 2022] DELETE /identity/v3/projects/7ce0699e938b43ebb6d369dc3abdcbd3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:26.388321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb019d20-6bbd-4c47-821f-6cd2e836daaf admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:26.389867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-fb019d20-6bbd-4c47-821f-6cd2e836daaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:26.395269 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2571252-ee95-4e0e-be01-3c68ff1951af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:26.396034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2571252-ee95-4e0e-be01-3c68ff1951af admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.396389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2571252-ee95-4e0e-be01-3c68ff1951af admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.396791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2571252-ee95-4e0e-be01-3c68ff1951af admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.398197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2571252-ee95-4e0e-be01-3c68ff1951af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:26.400918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2571252-ee95-4e0e-be01-3c68ff1951af admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:26.412025 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb019d20-6bbd-4c47-821f-6cd2e836daaf admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:26.418390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 915/1849] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:26.418390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5a39a-0d3d-4dc7-9376-9731c5aa79b4 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.418390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5a39a-0d3d-4dc7-9376-9731c5aa79b4 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.418390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5a39a-0d3d-4dc7-9376-9731c5aa79b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.422134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fc016-d9f6-4b2c-9783-772e74d28b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:26.423671 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fc016-d9f6-4b2c-9783-772e74d28b1c admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.424416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fc016-d9f6-4b2c-9783-772e74d28b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.424851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4fc016-d9f6-4b2c-9783-772e74d28b1c admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.425738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fc016-d9f6-4b2c-9783-772e74d28b1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:26.427577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fc016-d9f6-4b2c-9783-772e74d28b1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:26.430127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4fc016-d9f6-4b2c-9783-772e74d28b1c admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:26.444402 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 935/1850] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:00:26.445357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-21d5a39a-0d3d-4dc7-9376-9731c5aa79b4 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:26.445678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fc016-d9f6-4b2c-9783-772e74d28b1c admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:26.446849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-21d5a39a-0d3d-4dc7-9376-9731c5aa79b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:26.449746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ec4fc016-d9f6-4b2c-9783-772e74d28b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:26.466101 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 916/1851] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:26.467192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5a39a-0d3d-4dc7-9376-9731c5aa79b4 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:26.478049 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4fc016-d9f6-4b2c-9783-772e74d28b1c admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:26.478404 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5a39a-0d3d-4dc7-9376-9731c5aa79b4 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:26.483655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daafabf2-7e23-412e-a775-074a9834a560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:26.484192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af4892-d0e0-408e-afc8-91857bc24ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:26.484866 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af4892-d0e0-408e-afc8-91857bc24ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.484978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafabf2-7e23-412e-a775-074a9834a560 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.485212 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af4892-d0e0-408e-afc8-91857bc24ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.485463 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafabf2-7e23-412e-a775-074a9834a560 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.485568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af4892-d0e0-408e-afc8-91857bc24ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.485985 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daafabf2-7e23-412e-a775-074a9834a560 admin admin] PATH_INFO: `/v3/projects/9ecac54d80024eefbae3326bff0b24d6/users/2d60a6044bb64ac4bc747b0391e994a4/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.486249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af4892-d0e0-408e-afc8-91857bc24ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:26.488786 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af4892-d0e0-408e-afc8-91857bc24ec0 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:26.505556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafabf2-7e23-412e-a775-074a9834a560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ecac54d80024eefbae3326bff0b24d6, user_id=2d60a6044bb64ac4bc747b0391e994a4, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:26.508198 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daafabf2-7e23-412e-a775-074a9834a560 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:26.612311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 936/1852] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:26 2022] PUT /identity/v3/projects/9ecac54d80024eefbae3326bff0b24d6/users/2d60a6044bb64ac4bc747b0391e994a4/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:26.612311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133580c-8378-4a01-90d4-3e178887c0f5 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.612311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133580c-8378-4a01-90d4-3e178887c0f5 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.612311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133580c-8378-4a01-90d4-3e178887c0f5 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.612311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 937/1853] 10.222.0.15 () {54 vars in 921 bytes} [Fri May 27 20:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 20:00:26.612311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a669d-be27-43b2-ac81-b00a21607b99 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.612822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a669d-be27-43b2-ac81-b00a21607b99 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.612822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a669d-be27-43b2-ac81-b00a21607b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.615713 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 917/1854] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:26 2022] POST /identity/v3/projects => generated 361 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:26.617762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36405e10-502e-4dd6-a75f-09792c690463 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.618183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36405e10-502e-4dd6-a75f-09792c690463 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.618599 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36405e10-502e-4dd6-a75f-09792c690463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.632133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e01a669d-be27-43b2-ac81-b00a21607b99 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:26.633353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e01a669d-be27-43b2-ac81-b00a21607b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:26.650892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-36405e10-502e-4dd6-a75f-09792c690463 None None] MFA Rules not processed for user `2d60a6044bb64ac4bc747b0391e994a4`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:26.651962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-36405e10-502e-4dd6-a75f-09792c690463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:26.704302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 938/1855] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:26.704302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a669d-be27-43b2-ac81-b00a21607b99 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:26.716735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a669d-be27-43b2-ac81-b00a21607b99 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:26.717676 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:26.723300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ee5df-7b17-4b4b-884f-b0e29ca75f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:26.724085 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ee5df-7b17-4b4b-884f-b0e29ca75f4d admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.724540 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ee5df-7b17-4b4b-884f-b0e29ca75f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.725144 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ee5df-7b17-4b4b-884f-b0e29ca75f4d admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.725977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ee5df-7b17-4b4b-884f-b0e29ca75f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:26.728258 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ee5df-7b17-4b4b-884f-b0e29ca75f4d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:26.730518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 918/1856] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:26.731867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbd26c-1131-49f4-afe8-ec7650c092d1 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.732247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbd26c-1131-49f4-afe8-ec7650c092d1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.732559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacbd26c-1131-49f4-afe8-ec7650c092d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.755243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-cacbd26c-1131-49f4-afe8-ec7650c092d1 None None] MFA Rules not processed for user `105353b6b1a941ac81df7ad35567ba7c`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:26.757055 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cacbd26c-1131-49f4-afe8-ec7650c092d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:26.823201 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 919/1857] 10.222.0.15 () {58 vars in 1018 bytes} [Fri May 27 20:00:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:26.824050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbd26c-1131-49f4-afe8-ec7650c092d1 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:26.831936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 939/1858] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:26 2022] POST /identity/v3/users => generated 281 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:26.832892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ee5df-7b17-4b4b-884f-b0e29ca75f4d admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:26.834520 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-159ee5df-7b17-4b4b-884f-b0e29ca75f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:26.836442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacbd26c-1131-49f4-afe8-ec7650c092d1 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:26.841224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7181b0-4df5-43a9-aad6-e2fa1d4f0e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:26.841999 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7181b0-4df5-43a9-aad6-e2fa1d4f0e67 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.842376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7181b0-4df5-43a9-aad6-e2fa1d4f0e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.842731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7181b0-4df5-43a9-aad6-e2fa1d4f0e67 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.843536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7181b0-4df5-43a9-aad6-e2fa1d4f0e67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:26.843929 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7181b0-4df5-43a9-aad6-e2fa1d4f0e67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:26.845586 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7181b0-4df5-43a9-aad6-e2fa1d4f0e67 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:26.864733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 920/1859] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:00:26.864733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7181b0-4df5-43a9-aad6-e2fa1d4f0e67 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:26.872800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7181b0-4df5-43a9-aad6-e2fa1d4f0e67 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:26.878012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d01b22-345d-4b7b-a902-6394a28758db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:26.878717 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d01b22-345d-4b7b-a902-6394a28758db admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.879013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d01b22-345d-4b7b-a902-6394a28758db admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.879301 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d01b22-345d-4b7b-a902-6394a28758db admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.880061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d01b22-345d-4b7b-a902-6394a28758db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:26.882161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d01b22-345d-4b7b-a902-6394a28758db admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:26.893186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 921/1860] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:26.893872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d01b22-345d-4b7b-a902-6394a28758db admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:26.895560 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b2d01b22-345d-4b7b-a902-6394a28758db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:26.904272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ee5df-7b17-4b4b-884f-b0e29ca75f4d admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:26.908118 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81748b6c-53c2-46f9-8975-b425c391b6a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:26.908741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81748b6c-53c2-46f9-8975-b425c391b6a4 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.914511 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81748b6c-53c2-46f9-8975-b425c391b6a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.914511 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81748b6c-53c2-46f9-8975-b425c391b6a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.914673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d01b22-345d-4b7b-a902-6394a28758db admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:26.917883 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bec76-8c62-46ad-a35e-c382c9f2164d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:26.918569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bec76-8c62-46ad-a35e-c382c9f2164d service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.918854 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bec76-8c62-46ad-a35e-c382c9f2164d service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.919222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81748b6c-53c2-46f9-8975-b425c391b6a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:26.919314 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bec76-8c62-46ad-a35e-c382c9f2164d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.921014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81748b6c-53c2-46f9-8975-b425c391b6a4 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:26.929151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bec76-8c62-46ad-a35e-c382c9f2164d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:26.931155 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bec76-8c62-46ad-a35e-c382c9f2164d service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:26.931376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 940/1861] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:26.940651 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81748b6c-53c2-46f9-8975-b425c391b6a4 service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:26.953838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81748b6c-53c2-46f9-8975-b425c391b6a4 service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:26.959156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 922/1862] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:26.959156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bec76-8c62-46ad-a35e-c382c9f2164d service nova] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:26.960897 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876802ef-f931-457e-9f66-f4b01902e980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:26.961750 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876802ef-f931-457e-9f66-f4b01902e980 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.962308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876802ef-f931-457e-9f66-f4b01902e980 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.962786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876802ef-f931-457e-9f66-f4b01902e980 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.963619 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876802ef-f931-457e-9f66-f4b01902e980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:26.965921 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876802ef-f931-457e-9f66-f4b01902e980 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:26.970393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bec76-8c62-46ad-a35e-c382c9f2164d service nova] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:26.987155 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bfc9c-d5bf-4114-afeb-a93fca6e20f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:26.987977 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bfc9c-d5bf-4114-afeb-a93fca6e20f2 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:26.988262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bfc9c-d5bf-4114-afeb-a93fca6e20f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:26.988536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bfc9c-d5bf-4114-afeb-a93fca6e20f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:26.989268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548bfc9c-d5bf-4114-afeb-a93fca6e20f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:26.990900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548bfc9c-d5bf-4114-afeb-a93fca6e20f2 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:27.002492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 923/1863] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:27.003335 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bfc9c-d5bf-4114-afeb-a93fca6e20f2 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:27.015247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bfc9c-d5bf-4114-afeb-a93fca6e20f2 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:27.020085 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac848ad1-fc3c-42d4-89e5-dab99c1fb6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:27.020970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac848ad1-fc3c-42d4-89e5-dab99c1fb6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:27.021258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac848ad1-fc3c-42d4-89e5-dab99c1fb6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:27.021561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac848ad1-fc3c-42d4-89e5-dab99c1fb6e8 admin admin] PATH_INFO: `/v3/users/2d60a6044bb64ac4bc747b0391e994a4` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:27.023370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac848ad1-fc3c-42d4-89e5-dab99c1fb6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d60a6044bb64ac4bc747b0391e994a4)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:27.026156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac848ad1-fc3c-42d4-89e5-dab99c1fb6e8 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:27.072230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 941/1864] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:26 2022] POST /identity/v3/projects => generated 391 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:27.076522 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876802ef-f931-457e-9f66-f4b01902e980 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:27.151612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876802ef-f931-457e-9f66-f4b01902e980 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:27.156505 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a10da5-27c1-45d0-a4f4-bb22590b99fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:27.157344 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a10da5-27c1-45d0-a4f4-bb22590b99fc admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:27.157631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a10da5-27c1-45d0-a4f4-bb22590b99fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:27.157917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a10da5-27c1-45d0-a4f4-bb22590b99fc admin admin] PATH_INFO: `/v3/projects/019c55046c2f495496a3d8938863124e/users/271e954daa954cbd936d524281244ac4/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:27.174261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a10da5-27c1-45d0-a4f4-bb22590b99fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=019c55046c2f495496a3d8938863124e, user_id=271e954daa954cbd936d524281244ac4, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:27.177483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a10da5-27c1-45d0-a4f4-bb22590b99fc admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:27.301676 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ac848ad1-fc3c-42d4-89e5-dab99c1fb6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d60a6044bb64ac4bc747b0391e994a4'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:27.302605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ac848ad1-fc3c-42d4-89e5-dab99c1fb6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d60a6044bb64ac4bc747b0391e994a4'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:27.381046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 942/1865] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:27 2022] PUT /identity/v3/projects/019c55046c2f495496a3d8938863124e/users/271e954daa954cbd936d524281244ac4/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:27.381046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a10da5-27c1-45d0-a4f4-bb22590b99fc admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:27.390189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ac848ad1-fc3c-42d4-89e5-dab99c1fb6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d60a6044bb64ac4bc747b0391e994a4'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:27.409903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ac848ad1-fc3c-42d4-89e5-dab99c1fb6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d60a6044bb64ac4bc747b0391e994a4'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:27.422602 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ac848ad1-fc3c-42d4-89e5-dab99c1fb6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d60a6044bb64ac4bc747b0391e994a4'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:27.434316 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 924/1866] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:27 2022] DELETE /identity/v3/users/2d60a6044bb64ac4bc747b0391e994a4 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:27.438413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cf395-0c32-470b-8028-7dd5d61762a0 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:27.438413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cf395-0c32-470b-8028-7dd5d61762a0 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:27.438413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cf395-0c32-470b-8028-7dd5d61762a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:27.494163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a10da5-27c1-45d0-a4f4-bb22590b99fc admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:27.500372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-247cf395-0c32-470b-8028-7dd5d61762a0 None None] MFA Rules not processed for user `271e954daa954cbd936d524281244ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:27.504623 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-247cf395-0c32-470b-8028-7dd5d61762a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:27.590322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e6239-2e3b-453c-9522-53b74ad8cd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:27.591405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e6239-2e3b-453c-9522-53b74ad8cd86 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:27.592000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e6239-2e3b-453c-9522-53b74ad8cd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:27.592382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e6239-2e3b-453c-9522-53b74ad8cd86 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:27.593429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e6239-2e3b-453c-9522-53b74ad8cd86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:27.596363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e6239-2e3b-453c-9522-53b74ad8cd86 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:27.618365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 925/1867] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:27.618365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d491e7c-d96a-4a7e-9e8f-1f2dff3616af None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:27.618365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d491e7c-d96a-4a7e-9e8f-1f2dff3616af None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:27.618365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d491e7c-d96a-4a7e-9e8f-1f2dff3616af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:27.640510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-9d491e7c-d96a-4a7e-9e8f-1f2dff3616af None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:27.640510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9d491e7c-d96a-4a7e-9e8f-1f2dff3616af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:27.649479 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 926/1868] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:27.650306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d491e7c-d96a-4a7e-9e8f-1f2dff3616af None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:27.651629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9d491e7c-d96a-4a7e-9e8f-1f2dff3616af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:27.670420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d491e7c-d96a-4a7e-9e8f-1f2dff3616af None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:27.675029 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aa482-3658-41cb-babe-e5a641c92c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:27.675685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aa482-3658-41cb-babe-e5a641c92c21 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:27.675972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aa482-3658-41cb-babe-e5a641c92c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:27.676248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aa482-3658-41cb-babe-e5a641c92c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:27.676938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712aa482-3658-41cb-babe-e5a641c92c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:27.678897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712aa482-3658-41cb-babe-e5a641c92c21 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:27.694992 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 943/1869] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:27 2022] POST /identity/v3/users => generated 296 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:27.696217 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e6239-2e3b-453c-9522-53b74ad8cd86 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:27.698467 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-bf7e6239-2e3b-453c-9522-53b74ad8cd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:27.779325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e6239-2e3b-453c-9522-53b74ad8cd86 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:27.783329 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f0b7d-9581-4abf-a73f-75e3b5ba4a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:27.784054 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f0b7d-9581-4abf-a73f-75e3b5ba4a41 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:27.784409 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f0b7d-9581-4abf-a73f-75e3b5ba4a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:27.784754 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f0b7d-9581-4abf-a73f-75e3b5ba4a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:27.795071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f0b7d-9581-4abf-a73f-75e3b5ba4a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:27.796777 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8f0b7d-9581-4abf-a73f-75e3b5ba4a41 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:27.800808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 927/1870] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:27 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:27.800808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aa482-3658-41cb-babe-e5a641c92c21 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:27.802976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-712aa482-3658-41cb-babe-e5a641c92c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:27.809131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 944/1871] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:27.809970 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f0b7d-9581-4abf-a73f-75e3b5ba4a41 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:27.826955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f0b7d-9581-4abf-a73f-75e3b5ba4a41 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:27.916883 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aa482-3658-41cb-babe-e5a641c92c21 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:27.922163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589e3cc-d4a5-4199-97a7-0b63fb6561a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:27.922953 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589e3cc-d4a5-4199-97a7-0b63fb6561a6 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:27.923272 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589e3cc-d4a5-4199-97a7-0b63fb6561a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:27.924010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589e3cc-d4a5-4199-97a7-0b63fb6561a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:27.924541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589e3cc-d4a5-4199-97a7-0b63fb6561a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:27.926276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589e3cc-d4a5-4199-97a7-0b63fb6561a6 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:27.933972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8f1b-3a58-4e68-af51-715cfab7b543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:27.934738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8f1b-3a58-4e68-af51-715cfab7b543 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:27.935086 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8f1b-3a58-4e68-af51-715cfab7b543 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:27.935287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8f1b-3a58-4e68-af51-715cfab7b543 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:27.935989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d8f1b-3a58-4e68-af51-715cfab7b543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:27.937999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d8f1b-3a58-4e68-af51-715cfab7b543 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:27.941557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 928/1872] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:27.942916 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589e3cc-d4a5-4199-97a7-0b63fb6561a6 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:27.953480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589e3cc-d4a5-4199-97a7-0b63fb6561a6 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:27.958236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168af951-a984-44f5-8347-249f96a4aedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:27.958940 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168af951-a984-44f5-8347-249f96a4aedc admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:27.959223 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168af951-a984-44f5-8347-249f96a4aedc admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:27.959511 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168af951-a984-44f5-8347-249f96a4aedc admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:27.960790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168af951-a984-44f5-8347-249f96a4aedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:27.962442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168af951-a984-44f5-8347-249f96a4aedc admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:27.972310 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 929/1873] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:00:27.976881 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168af951-a984-44f5-8347-249f96a4aedc admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:27.986700 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168af951-a984-44f5-8347-249f96a4aedc admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:27.992190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38ae04-658a-456d-a992-dcb6d7cde187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:27.993102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38ae04-658a-456d-a992-dcb6d7cde187 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:27.993445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38ae04-658a-456d-a992-dcb6d7cde187 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:27.993726 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38ae04-658a-456d-a992-dcb6d7cde187 admin admin] PATH_INFO: `/v3/projects/b41ddd75eb6a471fa5310dd735fd2aea/users/ce140b4002e44c31a3eae07ddad547fd/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:28.008807 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38ae04-658a-456d-a992-dcb6d7cde187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41ddd75eb6a471fa5310dd735fd2aea, user_id=ce140b4002e44c31a3eae07ddad547fd, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:28.011489 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38ae04-658a-456d-a992-dcb6d7cde187 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:28.095685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 930/1874] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:27 2022] PUT /identity/v3/projects/b41ddd75eb6a471fa5310dd735fd2aea/users/ce140b4002e44c31a3eae07ddad547fd/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:00:28.110593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 945/1875] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:27 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:28.114426 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8f1b-3a58-4e68-af51-715cfab7b543 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:28.117167 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bf920-0948-4669-a287-1d14b3273925 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:28.117405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bf920-0948-4669-a287-1d14b3273925 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:28.118366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bf920-0948-4669-a287-1d14b3273925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:28.146270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8f1b-3a58-4e68-af51-715cfab7b543 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:28.170714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-166bf920-0948-4669-a287-1d14b3273925 None None] MFA Rules not processed for user `ce140b4002e44c31a3eae07ddad547fd`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:28.171919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-166bf920-0948-4669-a287-1d14b3273925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:28.283860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28aec02-8a10-4910-97da-508359316c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:28.284951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aec02-8a10-4910-97da-508359316c37 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:28.285412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aec02-8a10-4910-97da-508359316c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:28.285977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28aec02-8a10-4910-97da-508359316c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:28.287219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28aec02-8a10-4910-97da-508359316c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:28.290098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28aec02-8a10-4910-97da-508359316c37 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:28.305704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 946/1876] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:28.306645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28aec02-8a10-4910-97da-508359316c37 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:28.317844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28aec02-8a10-4910-97da-508359316c37 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:28.328634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea735bcb-844f-409b-ab81-59d83690c9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:28.329366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 931/1877] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:28.330362 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea735bcb-844f-409b-ab81-59d83690c9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:28.330727 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea735bcb-844f-409b-ab81-59d83690c9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:28.331078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea735bcb-844f-409b-ab81-59d83690c9ff admin admin] PATH_INFO: `/v3/projects/8e72156301bb49f9addbe51b63cf5fb4/users/fb27650cb6ec4ab7937513e46b642269/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:28.333654 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bf920-0948-4669-a287-1d14b3273925 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:28.347638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bf920-0948-4669-a287-1d14b3273925 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:28.361396 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb366591-a802-4a36-9b66-6efc913c1a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:28.361396 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb366591-a802-4a36-9b66-6efc913c1a64 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:28.361396 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb366591-a802-4a36-9b66-6efc913c1a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:28.361396 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb366591-a802-4a36-9b66-6efc913c1a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:28.362781 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb366591-a802-4a36-9b66-6efc913c1a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:28.362781 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb366591-a802-4a36-9b66-6efc913c1a64 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:28.383670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea735bcb-844f-409b-ab81-59d83690c9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e72156301bb49f9addbe51b63cf5fb4, user_id=fb27650cb6ec4ab7937513e46b642269, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:28.386377 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea735bcb-844f-409b-ab81-59d83690c9ff admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:28.516701 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 932/1878] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:28 2022] POST /identity/v3/projects => generated 393 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:28.518363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 947/1879] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:28 2022] PUT /identity/v3/projects/8e72156301bb49f9addbe51b63cf5fb4/users/fb27650cb6ec4ab7937513e46b642269/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:28.520591 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb366591-a802-4a36-9b66-6efc913c1a64 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:28.522000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea735bcb-844f-409b-ab81-59d83690c9ff admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:28.524006 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-eb366591-a802-4a36-9b66-6efc913c1a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:28.607973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb366591-a802-4a36-9b66-6efc913c1a64 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:28.614019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc3095-df15-4938-ab84-3c7eb35f807f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:28.615531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea735bcb-844f-409b-ab81-59d83690c9ff admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:28.621027 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19aeaf-e4b9-4d15-9557-60490dfb1d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:28.621802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19aeaf-e4b9-4d15-9557-60490dfb1d8b admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:28.622034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19aeaf-e4b9-4d15-9557-60490dfb1d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:28.622317 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19aeaf-e4b9-4d15-9557-60490dfb1d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:28.623104 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19aeaf-e4b9-4d15-9557-60490dfb1d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:28.623902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc3095-df15-4938-ab84-3c7eb35f807f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:28.624192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc3095-df15-4938-ab84-3c7eb35f807f admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:28.624476 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc3095-df15-4938-ab84-3c7eb35f807f admin admin] PATH_INFO: `/v3/projects/9ecac54d80024eefbae3326bff0b24d6` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:28.624694 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19aeaf-e4b9-4d15-9557-60490dfb1d8b admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:28.625735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc3095-df15-4938-ab84-3c7eb35f807f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ecac54d80024eefbae3326bff0b24d6)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:28.627917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc3095-df15-4938-ab84-3c7eb35f807f admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:28.636053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 948/1880] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:00:28.636780 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19aeaf-e4b9-4d15-9557-60490dfb1d8b admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:28.653117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19aeaf-e4b9-4d15-9557-60490dfb1d8b admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:28.658006 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd0603-0c3b-4b62-acac-76f730c81f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:28.658703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd0603-0c3b-4b62-acac-76f730c81f6c admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:28.658991 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd0603-0c3b-4b62-acac-76f730c81f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:28.659269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd0603-0c3b-4b62-acac-76f730c81f6c admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:28.659956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd0603-0c3b-4b62-acac-76f730c81f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:28.661877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd0603-0c3b-4b62-acac-76f730c81f6c admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:28.770755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cbdc3095-df15-4938-ab84-3c7eb35f807f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ecac54d80024eefbae3326bff0b24d6', 'request_id': 'req-cbdc3095-df15-4938-ab84-3c7eb35f807f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:28.791135 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 949/1881] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:28 2022] POST /identity/v3/users => generated 303 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:28.791135 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd0603-0c3b-4b62-acac-76f730c81f6c admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:28.799852 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd0603-0c3b-4b62-acac-76f730c81f6c admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:28.844362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cbdc3095-df15-4938-ab84-3c7eb35f807f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ecac54d80024eefbae3326bff0b24d6', 'request_id': 'req-cbdc3095-df15-4938-ab84-3c7eb35f807f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:28.851049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cbdc3095-df15-4938-ab84-3c7eb35f807f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ecac54d80024eefbae3326bff0b24d6', 'request_id': 'req-cbdc3095-df15-4938-ab84-3c7eb35f807f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:28.859883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cf9c8-7436-4a59-ab88-ab95c2971191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:28.859883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cf9c8-7436-4a59-ab88-ab95c2971191 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:28.859883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cf9c8-7436-4a59-ab88-ab95c2971191 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:28.859883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cf9c8-7436-4a59-ab88-ab95c2971191 admin admin] PATH_INFO: `/v3/projects/8e72156301bb49f9addbe51b63cf5fb4/users/fb27650cb6ec4ab7937513e46b642269/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:28.860984 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cf9c8-7436-4a59-ab88-ab95c2971191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e72156301bb49f9addbe51b63cf5fb4, user_id=fb27650cb6ec4ab7937513e46b642269, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:28.862556 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cbdc3095-df15-4938-ab84-3c7eb35f807f admin admin] The token cache is being invalidate because project 9ecac54d80024eefbae3326bff0b24d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:28.862844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cbdc3095-df15-4938-ab84-3c7eb35f807f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:28.863518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cbdc3095-df15-4938-ab84-3c7eb35f807f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:28.863707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cf9c8-7436-4a59-ab88-ab95c2971191 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:28.865076 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 933/1882] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:28 2022] DELETE /identity/v3/projects/9ecac54d80024eefbae3326bff0b24d6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:28.869917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc3095-df15-4938-ab84-3c7eb35f807f admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:28.871173 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cbdc3095-df15-4938-ab84-3c7eb35f807f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:28.874907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 950/1883] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:28 2022] PUT /identity/v3/projects/8e72156301bb49f9addbe51b63cf5fb4/users/fb27650cb6ec4ab7937513e46b642269/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:28.876155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411397e5-caca-4ea2-8076-9ebccce537a5 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:28.876709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411397e5-caca-4ea2-8076-9ebccce537a5 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:28.876993 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411397e5-caca-4ea2-8076-9ebccce537a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:28.893465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc3095-df15-4938-ab84-3c7eb35f807f admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:28.900006 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-411397e5-caca-4ea2-8076-9ebccce537a5 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:28.900006 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-411397e5-caca-4ea2-8076-9ebccce537a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:28.948965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23f543-2624-4790-b69b-4bdbbf241106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:28.949586 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23f543-2624-4790-b69b-4bdbbf241106 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:28.949871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23f543-2624-4790-b69b-4bdbbf241106 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:28.950150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23f543-2624-4790-b69b-4bdbbf241106 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:28.950914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23f543-2624-4790-b69b-4bdbbf241106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:28.952495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23f543-2624-4790-b69b-4bdbbf241106 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:28.955268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 951/1884] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:28.956561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7e710-c870-4872-beb2-ce3d73d687c9 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:28.958051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7e710-c870-4872-beb2-ce3d73d687c9 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:28.958051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7e710-c870-4872-beb2-ce3d73d687c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:28.963188 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 934/1885] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:28.964363 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2dc6d-d3d7-4a9c-8580-af4532366410 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:28.964645 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2dc6d-d3d7-4a9c-8580-af4532366410 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:28.964927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2dc6d-d3d7-4a9c-8580-af4532366410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:28.983160 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-31c2dc6d-d3d7-4a9c-8580-af4532366410 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:28.984421 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-31c2dc6d-d3d7-4a9c-8580-af4532366410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:28.987975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-64a7e710-c870-4872-beb2-ce3d73d687c9 None None] MFA Rules not processed for user `fb27650cb6ec4ab7937513e46b642269`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:28.991698 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-64a7e710-c870-4872-beb2-ce3d73d687c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:28.993170 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 935/1886] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:28.993954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2dc6d-d3d7-4a9c-8580-af4532366410 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:29.003633 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2dc6d-d3d7-4a9c-8580-af4532366410 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:29.008759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca555252-4bdd-47d3-8118-e94ae156f0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:29.009634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca555252-4bdd-47d3-8118-e94ae156f0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:29.009921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca555252-4bdd-47d3-8118-e94ae156f0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:29.010209 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca555252-4bdd-47d3-8118-e94ae156f0bf admin admin] PATH_INFO: `/v3/projects/95d5098fdfcc4c1ca306b64edba3de2c/users/af14cd6f89a84adc905a412d52298170/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:29.028474 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca555252-4bdd-47d3-8118-e94ae156f0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d5098fdfcc4c1ca306b64edba3de2c, user_id=af14cd6f89a84adc905a412d52298170, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:29.031242 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca555252-4bdd-47d3-8118-e94ae156f0bf admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:29.070489 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 952/1887] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:29.071493 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7e710-c870-4872-beb2-ce3d73d687c9 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:29.081507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7e710-c870-4872-beb2-ce3d73d687c9 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:29.087230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895d83-61af-45eb-b2a4-2373ca392ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:29.088004 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895d83-61af-45eb-b2a4-2373ca392ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:29.088185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895d83-61af-45eb-b2a4-2373ca392ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:29.088463 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895d83-61af-45eb-b2a4-2373ca392ab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:29.089276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a895d83-61af-45eb-b2a4-2373ca392ab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:29.089589 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a895d83-61af-45eb-b2a4-2373ca392ab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:29.091407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a895d83-61af-45eb-b2a4-2373ca392ab2 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:29.106243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 953/1888] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:00:29.106243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895d83-61af-45eb-b2a4-2373ca392ab2 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:29.114371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-1a895d83-61af-45eb-b2a4-2373ca392ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:29.114518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 936/1889] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:28 2022] PUT /identity/v3/projects/95d5098fdfcc4c1ca306b64edba3de2c/users/af14cd6f89a84adc905a412d52298170/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:29.114518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca555252-4bdd-47d3-8118-e94ae156f0bf admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:29.169559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895d83-61af-45eb-b2a4-2373ca392ab2 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:29.183819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca555252-4bdd-47d3-8118-e94ae156f0bf admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:29.189206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a68394-f662-4155-b191-16e3c3ee7eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:29.190260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a68394-f662-4155-b191-16e3c3ee7eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:29.190588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a68394-f662-4155-b191-16e3c3ee7eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:29.191177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a68394-f662-4155-b191-16e3c3ee7eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:29.191717 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a68394-f662-4155-b191-16e3c3ee7eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:29.193649 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a68394-f662-4155-b191-16e3c3ee7eb7 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:29.217988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebd186-ba6a-4c89-b79a-f884d37e193e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:29.218593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebd186-ba6a-4c89-b79a-f884d37e193e service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:29.218879 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebd186-ba6a-4c89-b79a-f884d37e193e service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:29.219162 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebd186-ba6a-4c89-b79a-f884d37e193e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:29.291745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebd186-ba6a-4c89-b79a-f884d37e193e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:29.293213 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebd186-ba6a-4c89-b79a-f884d37e193e service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:29.303454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 954/1890] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:29.304225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebd186-ba6a-4c89-b79a-f884d37e193e service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:29.316095 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebd186-ba6a-4c89-b79a-f884d37e193e service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:29.321627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 937/1891] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:29 2022] POST /identity/v3/projects => generated 359 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:29.322203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd77962-a985-4418-bd8a-ffb74791e8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:29.322917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd77962-a985-4418-bd8a-ffb74791e8ea admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:29.323197 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd77962-a985-4418-bd8a-ffb74791e8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:29.323476 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd77962-a985-4418-bd8a-ffb74791e8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:29.324220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd77962-a985-4418-bd8a-ffb74791e8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:29.326367 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd77962-a985-4418-bd8a-ffb74791e8ea admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:29.326494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a68394-f662-4155-b191-16e3c3ee7eb7 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:29.338375 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 955/1892] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:29.345057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd77962-a985-4418-bd8a-ffb74791e8ea admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:29.355520 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd77962-a985-4418-bd8a-ffb74791e8ea admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:29.403872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a68394-f662-4155-b191-16e3c3ee7eb7 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:29.409286 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a8339-7134-419d-bfe6-d3ff6706b276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:29.409975 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a8339-7134-419d-bfe6-d3ff6706b276 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:29.410267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a8339-7134-419d-bfe6-d3ff6706b276 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:29.410579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a8339-7134-419d-bfe6-d3ff6706b276 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:29.411441 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a8339-7134-419d-bfe6-d3ff6706b276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:29.414146 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a8339-7134-419d-bfe6-d3ff6706b276 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:29.430675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce91a2-3e0b-4a3d-af48-b60a1cd49ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:29.431586 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce91a2-3e0b-4a3d-af48-b60a1cd49ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:29.431871 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce91a2-3e0b-4a3d-af48-b60a1cd49ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:29.432153 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce91a2-3e0b-4a3d-af48-b60a1cd49ad8 admin admin] PATH_INFO: `/v3/projects/95d5098fdfcc4c1ca306b64edba3de2c/users/af14cd6f89a84adc905a412d52298170/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:29.434187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce91a2-3e0b-4a3d-af48-b60a1cd49ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95d5098fdfcc4c1ca306b64edba3de2c, user_id=af14cd6f89a84adc905a412d52298170, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:29.436900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce91a2-3e0b-4a3d-af48-b60a1cd49ad8 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:29.447351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 956/1893] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:29 2022] PUT /identity/v3/projects/95d5098fdfcc4c1ca306b64edba3de2c/users/af14cd6f89a84adc905a412d52298170/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:00:29.457530 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450b34e-5834-40be-ae73-6aaad7f3407b None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:29.457961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450b34e-5834-40be-ae73-6aaad7f3407b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:29.458246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450b34e-5834-40be-ae73-6aaad7f3407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:29.491986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-2450b34e-5834-40be-ae73-6aaad7f3407b None None] MFA Rules not processed for user `af14cd6f89a84adc905a412d52298170`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:29.493335 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2450b34e-5834-40be-ae73-6aaad7f3407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:29.543367 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:29.572753 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 957/1894] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:29.587525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450b34e-5834-40be-ae73-6aaad7f3407b None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:29.590009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2450b34e-5834-40be-ae73-6aaad7f3407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:29.590142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 938/1895] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:29 2022] POST /identity/v3/users => generated 280 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:29.600142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a8339-7134-419d-bfe6-d3ff6706b276 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:29.616147 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a8339-7134-419d-bfe6-d3ff6706b276 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:29.676582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450b34e-5834-40be-ae73-6aaad7f3407b None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:29.695269 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd655716-c0f0-444b-8ee1-83d2a645de83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:29.695438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f599df-52c7-430b-a07f-288b90eb8ba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:29.696016 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f599df-52c7-430b-a07f-288b90eb8ba4 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:29.696317 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd655716-c0f0-444b-8ee1-83d2a645de83 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:29.696572 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f599df-52c7-430b-a07f-288b90eb8ba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:29.696780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd655716-c0f0-444b-8ee1-83d2a645de83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:29.696894 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f599df-52c7-430b-a07f-288b90eb8ba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:29.697227 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd655716-c0f0-444b-8ee1-83d2a645de83 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:29.698652 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd655716-c0f0-444b-8ee1-83d2a645de83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:29.700473 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd655716-c0f0-444b-8ee1-83d2a645de83 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:29.716087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 939/1896] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:00:29.721944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd655716-c0f0-444b-8ee1-83d2a645de83 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:29.731922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f599df-52c7-430b-a07f-288b90eb8ba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:29.734801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f599df-52c7-430b-a07f-288b90eb8ba4 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:29.738860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd655716-c0f0-444b-8ee1-83d2a645de83 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:29.751753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed66c86-ef60-4d12-b56e-9569b3d84037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:29.752524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed66c86-ef60-4d12-b56e-9569b3d84037 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:29.753068 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed66c86-ef60-4d12-b56e-9569b3d84037 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:29.753430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed66c86-ef60-4d12-b56e-9569b3d84037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:29.757688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9ed66c86-ef60-4d12-b56e-9569b3d84037 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:29.761205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 958/1897] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:00:29.762778 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f599df-52c7-430b-a07f-288b90eb8ba4 service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:29.788571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f599df-52c7-430b-a07f-288b90eb8ba4 service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:29.801795 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79024519-f725-47ad-bc8f-9d6ee544c80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:29.802686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024519-f725-47ad-bc8f-9d6ee544c80e admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:29.803367 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024519-f725-47ad-bc8f-9d6ee544c80e admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:29.803495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79024519-f725-47ad-bc8f-9d6ee544c80e admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:29.804287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79024519-f725-47ad-bc8f-9d6ee544c80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:29.806796 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79024519-f725-47ad-bc8f-9d6ee544c80e admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:29.828108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 959/1898] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:29.830288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79024519-f725-47ad-bc8f-9d6ee544c80e admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:29.845300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79024519-f725-47ad-bc8f-9d6ee544c80e admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:29.849688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215debd9-693a-4dbf-b9ba-aae4dc15fabb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:29.850566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215debd9-693a-4dbf-b9ba-aae4dc15fabb service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:29.850921 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215debd9-693a-4dbf-b9ba-aae4dc15fabb service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:29.851578 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215debd9-693a-4dbf-b9ba-aae4dc15fabb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:29.855247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-215debd9-693a-4dbf-b9ba-aae4dc15fabb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:29.856774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed66c86-ef60-4d12-b56e-9569b3d84037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:29.860775 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed66c86-ef60-4d12-b56e-9569b3d84037 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:29.894787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 940/1899] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:29.895551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed66c86-ef60-4d12-b56e-9569b3d84037 service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:29.921920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed66c86-ef60-4d12-b56e-9569b3d84037 service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:29.936849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c7cfe-f07f-4d2e-8ee3-4082ed431f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:29.937872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c7cfe-f07f-4d2e-8ee3-4082ed431f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:29.938235 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c7cfe-f07f-4d2e-8ee3-4082ed431f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:29.938733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c7cfe-f07f-4d2e-8ee3-4082ed431f6e admin admin] PATH_INFO: `/v3/projects/cdd03a0104c1434e9ec178c7bd595f7f/users/fe5756aa638b4b29b3f041e4579e44be/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:29.972125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215debd9-693a-4dbf-b9ba-aae4dc15fabb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:29.974564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215debd9-693a-4dbf-b9ba-aae4dc15fabb service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:29.975378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c7cfe-f07f-4d2e-8ee3-4082ed431f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd03a0104c1434e9ec178c7bd595f7f, user_id=fe5756aa638b4b29b3f041e4579e44be, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:29.977319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:29.980393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c7cfe-f07f-4d2e-8ee3-4082ed431f6e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:29.986044 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 960/1900] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:30.088039 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 941/1901] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:29 2022] PUT /identity/v3/projects/cdd03a0104c1434e9ec178c7bd595f7f/users/fe5756aa638b4b29b3f041e4579e44be/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:30.098649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2924f-6845-4d14-addd-90f53ece51d3 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:30.099210 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2924f-6845-4d14-addd-90f53ece51d3 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:30.099681 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2924f-6845-4d14-addd-90f53ece51d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:30.132047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-d0b2924f-6845-4d14-addd-90f53ece51d3 None None] MFA Rules not processed for user `fe5756aa638b4b29b3f041e4579e44be`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:30.133606 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d0b2924f-6845-4d14-addd-90f53ece51d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:30.214037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 961/1902] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:30 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:30.523753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c7cfe-f07f-4d2e-8ee3-4082ed431f6e admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:30.621276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c7cfe-f07f-4d2e-8ee3-4082ed431f6e admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:30.625762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a516132-895d-4875-867c-b5de1dcbbb66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:30.626884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a516132-895d-4875-867c-b5de1dcbbb66 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:30.627243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a516132-895d-4875-867c-b5de1dcbbb66 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:30.627598 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a516132-895d-4875-867c-b5de1dcbbb66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:30.642459 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a516132-895d-4875-867c-b5de1dcbbb66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:30.644017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a516132-895d-4875-867c-b5de1dcbbb66 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:30.660058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 942/1903] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:30 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:30.686704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2924f-6845-4d14-addd-90f53ece51d3 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:30.803900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2924f-6845-4d14-addd-90f53ece51d3 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:30.819729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215a774-8135-4425-96cb-124c466d90f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:30.820990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215a774-8135-4425-96cb-124c466d90f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:30.821425 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215a774-8135-4425-96cb-124c466d90f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:30.824261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215a774-8135-4425-96cb-124c466d90f4 admin admin] PATH_INFO: `/v3/users/fe5756aa638b4b29b3f041e4579e44be` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:30.853050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215a774-8135-4425-96cb-124c466d90f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5756aa638b4b29b3f041e4579e44be)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:30.853050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215a774-8135-4425-96cb-124c466d90f4 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:31.156261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3215a774-8135-4425-96cb-124c466d90f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5756aa638b4b29b3f041e4579e44be'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:31.247009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3215a774-8135-4425-96cb-124c466d90f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5756aa638b4b29b3f041e4579e44be'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:31.247702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3215a774-8135-4425-96cb-124c466d90f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5756aa638b4b29b3f041e4579e44be'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:31.257689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3215a774-8135-4425-96cb-124c466d90f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5756aa638b4b29b3f041e4579e44be'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:31.270803 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3215a774-8135-4425-96cb-124c466d90f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5756aa638b4b29b3f041e4579e44be'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:31.277566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 962/1904] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:30 2022] DELETE /identity/v3/users/fe5756aa638b4b29b3f041e4579e44be => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:31.282138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cb2a9-3b93-4dc3-92e8-5110299700b4 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:31.282489 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cb2a9-3b93-4dc3-92e8-5110299700b4 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:31.282818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cb2a9-3b93-4dc3-92e8-5110299700b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:31.303151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-d78cb2a9-3b93-4dc3-92e8-5110299700b4 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:31.305247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d78cb2a9-3b93-4dc3-92e8-5110299700b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:31.369268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 943/1905] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:31.379240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215a774-8135-4425-96cb-124c466d90f4 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:31.381026 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-3215a774-8135-4425-96cb-124c466d90f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:31.441049 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215a774-8135-4425-96cb-124c466d90f4 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:31.444835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca468fc1-4ea8-431a-bd56-6506ee714828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:31.445492 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca468fc1-4ea8-431a-bd56-6506ee714828 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:31.445789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca468fc1-4ea8-431a-bd56-6506ee714828 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:31.446105 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca468fc1-4ea8-431a-bd56-6506ee714828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:31.455528 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca468fc1-4ea8-431a-bd56-6506ee714828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:31.457022 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca468fc1-4ea8-431a-bd56-6506ee714828 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:31.466696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 963/1906] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:31.942572 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cb2a9-3b93-4dc3-92e8-5110299700b4 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:31.947342 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d78cb2a9-3b93-4dc3-92e8-5110299700b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:31.965517 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cb2a9-3b93-4dc3-92e8-5110299700b4 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:31.971466 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede5913-eff1-4075-aaee-edca6c3cbe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:31.972625 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede5913-eff1-4075-aaee-edca6c3cbe63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:31.973314 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede5913-eff1-4075-aaee-edca6c3cbe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:31.974097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede5913-eff1-4075-aaee-edca6c3cbe63 admin admin] PATH_INFO: `/v3/projects/cdd03a0104c1434e9ec178c7bd595f7f` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:31.976593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede5913-eff1-4075-aaee-edca6c3cbe63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd03a0104c1434e9ec178c7bd595f7f)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:31.982225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede5913-eff1-4075-aaee-edca6c3cbe63 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:32.122516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-aede5913-eff1-4075-aaee-edca6c3cbe63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd03a0104c1434e9ec178c7bd595f7f', 'request_id': 'req-aede5913-eff1-4075-aaee-edca6c3cbe63'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:32.228812 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-aede5913-eff1-4075-aaee-edca6c3cbe63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd03a0104c1434e9ec178c7bd595f7f', 'request_id': 'req-aede5913-eff1-4075-aaee-edca6c3cbe63'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:32.237290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-aede5913-eff1-4075-aaee-edca6c3cbe63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd03a0104c1434e9ec178c7bd595f7f', 'request_id': 'req-aede5913-eff1-4075-aaee-edca6c3cbe63'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:32.249129 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-aede5913-eff1-4075-aaee-edca6c3cbe63 admin admin] The token cache is being invalidate because project cdd03a0104c1434e9ec178c7bd595f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:32.249515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-aede5913-eff1-4075-aaee-edca6c3cbe63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:32.250398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-aede5913-eff1-4075-aaee-edca6c3cbe63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:32.252466 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 944/1907] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:31 2022] DELETE /identity/v3/projects/cdd03a0104c1434e9ec178c7bd595f7f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:32.257439 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed65d3-ad32-4ef8-8795-f97c8019c712 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:32.258222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed65d3-ad32-4ef8-8795-f97c8019c712 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:32.258676 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed65d3-ad32-4ef8-8795-f97c8019c712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:32.281305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-f7ed65d3-ad32-4ef8-8795-f97c8019c712 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:32.283125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f7ed65d3-ad32-4ef8-8795-f97c8019c712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:32.353660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 964/1908] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:32.362779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f9884-14d8-4c4e-afc4-13d632c9103f None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:32.363083 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f9884-14d8-4c4e-afc4-13d632c9103f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:32.363372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f9884-14d8-4c4e-afc4-13d632c9103f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:32.382736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-a31f9884-14d8-4c4e-afc4-13d632c9103f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:32.383959 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-a31f9884-14d8-4c4e-afc4-13d632c9103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:32.394164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 945/1909] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:32.397928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed65d3-ad32-4ef8-8795-f97c8019c712 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:32.411512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed65d3-ad32-4ef8-8795-f97c8019c712 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:32.417381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4203e-9275-4ec1-b2dd-bbb571f38367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:32.418068 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4203e-9275-4ec1-b2dd-bbb571f38367 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:32.418361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4203e-9275-4ec1-b2dd-bbb571f38367 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:32.425244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4203e-9275-4ec1-b2dd-bbb571f38367 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:32.425244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4203e-9275-4ec1-b2dd-bbb571f38367 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:32.425244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4203e-9275-4ec1-b2dd-bbb571f38367 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:32.425244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4203e-9275-4ec1-b2dd-bbb571f38367 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:32.436397 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 965/1910] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 20:00:32.441057 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f9884-14d8-4c4e-afc4-13d632c9103f None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:32.451873 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f9884-14d8-4c4e-afc4-13d632c9103f None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:32.457764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecb402-0621-44b4-9509-69a700c81cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:32.458486 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecb402-0621-44b4-9509-69a700c81cbb admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:32.458803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecb402-0621-44b4-9509-69a700c81cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:32.459086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecb402-0621-44b4-9509-69a700c81cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:32.460524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecb402-0621-44b4-9509-69a700c81cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:32.462819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecb402-0621-44b4-9509-69a700c81cbb admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:32.626376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 946/1911] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:32 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:00:32.629945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4203e-9275-4ec1-b2dd-bbb571f38367 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:32.644994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4203e-9275-4ec1-b2dd-bbb571f38367 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:32.717566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cb085-7094-4e9d-81dc-7391c69314c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:32.718249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cb085-7094-4e9d-81dc-7391c69314c7 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:32.718565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cb085-7094-4e9d-81dc-7391c69314c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:32.718878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cb085-7094-4e9d-81dc-7391c69314c7 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:32.719636 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cb085-7094-4e9d-81dc-7391c69314c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:32.721630 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cb085-7094-4e9d-81dc-7391c69314c7 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:32.843420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 966/1912] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:32 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:32.847263 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecb402-0621-44b4-9509-69a700c81cbb admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:32.858316 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecb402-0621-44b4-9509-69a700c81cbb admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:32.864241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dbbb2-c0de-4464-8925-65299e3dc0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:32.864482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dbbb2-c0de-4464-8925-65299e3dc0ba admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:32.864993 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dbbb2-c0de-4464-8925-65299e3dc0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:32.865410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687dbbb2-c0de-4464-8925-65299e3dc0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:32.866791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dbbb2-c0de-4464-8925-65299e3dc0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:32.868468 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687dbbb2-c0de-4464-8925-65299e3dc0ba admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:32.882727 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 947/1913] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:32.886493 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cb085-7094-4e9d-81dc-7391c69314c7 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:32.897839 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cb085-7094-4e9d-81dc-7391c69314c7 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:32.902755 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b4302-8230-49a7-b2b7-43e09013c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:32.903435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b4302-8230-49a7-b2b7-43e09013c47b admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:32.903848 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b4302-8230-49a7-b2b7-43e09013c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:32.904493 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b4302-8230-49a7-b2b7-43e09013c47b admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:32.905278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b4302-8230-49a7-b2b7-43e09013c47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:32.907068 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b4302-8230-49a7-b2b7-43e09013c47b admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:32.918782 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 967/1914] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:00:32.919855 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:32.923079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dbbb2-c0de-4464-8925-65299e3dc0ba admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:32.940775 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687dbbb2-c0de-4464-8925-65299e3dc0ba admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:32.946509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9bb19-96fd-42aa-bb20-8bd682f6b01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:32.948515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9bb19-96fd-42aa-bb20-8bd682f6b01b admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:32.949383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9bb19-96fd-42aa-bb20-8bd682f6b01b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:32.949869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9bb19-96fd-42aa-bb20-8bd682f6b01b admin admin] PATH_INFO: `/v3/projects/3a8246bee5a047f9adfc669e30985e6a/users/2b6d05b3cda44222b7a2cbf11e65056f/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:32.968714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9bb19-96fd-42aa-bb20-8bd682f6b01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8246bee5a047f9adfc669e30985e6a, user_id=2b6d05b3cda44222b7a2cbf11e65056f, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:32.972037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9bb19-96fd-42aa-bb20-8bd682f6b01b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:33.069626 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 948/1915] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:32 2022] PUT /identity/v3/projects/3a8246bee5a047f9adfc669e30985e6a/users/2b6d05b3cda44222b7a2cbf11e65056f/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:33.079165 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd6fcb-8170-4040-b806-73ad10a4a1e5 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:33.079492 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd6fcb-8170-4040-b806-73ad10a4a1e5 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:33.081003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd6fcb-8170-4040-b806-73ad10a4a1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:33.124216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-60dd6fcb-8170-4040-b806-73ad10a4a1e5 None None] MFA Rules not processed for user `2b6d05b3cda44222b7a2cbf11e65056f`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:33.125570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-60dd6fcb-8170-4040-b806-73ad10a4a1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:33.259662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 968/1916] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:33.366749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9bb19-96fd-42aa-bb20-8bd682f6b01b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:33.368519 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-8bc9bb19-96fd-42aa-bb20-8bd682f6b01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:33.447975 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9bb19-96fd-42aa-bb20-8bd682f6b01b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:33.451820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27481dc-915a-48d8-944f-f4486706effd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:33.452488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27481dc-915a-48d8-944f-f4486706effd service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:33.452768 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27481dc-915a-48d8-944f-f4486706effd service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:33.453046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27481dc-915a-48d8-944f-f4486706effd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:33.463088 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27481dc-915a-48d8-944f-f4486706effd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:33.464527 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27481dc-915a-48d8-944f-f4486706effd service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:33.482980 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 949/1917] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:33.590060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:DELETE=13,keystone:SELECT=83,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:34.737223 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd6fcb-8170-4040-b806-73ad10a4a1e5 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:34.739687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-60dd6fcb-8170-4040-b806-73ad10a4a1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:34.874829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd6fcb-8170-4040-b806-73ad10a4a1e5 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:34.880524 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdd651-0b47-4262-b699-188ccc7bbc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:34.881807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdd651-0b47-4262-b699-188ccc7bbc91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:34.882105 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdd651-0b47-4262-b699-188ccc7bbc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:34.882725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdd651-0b47-4262-b699-188ccc7bbc91 admin admin] PATH_INFO: `/v3/users/271e954daa954cbd936d524281244ac4` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:34.883981 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdd651-0b47-4262-b699-188ccc7bbc91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=271e954daa954cbd936d524281244ac4)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:34.886086 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cdd651-0b47-4262-b699-188ccc7bbc91 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:35.075407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:35.118069 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-05cdd651-0b47-4262-b699-188ccc7bbc91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271e954daa954cbd936d524281244ac4'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:35.238424 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-05cdd651-0b47-4262-b699-188ccc7bbc91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271e954daa954cbd936d524281244ac4'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:35.239118 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-05cdd651-0b47-4262-b699-188ccc7bbc91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271e954daa954cbd936d524281244ac4'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:35.247889 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-05cdd651-0b47-4262-b699-188ccc7bbc91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271e954daa954cbd936d524281244ac4'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:35.262944 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-05cdd651-0b47-4262-b699-188ccc7bbc91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271e954daa954cbd936d524281244ac4'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:35.272422 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 969/1918] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:34 2022] DELETE /identity/v3/users/271e954daa954cbd936d524281244ac4 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:35.279504 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc18978-4774-4e35-8755-0eaa4ff0dda0 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:35.280708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc18978-4774-4e35-8755-0eaa4ff0dda0 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:35.281213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc18978-4774-4e35-8755-0eaa4ff0dda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:35.309165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-3fc18978-4774-4e35-8755-0eaa4ff0dda0 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:35.310780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-3fc18978-4774-4e35-8755-0eaa4ff0dda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:35.407323 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 950/1919] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:35.417458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdd651-0b47-4262-b699-188ccc7bbc91 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:35.418964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-05cdd651-0b47-4262-b699-188ccc7bbc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:35.499363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdd651-0b47-4262-b699-188ccc7bbc91 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:35.503777 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc889d3-915c-4512-8187-8ed913978c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:35.504445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc889d3-915c-4512-8187-8ed913978c43 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:35.504738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc889d3-915c-4512-8187-8ed913978c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:35.505024 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc889d3-915c-4512-8187-8ed913978c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:35.517327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc889d3-915c-4512-8187-8ed913978c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:35.519000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc889d3-915c-4512-8187-8ed913978c43 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:35.530495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 970/1920] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:36.249760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc18978-4774-4e35-8755-0eaa4ff0dda0 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:36.251900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-3fc18978-4774-4e35-8755-0eaa4ff0dda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:36.269769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc18978-4774-4e35-8755-0eaa4ff0dda0 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:36.284227 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f62c7-90c5-470e-8fbe-db7e123f837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:36.285495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f62c7-90c5-470e-8fbe-db7e123f837d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:36.285953 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f62c7-90c5-470e-8fbe-db7e123f837d admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:36.286448 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f62c7-90c5-470e-8fbe-db7e123f837d admin admin] PATH_INFO: `/v3/projects/019c55046c2f495496a3d8938863124e` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:36.288544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f62c7-90c5-470e-8fbe-db7e123f837d admin admin] RBAC: Authorizing `identity:delete_project(project_id=019c55046c2f495496a3d8938863124e)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:36.293630 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f62c7-90c5-470e-8fbe-db7e123f837d admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:36.456831 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cc2f62c7-90c5-470e-8fbe-db7e123f837d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '019c55046c2f495496a3d8938863124e', 'request_id': 'req-cc2f62c7-90c5-470e-8fbe-db7e123f837d'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:36.542670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cc2f62c7-90c5-470e-8fbe-db7e123f837d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '019c55046c2f495496a3d8938863124e', 'request_id': 'req-cc2f62c7-90c5-470e-8fbe-db7e123f837d'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:36.555467 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cc2f62c7-90c5-470e-8fbe-db7e123f837d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '019c55046c2f495496a3d8938863124e', 'request_id': 'req-cc2f62c7-90c5-470e-8fbe-db7e123f837d'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:36.568195 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cc2f62c7-90c5-470e-8fbe-db7e123f837d admin admin] The token cache is being invalidate because project 019c55046c2f495496a3d8938863124e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:36.568712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cc2f62c7-90c5-470e-8fbe-db7e123f837d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:36.569652 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cc2f62c7-90c5-470e-8fbe-db7e123f837d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:36.571937 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 951/1921] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:36 2022] DELETE /identity/v3/projects/019c55046c2f495496a3d8938863124e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:36.575899 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc889d3-915c-4512-8187-8ed913978c43 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:36.585956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc889d3-915c-4512-8187-8ed913978c43 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:36.659393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd6585-0a74-4810-ae18-60f791c180d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:36.660281 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd6585-0a74-4810-ae18-60f791c180d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:36.660578 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd6585-0a74-4810-ae18-60f791c180d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:36.660851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd6585-0a74-4810-ae18-60f791c180d7 admin admin] PATH_INFO: `/v3/users/fb27650cb6ec4ab7937513e46b642269` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:36.662049 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd6585-0a74-4810-ae18-60f791c180d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb27650cb6ec4ab7937513e46b642269)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:36.664535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd6585-0a74-4810-ae18-60f791c180d7 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:36.714516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:36.899122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f62c7-90c5-470e-8fbe-db7e123f837d admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:36.900830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cc2f62c7-90c5-470e-8fbe-db7e123f837d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:36.915970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f62c7-90c5-470e-8fbe-db7e123f837d admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:36.919549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-50fd6585-0a74-4810-ae18-60f791c180d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb27650cb6ec4ab7937513e46b642269'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:36.921577 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d707e0-0ff6-431f-a9eb-de92c8b8a19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:36.922691 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d707e0-0ff6-431f-a9eb-de92c8b8a19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:36.923126 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d707e0-0ff6-431f-a9eb-de92c8b8a19a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:36.923572 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d707e0-0ff6-431f-a9eb-de92c8b8a19a admin admin] PATH_INFO: `/v3/users/ce140b4002e44c31a3eae07ddad547fd` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:36.925186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d707e0-0ff6-431f-a9eb-de92c8b8a19a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce140b4002e44c31a3eae07ddad547fd)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:36.927297 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d707e0-0ff6-431f-a9eb-de92c8b8a19a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:36.998146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-50fd6585-0a74-4810-ae18-60f791c180d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb27650cb6ec4ab7937513e46b642269'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:37.010036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-50fd6585-0a74-4810-ae18-60f791c180d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb27650cb6ec4ab7937513e46b642269'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:37.023619 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-50fd6585-0a74-4810-ae18-60f791c180d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb27650cb6ec4ab7937513e46b642269'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:37.045233 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-50fd6585-0a74-4810-ae18-60f791c180d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb27650cb6ec4ab7937513e46b642269'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:37.050461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:37.060338 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 971/1922] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:36 2022] DELETE /identity/v3/users/fb27650cb6ec4ab7937513e46b642269 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:37.122890 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-59d707e0-0ff6-431f-a9eb-de92c8b8a19a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce140b4002e44c31a3eae07ddad547fd'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:37.123973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-59d707e0-0ff6-431f-a9eb-de92c8b8a19a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce140b4002e44c31a3eae07ddad547fd'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:37.222791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-59d707e0-0ff6-431f-a9eb-de92c8b8a19a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce140b4002e44c31a3eae07ddad547fd'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:37.236243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-59d707e0-0ff6-431f-a9eb-de92c8b8a19a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce140b4002e44c31a3eae07ddad547fd'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:37.244117 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-59d707e0-0ff6-431f-a9eb-de92c8b8a19a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce140b4002e44c31a3eae07ddad547fd'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:37.251361 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 952/1923] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:36 2022] DELETE /identity/v3/users/ce140b4002e44c31a3eae07ddad547fd => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:37.255522 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f8413-3ca0-4733-ba63-c28bbc034fd5 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:37.255870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f8413-3ca0-4733-ba63-c28bbc034fd5 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:37.256160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f8413-3ca0-4733-ba63-c28bbc034fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:37.273667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e96f8413-3ca0-4733-ba63-c28bbc034fd5 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:37.274897 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e96f8413-3ca0-4733-ba63-c28bbc034fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:37.334568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 972/1924] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:37.344715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d707e0-0ff6-431f-a9eb-de92c8b8a19a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:37.346130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-59d707e0-0ff6-431f-a9eb-de92c8b8a19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:37.424571 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d707e0-0ff6-431f-a9eb-de92c8b8a19a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:37.429594 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e41cc-445b-42c2-a14e-48033a68c8a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:37.433988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e41cc-445b-42c2-a14e-48033a68c8a1 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:37.433988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e41cc-445b-42c2-a14e-48033a68c8a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:37.433988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e41cc-445b-42c2-a14e-48033a68c8a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:37.441014 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e41cc-445b-42c2-a14e-48033a68c8a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:37.442503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e41cc-445b-42c2-a14e-48033a68c8a1 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:37.452995 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 953/1925] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:37.774886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f8413-3ca0-4733-ba63-c28bbc034fd5 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:37.777270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e96f8413-3ca0-4733-ba63-c28bbc034fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:37.819317 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f8413-3ca0-4733-ba63-c28bbc034fd5 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:37.825117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a5818-8da2-4b09-9be0-ed5a85424301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:37.826005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a5818-8da2-4b09-9be0-ed5a85424301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:37.826300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a5818-8da2-4b09-9be0-ed5a85424301 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:37.826622 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a5818-8da2-4b09-9be0-ed5a85424301 admin admin] PATH_INFO: `/v3/projects/8e72156301bb49f9addbe51b63cf5fb4` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:37.827841 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a5818-8da2-4b09-9be0-ed5a85424301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e72156301bb49f9addbe51b63cf5fb4)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:37.829807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a5818-8da2-4b09-9be0-ed5a85424301 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:37.940006 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e41cc-445b-42c2-a14e-48033a68c8a1 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:37.941494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-a46e41cc-445b-42c2-a14e-48033a68c8a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:37.976345 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e41cc-445b-42c2-a14e-48033a68c8a1 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:37.999257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-043a5818-8da2-4b09-9be0-ed5a85424301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e72156301bb49f9addbe51b63cf5fb4', 'request_id': 'req-043a5818-8da2-4b09-9be0-ed5a85424301'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:38.022948 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-043a5818-8da2-4b09-9be0-ed5a85424301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e72156301bb49f9addbe51b63cf5fb4', 'request_id': 'req-043a5818-8da2-4b09-9be0-ed5a85424301'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:38.030385 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-043a5818-8da2-4b09-9be0-ed5a85424301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e72156301bb49f9addbe51b63cf5fb4', 'request_id': 'req-043a5818-8da2-4b09-9be0-ed5a85424301'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:38.090054 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607e8b4-bb26-4248-8569-7b55a7439cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:38.091322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607e8b4-bb26-4248-8569-7b55a7439cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:38.091787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607e8b4-bb26-4248-8569-7b55a7439cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:38.092209 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607e8b4-bb26-4248-8569-7b55a7439cc0 admin admin] PATH_INFO: `/v3/projects/b41ddd75eb6a471fa5310dd735fd2aea` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:38.094130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607e8b4-bb26-4248-8569-7b55a7439cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41ddd75eb6a471fa5310dd735fd2aea)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:38.095998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607e8b4-bb26-4248-8569-7b55a7439cc0 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:38.132194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-043a5818-8da2-4b09-9be0-ed5a85424301 admin admin] The token cache is being invalidate because project 8e72156301bb49f9addbe51b63cf5fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:38.139086 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-043a5818-8da2-4b09-9be0-ed5a85424301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:38.148245 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-043a5818-8da2-4b09-9be0-ed5a85424301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:38.152231 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 973/1926] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:37 2022] DELETE /identity/v3/projects/8e72156301bb49f9addbe51b63cf5fb4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:38.167186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d9565-6243-419e-af99-66945f7fbca5 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:38.167830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d9565-6243-419e-af99-66945f7fbca5 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:38.168287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d9565-6243-419e-af99-66945f7fbca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:38.194736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-280d9565-6243-419e-af99-66945f7fbca5 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:38.196738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-280d9565-6243-419e-af99-66945f7fbca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:38.209112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 974/1927] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:38.219807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a139c-4219-4708-a4eb-0f89d9e1083b None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:38.220104 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a139c-4219-4708-a4eb-0f89d9e1083b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:38.223815 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a139c-4219-4708-a4eb-0f89d9e1083b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:38.249969 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-1607e8b4-bb26-4248-8569-7b55a7439cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41ddd75eb6a471fa5310dd735fd2aea', 'request_id': 'req-1607e8b4-bb26-4248-8569-7b55a7439cc0'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:38.278931 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-6a4a139c-4219-4708-a4eb-0f89d9e1083b None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:38.282090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-6a4a139c-4219-4708-a4eb-0f89d9e1083b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:38.370508 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 975/1928] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:38.374199 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a139c-4219-4708-a4eb-0f89d9e1083b None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:38.386163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a139c-4219-4708-a4eb-0f89d9e1083b None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:38.386571 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-1607e8b4-bb26-4248-8569-7b55a7439cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41ddd75eb6a471fa5310dd735fd2aea', 'request_id': 'req-1607e8b4-bb26-4248-8569-7b55a7439cc0'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:38.391886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69737fce-25d3-4a6e-b91c-223c77a3f05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:38.392916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69737fce-25d3-4a6e-b91c-223c77a3f05c admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:38.393605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69737fce-25d3-4a6e-b91c-223c77a3f05c admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:38.394063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69737fce-25d3-4a6e-b91c-223c77a3f05c admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:38.394506 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-1607e8b4-bb26-4248-8569-7b55a7439cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41ddd75eb6a471fa5310dd735fd2aea', 'request_id': 'req-1607e8b4-bb26-4248-8569-7b55a7439cc0'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:38.395196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69737fce-25d3-4a6e-b91c-223c77a3f05c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:38.395704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69737fce-25d3-4a6e-b91c-223c77a3f05c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:38.397603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69737fce-25d3-4a6e-b91c-223c77a3f05c admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:38.411073 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 976/1929] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:00:38.419098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69737fce-25d3-4a6e-b91c-223c77a3f05c admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:38.420659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-1607e8b4-bb26-4248-8569-7b55a7439cc0 admin admin] The token cache is being invalidate because project b41ddd75eb6a471fa5310dd735fd2aea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:38.420965 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-1607e8b4-bb26-4248-8569-7b55a7439cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:38.424156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-1607e8b4-bb26-4248-8569-7b55a7439cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:38.428151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 954/1930] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:37 2022] DELETE /identity/v3/projects/b41ddd75eb6a471fa5310dd735fd2aea => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:38.429541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69737fce-25d3-4a6e-b91c-223c77a3f05c admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:38.432025 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607e8b4-bb26-4248-8569-7b55a7439cc0 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:38.436759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3fb97-010e-4a01-a192-a2ce71183965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:38.436942 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-1607e8b4-bb26-4248-8569-7b55a7439cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:38.437885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3fb97-010e-4a01-a192-a2ce71183965 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:38.438295 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3fb97-010e-4a01-a192-a2ce71183965 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:38.438700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3fb97-010e-4a01-a192-a2ce71183965 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:38.439501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3fb97-010e-4a01-a192-a2ce71183965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:38.442293 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3fb97-010e-4a01-a192-a2ce71183965 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:38.463118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607e8b4-bb26-4248-8569-7b55a7439cc0 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:38.479362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e14e2-af6d-4144-87fc-9f8f2ca343a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:38.480558 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e14e2-af6d-4144-87fc-9f8f2ca343a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:38.480995 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e14e2-af6d-4144-87fc-9f8f2ca343a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:38.481457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e14e2-af6d-4144-87fc-9f8f2ca343a3 admin admin] PATH_INFO: `/v3/users/af14cd6f89a84adc905a412d52298170` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:38.484664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e14e2-af6d-4144-87fc-9f8f2ca343a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af14cd6f89a84adc905a412d52298170)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:38.489406 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e14e2-af6d-4144-87fc-9f8f2ca343a3 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:38.560040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 977/1931] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:38 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:38.561177 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3fb97-010e-4a01-a192-a2ce71183965 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:38.563024 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-73a3fb97-010e-4a01-a192-a2ce71183965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:38.666290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3fb97-010e-4a01-a192-a2ce71183965 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:38.677739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c126a-647f-49d7-81a0-67da1708e071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:38.679320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c126a-647f-49d7-81a0-67da1708e071 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:38.679809 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c126a-647f-49d7-81a0-67da1708e071 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:38.680238 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c126a-647f-49d7-81a0-67da1708e071 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:38.681294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c126a-647f-49d7-81a0-67da1708e071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:38.685830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c126a-647f-49d7-81a0-67da1708e071 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:38.781160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 978/1932] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:38 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:38.782370 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c126a-647f-49d7-81a0-67da1708e071 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:38.784597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-db1c126a-647f-49d7-81a0-67da1708e071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:38.796018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6c5e14e2-af6d-4144-87fc-9f8f2ca343a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af14cd6f89a84adc905a412d52298170'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:38.797212 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6c5e14e2-af6d-4144-87fc-9f8f2ca343a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af14cd6f89a84adc905a412d52298170'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:38.807484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c126a-647f-49d7-81a0-67da1708e071 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:38.812781 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453968f-c477-4dd7-85e0-05a46a9e28fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:38.813623 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453968f-c477-4dd7-85e0-05a46a9e28fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:38.813909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453968f-c477-4dd7-85e0-05a46a9e28fa admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:38.814189 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453968f-c477-4dd7-85e0-05a46a9e28fa admin admin] PATH_INFO: `/v3/users/2b6d05b3cda44222b7a2cbf11e65056f` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:38.815477 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453968f-c477-4dd7-85e0-05a46a9e28fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6d05b3cda44222b7a2cbf11e65056f)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:38.817440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453968f-c477-4dd7-85e0-05a46a9e28fa admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:38.908595 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6c5e14e2-af6d-4144-87fc-9f8f2ca343a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af14cd6f89a84adc905a412d52298170'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:38.924742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6c5e14e2-af6d-4144-87fc-9f8f2ca343a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af14cd6f89a84adc905a412d52298170'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:38.936636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-6c5e14e2-af6d-4144-87fc-9f8f2ca343a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af14cd6f89a84adc905a412d52298170'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:38.943417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 955/1933] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:38 2022] DELETE /identity/v3/users/af14cd6f89a84adc905a412d52298170 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:38.944292 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e14e2-af6d-4144-87fc-9f8f2ca343a3 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:38.945789 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-6c5e14e2-af6d-4144-87fc-9f8f2ca343a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:39.047945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-e453968f-c477-4dd7-85e0-05a46a9e28fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6d05b3cda44222b7a2cbf11e65056f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:39.076880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e14e2-af6d-4144-87fc-9f8f2ca343a3 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:39.082791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d6953-544f-4c99-a7b1-08e83f1e3563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:39.083557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d6953-544f-4c99-a7b1-08e83f1e3563 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:39.084656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d6953-544f-4c99-a7b1-08e83f1e3563 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:39.084999 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d6953-544f-4c99-a7b1-08e83f1e3563 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:39.085859 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d6953-544f-4c99-a7b1-08e83f1e3563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:39.087573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d6953-544f-4c99-a7b1-08e83f1e3563 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:39.100791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 956/1934] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:38 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:39.106869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d6953-544f-4c99-a7b1-08e83f1e3563 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:39.118831 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d6953-544f-4c99-a7b1-08e83f1e3563 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:39.124028 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d05e3-6832-43f2-93d3-a4eafbd9404d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:39.125909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-e453968f-c477-4dd7-85e0-05a46a9e28fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6d05b3cda44222b7a2cbf11e65056f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:39.126302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d05e3-6832-43f2-93d3-a4eafbd9404d admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:39.127927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d05e3-6832-43f2-93d3-a4eafbd9404d admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:39.128031 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-e453968f-c477-4dd7-85e0-05a46a9e28fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6d05b3cda44222b7a2cbf11e65056f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:39.128120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d05e3-6832-43f2-93d3-a4eafbd9404d admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:39.128120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d05e3-6832-43f2-93d3-a4eafbd9404d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:39.129518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d05e3-6832-43f2-93d3-a4eafbd9404d admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:39.137750 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-e453968f-c477-4dd7-85e0-05a46a9e28fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6d05b3cda44222b7a2cbf11e65056f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:39.143323 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 957/1935] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:39.148075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d05e3-6832-43f2-93d3-a4eafbd9404d admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:39.150001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-504d05e3-6832-43f2-93d3-a4eafbd9404d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:39.152532 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-e453968f-c477-4dd7-85e0-05a46a9e28fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6d05b3cda44222b7a2cbf11e65056f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:39.159222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 979/1936] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:38 2022] DELETE /identity/v3/users/2b6d05b3cda44222b7a2cbf11e65056f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:39.167089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffdd76-1958-474b-9192-09a95932c1b2 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:39.167538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffdd76-1958-474b-9192-09a95932c1b2 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:39.167835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffdd76-1958-474b-9192-09a95932c1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:39.170539 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d05e3-6832-43f2-93d3-a4eafbd9404d admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:39.187499 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a8ffdd76-1958-474b-9192-09a95932c1b2 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:39.188722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a8ffdd76-1958-474b-9192-09a95932c1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:39.248358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb092aa6-466b-48eb-904d-0fd5facee43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:39.252975 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb092aa6-466b-48eb-904d-0fd5facee43b admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:39.253495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb092aa6-466b-48eb-904d-0fd5facee43b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:39.253877 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb092aa6-466b-48eb-904d-0fd5facee43b admin admin] PATH_INFO: `/v3/projects/dc204e5f55344e23ac0bfeca5baf70e5/users/cf965d8bf36646fbb1d7cc90ff4c3739/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:39.275904 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb092aa6-466b-48eb-904d-0fd5facee43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc204e5f55344e23ac0bfeca5baf70e5, user_id=cf965d8bf36646fbb1d7cc90ff4c3739, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:39.279568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb092aa6-466b-48eb-904d-0fd5facee43b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:39.286641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:39.300349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 980/1937] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:39.311022 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffdd76-1958-474b-9192-09a95932c1b2 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:39.312686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a8ffdd76-1958-474b-9192-09a95932c1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:39.349928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 958/1938] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:39 2022] PUT /identity/v3/projects/dc204e5f55344e23ac0bfeca5baf70e5/users/cf965d8bf36646fbb1d7cc90ff4c3739/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:00:39.360036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1d5f3-0fad-4e1b-92fb-43c058bf3c8c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:39.360326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1d5f3-0fad-4e1b-92fb-43c058bf3c8c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:39.360604 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1d5f3-0fad-4e1b-92fb-43c058bf3c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:39.377639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffdd76-1958-474b-9192-09a95932c1b2 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:39.395645 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-29f1d5f3-0fad-4e1b-92fb-43c058bf3c8c None None] MFA Rules not processed for user `cf965d8bf36646fbb1d7cc90ff4c3739`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:39.397090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-29f1d5f3-0fad-4e1b-92fb-43c058bf3c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:39.438503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4c67a-20e5-47fa-9daf-aec05f734a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:39.439627 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4c67a-20e5-47fa-9daf-aec05f734a38 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:39.439916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4c67a-20e5-47fa-9daf-aec05f734a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:39.440269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4c67a-20e5-47fa-9daf-aec05f734a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:39.467861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 959/1939] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:39.472450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1d5f3-0fad-4e1b-92fb-43c058bf3c8c None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:39.511643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4c67a-20e5-47fa-9daf-aec05f734a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:39.513314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4c67a-20e5-47fa-9daf-aec05f734a38 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:39.524549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 981/1940] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:00:39.525328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4c67a-20e5-47fa-9daf-aec05f734a38 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:39.526916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-52d4c67a-20e5-47fa-9daf-aec05f734a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:39.540583 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4c67a-20e5-47fa-9daf-aec05f734a38 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:39.545434 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439d1b0-0973-4cf8-9ebd-245b343d7016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:39.546554 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439d1b0-0973-4cf8-9ebd-245b343d7016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:39.547437 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439d1b0-0973-4cf8-9ebd-245b343d7016 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:39.547735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439d1b0-0973-4cf8-9ebd-245b343d7016 admin admin] PATH_INFO: `/v3/projects/95d5098fdfcc4c1ca306b64edba3de2c` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:39.549162 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439d1b0-0973-4cf8-9ebd-245b343d7016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95d5098fdfcc4c1ca306b64edba3de2c)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:39.551068 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439d1b0-0973-4cf8-9ebd-245b343d7016 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:39.553357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1d5f3-0fad-4e1b-92fb-43c058bf3c8c None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:39.558568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a7acb-fcd0-4841-87a0-334959d9fbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:39.559341 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a7acb-fcd0-4841-87a0-334959d9fbfe admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:39.559639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a7acb-fcd0-4841-87a0-334959d9fbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:39.559939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a7acb-fcd0-4841-87a0-334959d9fbfe admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:39.560607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a7acb-fcd0-4841-87a0-334959d9fbfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:39.562574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a7acb-fcd0-4841-87a0-334959d9fbfe admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:39.611974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:39.648297 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 960/1941] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:39 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:00:39.652384 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a7acb-fcd0-4841-87a0-334959d9fbfe admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:39.660620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a439d1b0-0973-4cf8-9ebd-245b343d7016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95d5098fdfcc4c1ca306b64edba3de2c', 'request_id': 'req-a439d1b0-0973-4cf8-9ebd-245b343d7016'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:39.668348 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a439d1b0-0973-4cf8-9ebd-245b343d7016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95d5098fdfcc4c1ca306b64edba3de2c', 'request_id': 'req-a439d1b0-0973-4cf8-9ebd-245b343d7016'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:39.674229 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a439d1b0-0973-4cf8-9ebd-245b343d7016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95d5098fdfcc4c1ca306b64edba3de2c', 'request_id': 'req-a439d1b0-0973-4cf8-9ebd-245b343d7016'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:39.714999 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a7acb-fcd0-4841-87a0-334959d9fbfe admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:39.719689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b9b67-33ef-4f06-b28c-0691e569ced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:39.720362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b9b67-33ef-4f06-b28c-0691e569ced8 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:39.720652 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b9b67-33ef-4f06-b28c-0691e569ced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:39.720934 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b9b67-33ef-4f06-b28c-0691e569ced8 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:39.721620 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b9b67-33ef-4f06-b28c-0691e569ced8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:39.723607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b9b67-33ef-4f06-b28c-0691e569ced8 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:39.794120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a439d1b0-0973-4cf8-9ebd-245b343d7016 admin admin] The token cache is being invalidate because project 95d5098fdfcc4c1ca306b64edba3de2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:39.794758 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a439d1b0-0973-4cf8-9ebd-245b343d7016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:39.795132 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a439d1b0-0973-4cf8-9ebd-245b343d7016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:39.796714 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 982/1942] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:39 2022] DELETE /identity/v3/projects/95d5098fdfcc4c1ca306b64edba3de2c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:39.803515 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324b181-6bea-4062-850b-b2ae6cc1dd27 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:39.805224 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324b181-6bea-4062-850b-b2ae6cc1dd27 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:39.805224 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324b181-6bea-4062-850b-b2ae6cc1dd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:39.808983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 961/1943] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:39 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:00:39.810126 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b9b67-33ef-4f06-b28c-0691e569ced8 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:39.812474 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-0d1b9b67-33ef-4f06-b28c-0691e569ced8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:39.831869 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-7324b181-6bea-4062-850b-b2ae6cc1dd27 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:39.836383 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-7324b181-6bea-4062-850b-b2ae6cc1dd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:39.837533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b9b67-33ef-4f06-b28c-0691e569ced8 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:39.843919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530d4f6-b383-45f9-a4e0-65720442bbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:39.844781 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530d4f6-b383-45f9-a4e0-65720442bbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:39.845260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530d4f6-b383-45f9-a4e0-65720442bbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:39.846426 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530d4f6-b383-45f9-a4e0-65720442bbf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:39.847377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530d4f6-b383-45f9-a4e0-65720442bbf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:39.854462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530d4f6-b383-45f9-a4e0-65720442bbf9 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:39.854740 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 983/1944] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:39.860815 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a51056-f096-4cad-a8fd-02171b9b760b None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:39.861327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a51056-f096-4cad-a8fd-02171b9b760b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:39.861886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a51056-f096-4cad-a8fd-02171b9b760b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:39.863254 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 962/1945] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:39.868335 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530d4f6-b383-45f9-a4e0-65720442bbf9 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:39.885646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530d4f6-b383-45f9-a4e0-65720442bbf9 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:39.889942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-63a51056-f096-4cad-a8fd-02171b9b760b None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:39.891028 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57548f63-80ef-48c4-a3f3-26cc49a2a252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:39.891421 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-63a51056-f096-4cad-a8fd-02171b9b760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:39.891931 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57548f63-80ef-48c4-a3f3-26cc49a2a252 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:39.892219 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57548f63-80ef-48c4-a3f3-26cc49a2a252 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:39.892505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57548f63-80ef-48c4-a3f3-26cc49a2a252 admin admin] PATH_INFO: `/v3/projects/83a5c248735f468cbf7117f9324825cc/users/0e70131ee0b647c1b4a02a9114b68252/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:39.910891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 984/1946] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:39.911053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57548f63-80ef-48c4-a3f3-26cc49a2a252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a5c248735f468cbf7117f9324825cc, user_id=0e70131ee0b647c1b4a02a9114b68252, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:39.912410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a51056-f096-4cad-a8fd-02171b9b760b None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:39.913745 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57548f63-80ef-48c4-a3f3-26cc49a2a252 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:39.923024 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a51056-f096-4cad-a8fd-02171b9b760b None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:39.928266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230e01d-b0e6-4fe6-8a05-031b6d3fa214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:39.928929 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230e01d-b0e6-4fe6-8a05-031b6d3fa214 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:39.930889 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230e01d-b0e6-4fe6-8a05-031b6d3fa214 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:39.930889 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230e01d-b0e6-4fe6-8a05-031b6d3fa214 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:39.930889 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230e01d-b0e6-4fe6-8a05-031b6d3fa214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:39.930889 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230e01d-b0e6-4fe6-8a05-031b6d3fa214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:39.932244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230e01d-b0e6-4fe6-8a05-031b6d3fa214 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:39.945362 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 985/1947] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 20:00:39.949550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230e01d-b0e6-4fe6-8a05-031b6d3fa214 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:39.959348 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230e01d-b0e6-4fe6-8a05-031b6d3fa214 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:39.964264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2fe56-4716-4f1f-9caf-7598746f7a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:39.969083 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2fe56-4716-4f1f-9caf-7598746f7a68 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:39.969372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2fe56-4716-4f1f-9caf-7598746f7a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:39.969650 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2fe56-4716-4f1f-9caf-7598746f7a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:39.970460 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2fe56-4716-4f1f-9caf-7598746f7a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:39.972552 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2fe56-4716-4f1f-9caf-7598746f7a68 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:39.975379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 963/1948] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:39 2022] PUT /identity/v3/projects/83a5c248735f468cbf7117f9324825cc/users/0e70131ee0b647c1b4a02a9114b68252/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:39.981085 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57548f63-80ef-48c4-a3f3-26cc49a2a252 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:39.983933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-57548f63-80ef-48c4-a3f3-26cc49a2a252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:40.041664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 986/1949] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:39 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:00:40.042537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2fe56-4716-4f1f-9caf-7598746f7a68 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:40.057721 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57548f63-80ef-48c4-a3f3-26cc49a2a252 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:40.109157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2fe56-4716-4f1f-9caf-7598746f7a68 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:40.113837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a3bae-8105-44d5-9fb7-cd6b9b4fc4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:40.114477 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a3bae-8105-44d5-9fb7-cd6b9b4fc4ff admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.114767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a3bae-8105-44d5-9fb7-cd6b9b4fc4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.115092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a3bae-8105-44d5-9fb7-cd6b9b4fc4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.115824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a3bae-8105-44d5-9fb7-cd6b9b4fc4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:40.117428 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a3bae-8105-44d5-9fb7-cd6b9b4fc4ff admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:40.117660 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370c649-f819-415d-97ed-85a0e7d8b43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:40.118867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370c649-f819-415d-97ed-85a0e7d8b43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.119163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370c649-f819-415d-97ed-85a0e7d8b43d admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.120002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370c649-f819-415d-97ed-85a0e7d8b43d admin admin] PATH_INFO: `/v3/projects/3a8246bee5a047f9adfc669e30985e6a` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.121123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370c649-f819-415d-97ed-85a0e7d8b43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8246bee5a047f9adfc669e30985e6a)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:40.123529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370c649-f819-415d-97ed-85a0e7d8b43d admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:40.128550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 987/1950] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:40.129382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a3bae-8105-44d5-9fb7-cd6b9b4fc4ff admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:40.141030 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a3bae-8105-44d5-9fb7-cd6b9b4fc4ff admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:40.145760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea52afb-3436-4e30-b911-fce1821c8eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:40.147040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea52afb-3436-4e30-b911-fce1821c8eaf admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.147331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea52afb-3436-4e30-b911-fce1821c8eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.147612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea52afb-3436-4e30-b911-fce1821c8eaf admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.148304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea52afb-3436-4e30-b911-fce1821c8eaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:40.150253 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea52afb-3436-4e30-b911-fce1821c8eaf admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:40.244155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 988/1951] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:40 2022] POST /identity/v3/users => generated 284 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:40.244155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea52afb-3436-4e30-b911-fce1821c8eaf admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:40.253016 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea52afb-3436-4e30-b911-fce1821c8eaf admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:40.256707 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c370c649-f819-415d-97ed-85a0e7d8b43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8246bee5a047f9adfc669e30985e6a', 'request_id': 'req-c370c649-f819-415d-97ed-85a0e7d8b43d'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:40.311934 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4f778-5e21-4846-bde4-95c264ae5062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:40.312928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4f778-5e21-4846-bde4-95c264ae5062 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.313213 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4f778-5e21-4846-bde4-95c264ae5062 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.313496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4f778-5e21-4846-bde4-95c264ae5062 admin admin] PATH_INFO: `/v3/projects/83a5c248735f468cbf7117f9324825cc/users/0e70131ee0b647c1b4a02a9114b68252/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.315545 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4f778-5e21-4846-bde4-95c264ae5062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a5c248735f468cbf7117f9324825cc, user_id=0e70131ee0b647c1b4a02a9114b68252, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:40.317740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c370c649-f819-415d-97ed-85a0e7d8b43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8246bee5a047f9adfc669e30985e6a', 'request_id': 'req-c370c649-f819-415d-97ed-85a0e7d8b43d'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:40.318873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4f778-5e21-4846-bde4-95c264ae5062 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:40.325757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c370c649-f819-415d-97ed-85a0e7d8b43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8246bee5a047f9adfc669e30985e6a', 'request_id': 'req-c370c649-f819-415d-97ed-85a0e7d8b43d'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:40.330971 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 989/1952] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:40 2022] PUT /identity/v3/projects/83a5c248735f468cbf7117f9324825cc/users/0e70131ee0b647c1b4a02a9114b68252/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:40.332626 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4f778-5e21-4846-bde4-95c264ae5062 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:40.337294 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c370c649-f819-415d-97ed-85a0e7d8b43d admin admin] The token cache is being invalidate because project 3a8246bee5a047f9adfc669e30985e6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:40.337701 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c370c649-f819-415d-97ed-85a0e7d8b43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:40.338931 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c370c649-f819-415d-97ed-85a0e7d8b43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:40.340792 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 964/1953] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:39 2022] DELETE /identity/v3/projects/3a8246bee5a047f9adfc669e30985e6a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:40.345262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c1290-a85f-45d5-b0fe-56cb9018a9dd None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.345655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c1290-a85f-45d5-b0fe-56cb9018a9dd None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.346021 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c1290-a85f-45d5-b0fe-56cb9018a9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.372012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-115c1290-a85f-45d5-b0fe-56cb9018a9dd None None] MFA Rules not processed for user `0e70131ee0b647c1b4a02a9114b68252`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:40.373200 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-115c1290-a85f-45d5-b0fe-56cb9018a9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:40.393625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4f778-5e21-4846-bde4-95c264ae5062 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:40.399233 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096c20d-8bd4-4e37-81fe-4aca8ab37569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:40.399737 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096c20d-8bd4-4e37-81fe-4aca8ab37569 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.400029 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096c20d-8bd4-4e37-81fe-4aca8ab37569 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.400314 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096c20d-8bd4-4e37-81fe-4aca8ab37569 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.401052 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096c20d-8bd4-4e37-81fe-4aca8ab37569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:40.402716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096c20d-8bd4-4e37-81fe-4aca8ab37569 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:40.412713 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 990/1954] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:40.413990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac85157-6fcf-46cf-990d-503c4b5a9f30 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.414290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac85157-6fcf-46cf-990d-503c4b5a9f30 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.414598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac85157-6fcf-46cf-990d-503c4b5a9f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.432100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-5ac85157-6fcf-46cf-990d-503c4b5a9f30 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:40.433546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5ac85157-6fcf-46cf-990d-503c4b5a9f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:40.442950 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 991/1955] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:40.444692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac85157-6fcf-46cf-990d-503c4b5a9f30 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:40.444829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 965/1956] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:40.452451 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc53f9-4966-4390-81aa-3279538fca09 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.452590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc53f9-4966-4390-81aa-3279538fca09 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.453152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc53f9-4966-4390-81aa-3279538fca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.453837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5ac85157-6fcf-46cf-990d-503c4b5a9f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:40.475832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-5ecc53f9-4966-4390-81aa-3279538fca09 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:40.476979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac85157-6fcf-46cf-990d-503c4b5a9f30 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:40.478102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-5ecc53f9-4966-4390-81aa-3279538fca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:40.482184 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e1ca3-33b8-43f1-934a-a485c1e16dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:40.483095 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e1ca3-33b8-43f1-934a-a485c1e16dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.483452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e1ca3-33b8-43f1-934a-a485c1e16dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.483801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e1ca3-33b8-43f1-934a-a485c1e16dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.484668 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e1ca3-33b8-43f1-934a-a485c1e16dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:40.486570 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e1ca3-33b8-43f1-934a-a485c1e16dd5 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:40.491610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 966/1957] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:40.492136 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc53f9-4966-4390-81aa-3279538fca09 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:40.493807 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-5ecc53f9-4966-4390-81aa-3279538fca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:40.501160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 992/1958] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:40.502022 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e1ca3-33b8-43f1-934a-a485c1e16dd5 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:40.513976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e1ca3-33b8-43f1-934a-a485c1e16dd5 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:40.519039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0abc4-90c3-4afd-bac8-fe96445418aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:40.519776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0abc4-90c3-4afd-bac8-fe96445418aa admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.520154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0abc4-90c3-4afd-bac8-fe96445418aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.520499 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0abc4-90c3-4afd-bac8-fe96445418aa admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.521833 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0abc4-90c3-4afd-bac8-fe96445418aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:40.522213 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0abc4-90c3-4afd-bac8-fe96445418aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:40.525962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0abc4-90c3-4afd-bac8-fe96445418aa admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:40.542620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 993/1959] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:00:40.542620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0abc4-90c3-4afd-bac8-fe96445418aa admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:40.556478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0abc4-90c3-4afd-bac8-fe96445418aa admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:40.561791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af2d74-7d96-47d7-868d-785e868024fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:40.565678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af2d74-7d96-47d7-868d-785e868024fc admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.565678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af2d74-7d96-47d7-868d-785e868024fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.565678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af2d74-7d96-47d7-868d-785e868024fc admin admin] PATH_INFO: `/v3/projects/e93bb10d96fd4c53a560bea09f4bd0f4/users/f533eecf106341de9c8afe6c13938429/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.575397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc53f9-4966-4390-81aa-3279538fca09 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:40.579745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af2d74-7d96-47d7-868d-785e868024fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93bb10d96fd4c53a560bea09f4bd0f4, user_id=f533eecf106341de9c8afe6c13938429, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:40.579973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bffb1-5472-4d17-937e-7da65c5de8db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:40.580636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bffb1-5472-4d17-937e-7da65c5de8db service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.580924 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bffb1-5472-4d17-937e-7da65c5de8db service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.581207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bffb1-5472-4d17-937e-7da65c5de8db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.583296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af2d74-7d96-47d7-868d-785e868024fc admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:40.592300 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bffb1-5472-4d17-937e-7da65c5de8db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:40.593729 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45bffb1-5472-4d17-937e-7da65c5de8db service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:40.604610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 967/1960] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:40.605370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bffb1-5472-4d17-937e-7da65c5de8db service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:40.617423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45bffb1-5472-4d17-937e-7da65c5de8db service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:40.624046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b394cd-7ebd-4b0a-ac4d-94172fbed6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:40.624847 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b394cd-7ebd-4b0a-ac4d-94172fbed6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.625206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b394cd-7ebd-4b0a-ac4d-94172fbed6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.625821 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b394cd-7ebd-4b0a-ac4d-94172fbed6b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.627065 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b394cd-7ebd-4b0a-ac4d-94172fbed6b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:40.629137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b394cd-7ebd-4b0a-ac4d-94172fbed6b5 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:40.669302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 994/1961] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:40 2022] PUT /identity/v3/projects/e93bb10d96fd4c53a560bea09f4bd0f4/users/f533eecf106341de9c8afe6c13938429/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:40.681094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf190ad-2076-4729-8860-870fe4241c4e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.681391 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf190ad-2076-4729-8860-870fe4241c4e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.681712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf190ad-2076-4729-8860-870fe4241c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.691742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:40.713215 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-aaf190ad-2076-4729-8860-870fe4241c4e None None] MFA Rules not processed for user `f533eecf106341de9c8afe6c13938429`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:40.716426 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-aaf190ad-2076-4729-8860-870fe4241c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:40.722083 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 968/1962] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:40 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:40.726813 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b394cd-7ebd-4b0a-ac4d-94172fbed6b5 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:40.795286 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 995/1963] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:40.795725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf190ad-2076-4729-8860-870fe4241c4e None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:40.824863 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b394cd-7ebd-4b0a-ac4d-94172fbed6b5 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:40.829839 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cf3cf-246b-4979-9ca0-df64583392c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:40.830673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cf3cf-246b-4979-9ca0-df64583392c2 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.830966 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cf3cf-246b-4979-9ca0-df64583392c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.831248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cf3cf-246b-4979-9ca0-df64583392c2 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.831982 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cf3cf-246b-4979-9ca0-df64583392c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:40.834496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43cf3cf-246b-4979-9ca0-df64583392c2 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:40.846563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:40.853699 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf190ad-2076-4729-8860-870fe4241c4e None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:40.902435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2254cf-d5ca-415d-9ff9-99e122797568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:40.903098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2254cf-d5ca-415d-9ff9-99e122797568 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.903386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2254cf-d5ca-415d-9ff9-99e122797568 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.903669 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2254cf-d5ca-415d-9ff9-99e122797568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.905448 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-be2254cf-d5ca-415d-9ff9-99e122797568 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:40.926824 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 969/1964] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:40 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:40.928241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cf3cf-246b-4979-9ca0-df64583392c2 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:40.938858 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cf3cf-246b-4979-9ca0-df64583392c2 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:40.944512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70171732-e778-4e51-bcbc-3d4928a7f097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:40.945696 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70171732-e778-4e51-bcbc-3d4928a7f097 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:40.945696 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70171732-e778-4e51-bcbc-3d4928a7f097 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:40.946007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70171732-e778-4e51-bcbc-3d4928a7f097 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:40.946851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70171732-e778-4e51-bcbc-3d4928a7f097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:40.948846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70171732-e778-4e51-bcbc-3d4928a7f097 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:40.975637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2254cf-d5ca-415d-9ff9-99e122797568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:40.977105 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2254cf-d5ca-415d-9ff9-99e122797568 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:40.986031 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 996/1965] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:40.986970 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2254cf-d5ca-415d-9ff9-99e122797568 service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:40.998605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2254cf-d5ca-415d-9ff9-99e122797568 service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:41.022063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c746-ea2c-4186-ba9d-16b3fe47373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:41.023095 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c746-ea2c-4186-ba9d-16b3fe47373d admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:41.024785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c746-ea2c-4186-ba9d-16b3fe47373d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:41.024785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082c746-ea2c-4186-ba9d-16b3fe47373d admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:41.026882 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082c746-ea2c-4186-ba9d-16b3fe47373d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:41.033015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082c746-ea2c-4186-ba9d-16b3fe47373d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:41.056170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 997/1966] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:41.062083 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c746-ea2c-4186-ba9d-16b3fe47373d admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:41.075526 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082c746-ea2c-4186-ba9d-16b3fe47373d admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:41.081637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321211c-0655-496a-a662-fea07412b113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:41.082623 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321211c-0655-496a-a662-fea07412b113 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:41.082903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321211c-0655-496a-a662-fea07412b113 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:41.083225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321211c-0655-496a-a662-fea07412b113 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:41.085150 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321211c-0655-496a-a662-fea07412b113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:41.087242 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321211c-0655-496a-a662-fea07412b113 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:41.090105 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 970/1967] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:40 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:41.094421 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70171732-e778-4e51-bcbc-3d4928a7f097 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:41.106449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 998/1968] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:00:41.111072 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321211c-0655-496a-a662-fea07412b113 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:41.122726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321211c-0655-496a-a662-fea07412b113 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:41.199897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70171732-e778-4e51-bcbc-3d4928a7f097 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:41.205568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd63d0-248a-435a-a1b9-a475cc1ca412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:41.206493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd63d0-248a-435a-a1b9-a475cc1ca412 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:41.206852 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd63d0-248a-435a-a1b9-a475cc1ca412 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:41.207670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd63d0-248a-435a-a1b9-a475cc1ca412 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:41.208203 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd63d0-248a-435a-a1b9-a475cc1ca412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:41.209822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3293bb9-c4c4-4831-b131-3e841da4a58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:41.211090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd63d0-248a-435a-a1b9-a475cc1ca412 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:41.211692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3293bb9-c4c4-4831-b131-3e841da4a58b admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:41.212178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3293bb9-c4c4-4831-b131-3e841da4a58b admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:41.212653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3293bb9-c4c4-4831-b131-3e841da4a58b admin admin] PATH_INFO: `/v3/projects/1fe267dc7cb84e388f01ccfb0f2ab4d5/users/2e7a03fe6e01456298f81a6a45f345da/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:41.238224 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3293bb9-c4c4-4831-b131-3e841da4a58b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe267dc7cb84e388f01ccfb0f2ab4d5, user_id=2e7a03fe6e01456298f81a6a45f345da, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:41.241402 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3293bb9-c4c4-4831-b131-3e841da4a58b admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:41.299069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 971/1969] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:41 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:41.304715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd63d0-248a-435a-a1b9-a475cc1ca412 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:41.316384 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd63d0-248a-435a-a1b9-a475cc1ca412 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:41.322920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501c224-85e2-404a-a2dc-2d0a01460f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:41.323780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501c224-85e2-404a-a2dc-2d0a01460f23 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:41.324107 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501c224-85e2-404a-a2dc-2d0a01460f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:41.324390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501c224-85e2-404a-a2dc-2d0a01460f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:41.325297 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501c224-85e2-404a-a2dc-2d0a01460f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:41.327100 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501c224-85e2-404a-a2dc-2d0a01460f23 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:41.338249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 999/1970] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:41 2022] PUT /identity/v3/projects/1fe267dc7cb84e388f01ccfb0f2ab4d5/users/2e7a03fe6e01456298f81a6a45f345da/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:41.338568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 972/1971] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:41.339870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3bcd6-e1a4-4ce6-b91d-855616903796 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:41.340170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3bcd6-e1a4-4ce6-b91d-855616903796 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:41.340489 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3bcd6-e1a4-4ce6-b91d-855616903796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:41.342435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501c224-85e2-404a-a2dc-2d0a01460f23 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:41.355454 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501c224-85e2-404a-a2dc-2d0a01460f23 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:41.370114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-8bc3bcd6-e1a4-4ce6-b91d-855616903796 None None] MFA Rules not processed for user `2e7a03fe6e01456298f81a6a45f345da`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:41.371379 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8bc3bcd6-e1a4-4ce6-b91d-855616903796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:41.448631 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bd960-0908-466a-b3c7-2546e8ba604c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:41.449549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bd960-0908-466a-b3c7-2546e8ba604c admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:41.449893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bd960-0908-466a-b3c7-2546e8ba604c admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:41.450174 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bd960-0908-466a-b3c7-2546e8ba604c admin admin] PATH_INFO: `/v3/projects/de7da3e7aa1f4e3589fddeb9c1042500/users/3c6ffd5db7f945ee8161ced6cff6e108/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:41.462011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1000/1972] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:41.466877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3bcd6-e1a4-4ce6-b91d-855616903796 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:41.490429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3bcd6-e1a4-4ce6-b91d-855616903796 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:41.491694 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bd960-0908-466a-b3c7-2546e8ba604c admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7da3e7aa1f4e3589fddeb9c1042500, user_id=3c6ffd5db7f945ee8161ced6cff6e108, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:41.495014 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bd960-0908-466a-b3c7-2546e8ba604c admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:41.504702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ee071-9d52-44dd-9450-68467ff19186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:41.506368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ee071-9d52-44dd-9450-68467ff19186 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:41.506741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ee071-9d52-44dd-9450-68467ff19186 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:41.507220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ee071-9d52-44dd-9450-68467ff19186 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:41.508070 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ee071-9d52-44dd-9450-68467ff19186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:41.510146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ee071-9d52-44dd-9450-68467ff19186 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:41.616474 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 973/1973] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:41 2022] PUT /identity/v3/projects/de7da3e7aa1f4e3589fddeb9c1042500/users/3c6ffd5db7f945ee8161ced6cff6e108/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:41.617326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bd960-0908-466a-b3c7-2546e8ba604c admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:41.618978 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-ec6bd960-0908-466a-b3c7-2546e8ba604c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:41.653840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1001/1974] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:41 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:41.653840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ee071-9d52-44dd-9450-68467ff19186 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:41.691467 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bd960-0908-466a-b3c7-2546e8ba604c admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:41.717216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ee071-9d52-44dd-9450-68467ff19186 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:41.721917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b1a38-b5b7-4f9f-b0e5-cb08e0778e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:41.734996 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b1a38-b5b7-4f9f-b0e5-cb08e0778e19 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:41.734996 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b1a38-b5b7-4f9f-b0e5-cb08e0778e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:41.734996 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b1a38-b5b7-4f9f-b0e5-cb08e0778e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:41.734996 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b1a38-b5b7-4f9f-b0e5-cb08e0778e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:41.734996 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b1a38-b5b7-4f9f-b0e5-cb08e0778e19 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:41.735573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1002/1975] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:41.736450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b1a38-b5b7-4f9f-b0e5-cb08e0778e19 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:41.746036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b1a38-b5b7-4f9f-b0e5-cb08e0778e19 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:41.750919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d7272-71be-46d0-bb76-b905e0c673bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:41.751126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17750d8a-dd0f-44b6-9586-71d39c803f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:41.751779 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17750d8a-dd0f-44b6-9586-71d39c803f37 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:41.751878 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d7272-71be-46d0-bb76-b905e0c673bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:41.752066 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d7272-71be-46d0-bb76-b905e0c673bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:41.752156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17750d8a-dd0f-44b6-9586-71d39c803f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:41.752337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17750d8a-dd0f-44b6-9586-71d39c803f37 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:41.752422 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d7272-71be-46d0-bb76-b905e0c673bb admin admin] PATH_INFO: `/v3/users/cf965d8bf36646fbb1d7cc90ff4c3739` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:41.753145 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17750d8a-dd0f-44b6-9586-71d39c803f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:41.753684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d7272-71be-46d0-bb76-b905e0c673bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf965d8bf36646fbb1d7cc90ff4c3739)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:41.755104 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17750d8a-dd0f-44b6-9586-71d39c803f37 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:41.756266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d7272-71be-46d0-bb76-b905e0c673bb admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:41.856167 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1003/1976] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:41 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:41.856167 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17750d8a-dd0f-44b6-9586-71d39c803f37 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:41.868448 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17750d8a-dd0f-44b6-9586-71d39c803f37 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:41.873435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ec958-b0d8-45b9-94da-34be17aa3223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:41.874437 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ec958-b0d8-45b9-94da-34be17aa3223 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:41.874795 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ec958-b0d8-45b9-94da-34be17aa3223 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:41.875143 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ec958-b0d8-45b9-94da-34be17aa3223 admin admin] PATH_INFO: `/v3/projects/de7da3e7aa1f4e3589fddeb9c1042500/users/3c6ffd5db7f945ee8161ced6cff6e108/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:41.877518 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ec958-b0d8-45b9-94da-34be17aa3223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7da3e7aa1f4e3589fddeb9c1042500, user_id=3c6ffd5db7f945ee8161ced6cff6e108, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:41.881044 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ec958-b0d8-45b9-94da-34be17aa3223 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:41.893090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1004/1977] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:41 2022] PUT /identity/v3/projects/de7da3e7aa1f4e3589fddeb9c1042500/users/3c6ffd5db7f945ee8161ced6cff6e108/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:41.893581 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ec958-b0d8-45b9-94da-34be17aa3223 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:41.961074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ec958-b0d8-45b9-94da-34be17aa3223 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:41.965941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0dad0-749f-442d-af05-11b5f598ea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:41.966687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0dad0-749f-442d-af05-11b5f598ea79 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:41.966976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0dad0-749f-442d-af05-11b5f598ea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:41.967352 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0dad0-749f-442d-af05-11b5f598ea79 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:41.968060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0dad0-749f-442d-af05-11b5f598ea79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:41.969674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0dad0-749f-442d-af05-11b5f598ea79 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:41.979933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1005/1978] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:41.981210 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0f633-2db0-4620-8998-81ba5b6682e2 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:41.981496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0f633-2db0-4620-8998-81ba5b6682e2 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:41.982127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0f633-2db0-4620-8998-81ba5b6682e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:42.010201 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2d3d7272-71be-46d0-bb76-b905e0c673bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf965d8bf36646fbb1d7cc90ff4c3739'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:42.014261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-b3c0f633-2db0-4620-8998-81ba5b6682e2 None None] MFA Rules not processed for user `3c6ffd5db7f945ee8161ced6cff6e108`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:42.014410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2d3d7272-71be-46d0-bb76-b905e0c673bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf965d8bf36646fbb1d7cc90ff4c3739'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:42.014523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b3c0f633-2db0-4620-8998-81ba5b6682e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:42.081085 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1006/1979] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:42.081935 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0f633-2db0-4620-8998-81ba5b6682e2 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:42.092122 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0f633-2db0-4620-8998-81ba5b6682e2 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:42.096741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb821a-03b6-472e-92f4-3bfdfcc4f300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:42.097404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb821a-03b6-472e-92f4-3bfdfcc4f300 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:42.097696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb821a-03b6-472e-92f4-3bfdfcc4f300 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:42.097978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb821a-03b6-472e-92f4-3bfdfcc4f300 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:42.098801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb821a-03b6-472e-92f4-3bfdfcc4f300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:42.100433 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb821a-03b6-472e-92f4-3bfdfcc4f300 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:42.110637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1007/1980] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:42.111475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb821a-03b6-472e-92f4-3bfdfcc4f300 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:42.120651 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2d3d7272-71be-46d0-bb76-b905e0c673bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf965d8bf36646fbb1d7cc90ff4c3739'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:42.138818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2d3d7272-71be-46d0-bb76-b905e0c673bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf965d8bf36646fbb1d7cc90ff4c3739'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:42.145967 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2d3d7272-71be-46d0-bb76-b905e0c673bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf965d8bf36646fbb1d7cc90ff4c3739'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:42.153173 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 974/1981] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:41 2022] DELETE /identity/v3/users/cf965d8bf36646fbb1d7cc90ff4c3739 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:42.153961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d7272-71be-46d0-bb76-b905e0c673bb admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:42.155370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2d3d7272-71be-46d0-bb76-b905e0c673bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:42.173680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb821a-03b6-472e-92f4-3bfdfcc4f300 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:42.223382 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d7272-71be-46d0-bb76-b905e0c673bb admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:42.228050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b8974-97f3-4e8b-bd3d-1265adec1b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:42.229056 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b8974-97f3-4e8b-bd3d-1265adec1b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:42.229440 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b8974-97f3-4e8b-bd3d-1265adec1b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:42.229994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b8974-97f3-4e8b-bd3d-1265adec1b5d admin admin] PATH_INFO: `/v3/projects/4bf5ca7849b84b49b3680f3b17205213/users/20c39bb208444f65a44cedbdd0da035b/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:42.231440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8037da8-e0fa-438d-9d5f-bc0e70090aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:42.232125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8037da8-e0fa-438d-9d5f-bc0e70090aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:42.232825 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8037da8-e0fa-438d-9d5f-bc0e70090aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:42.232825 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8037da8-e0fa-438d-9d5f-bc0e70090aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:42.235658 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d8037da8-e0fa-438d-9d5f-bc0e70090aa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:42.247890 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b8974-97f3-4e8b-bd3d-1265adec1b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf5ca7849b84b49b3680f3b17205213, user_id=20c39bb208444f65a44cedbdd0da035b, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:42.251086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b8974-97f3-4e8b-bd3d-1265adec1b5d admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:42.301182 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8037da8-e0fa-438d-9d5f-bc0e70090aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:42.303470 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8037da8-e0fa-438d-9d5f-bc0e70090aa7 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:42.313084 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1008/1982] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:42.314581 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f298015-9647-4ddf-9bbe-46ea9fa50bf2 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:42.314871 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f298015-9647-4ddf-9bbe-46ea9fa50bf2 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:42.315158 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f298015-9647-4ddf-9bbe-46ea9fa50bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:42.332318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-4f298015-9647-4ddf-9bbe-46ea9fa50bf2 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:42.333694 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4f298015-9647-4ddf-9bbe-46ea9fa50bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:42.342803 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1009/1983] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:42.354791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f298015-9647-4ddf-9bbe-46ea9fa50bf2 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:42.356464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4f298015-9647-4ddf-9bbe-46ea9fa50bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:42.356579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 975/1984] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:42 2022] PUT /identity/v3/projects/4bf5ca7849b84b49b3680f3b17205213/users/20c39bb208444f65a44cedbdd0da035b/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:42.358242 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f6771-f74d-421b-bf94-236cdf8f0742 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:42.358574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f6771-f74d-421b-bf94-236cdf8f0742 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:42.358931 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f6771-f74d-421b-bf94-236cdf8f0742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:42.394926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-474f6771-f74d-421b-bf94-236cdf8f0742 None None] MFA Rules not processed for user `20c39bb208444f65a44cedbdd0da035b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:42.398319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-474f6771-f74d-421b-bf94-236cdf8f0742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:42.450715 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:42.480246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f298015-9647-4ddf-9bbe-46ea9fa50bf2 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:42.486746 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 976/1985] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:42.491471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f6771-f74d-421b-bf94-236cdf8f0742 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:42.534401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab2e56-f24f-435a-8f1c-db55497e8d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:42.535195 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab2e56-f24f-435a-8f1c-db55497e8d21 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:42.535599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab2e56-f24f-435a-8f1c-db55497e8d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:42.535943 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab2e56-f24f-435a-8f1c-db55497e8d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:42.557399 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f6771-f74d-421b-bf94-236cdf8f0742 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:42.563143 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239fc28-d2a6-4ddf-b728-170f4b6e6cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:42.564128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239fc28-d2a6-4ddf-b728-170f4b6e6cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:42.564418 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239fc28-d2a6-4ddf-b728-170f4b6e6cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:42.564701 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239fc28-d2a6-4ddf-b728-170f4b6e6cb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:42.565422 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239fc28-d2a6-4ddf-b728-170f4b6e6cb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:42.567353 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239fc28-d2a6-4ddf-b728-170f4b6e6cb9 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:42.600605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab2e56-f24f-435a-8f1c-db55497e8d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:42.602128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab2e56-f24f-435a-8f1c-db55497e8d21 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:42.612357 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1010/1986] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:00:42.653813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab2e56-f24f-435a-8f1c-db55497e8d21 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:42.655552 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9dab2e56-f24f-435a-8f1c-db55497e8d21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:42.678724 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 977/1987] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:42 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:00:42.683833 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239fc28-d2a6-4ddf-b728-170f4b6e6cb9 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:42.738635 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab2e56-f24f-435a-8f1c-db55497e8d21 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:42.770446 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239fc28-d2a6-4ddf-b728-170f4b6e6cb9 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:42.777102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87056643-52db-4db0-8931-f84e36036948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:42.777734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87056643-52db-4db0-8931-f84e36036948 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:42.778031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87056643-52db-4db0-8931-f84e36036948 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:42.778410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87056643-52db-4db0-8931-f84e36036948 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:42.779192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87056643-52db-4db0-8931-f84e36036948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:42.781219 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87056643-52db-4db0-8931-f84e36036948 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:42.814804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e35962-2903-40a5-841d-82a120939adb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:42.815033 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:42.815637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35962-2903-40a5-841d-82a120939adb service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:42.815926 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35962-2903-40a5-841d-82a120939adb service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:42.816211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e35962-2903-40a5-841d-82a120939adb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:42.818677 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e6e35962-2903-40a5-841d-82a120939adb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:42.878187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e35962-2903-40a5-841d-82a120939adb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:42.879703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e35962-2903-40a5-841d-82a120939adb service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:42.889166 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1011/1988] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:00:42.942236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 978/1989] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:42 2022] POST /identity/v3/users => generated 295 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:42.947614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e35962-2903-40a5-841d-82a120939adb service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:42.959853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e35962-2903-40a5-841d-82a120939adb service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:42.965229 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689e396-c07a-4184-8342-d2f56353bf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:42.965957 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689e396-c07a-4184-8342-d2f56353bf43 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:42.966194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689e396-c07a-4184-8342-d2f56353bf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:42.966512 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689e396-c07a-4184-8342-d2f56353bf43 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:42.967249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689e396-c07a-4184-8342-d2f56353bf43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:42.969039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689e396-c07a-4184-8342-d2f56353bf43 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:42.981681 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1012/1990] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:42.985670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87056643-52db-4db0-8931-f84e36036948 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:43.000180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87056643-52db-4db0-8931-f84e36036948 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:43.006694 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932898e8-35e7-4b1b-ac2b-867c40eb6c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:43.007637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932898e8-35e7-4b1b-ac2b-867c40eb6c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:43.007995 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932898e8-35e7-4b1b-ac2b-867c40eb6c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:43.008154 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932898e8-35e7-4b1b-ac2b-867c40eb6c8c admin admin] PATH_INFO: `/v3/projects/7e30b3111d4e4f3481e26570a62379ea/users/1144cf39b3784abe97b57057e3bb126d/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:43.030651 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932898e8-35e7-4b1b-ac2b-867c40eb6c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e30b3111d4e4f3481e26570a62379ea, user_id=1144cf39b3784abe97b57057e3bb126d, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:43.034691 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932898e8-35e7-4b1b-ac2b-867c40eb6c8c admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:43.046220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689e396-c07a-4184-8342-d2f56353bf43 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:43.048395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5689e396-c07a-4184-8342-d2f56353bf43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:43.063800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689e396-c07a-4184-8342-d2f56353bf43 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:43.069812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac9b21-8fb4-4df5-8109-7ddfc02e4741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:43.071546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac9b21-8fb4-4df5-8109-7ddfc02e4741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:43.071943 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac9b21-8fb4-4df5-8109-7ddfc02e4741 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:43.072327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac9b21-8fb4-4df5-8109-7ddfc02e4741 admin admin] PATH_INFO: `/v3/users/387d44d2bf164072897de8a791bf7af1` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:43.074134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac9b21-8fb4-4df5-8109-7ddfc02e4741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=387d44d2bf164072897de8a791bf7af1)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:43.078830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac9b21-8fb4-4df5-8109-7ddfc02e4741 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:43.135773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 979/1991] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:42 2022] PUT /identity/v3/projects/7e30b3111d4e4f3481e26570a62379ea/users/1144cf39b3784abe97b57057e3bb126d/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:43.139665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932898e8-35e7-4b1b-ac2b-867c40eb6c8c admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:43.203513 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932898e8-35e7-4b1b-ac2b-867c40eb6c8c admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:43.210425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40171742-abc4-4240-a31d-533e69f6fb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:43.210425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40171742-abc4-4240-a31d-533e69f6fb31 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:43.210425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40171742-abc4-4240-a31d-533e69f6fb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:43.210425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40171742-abc4-4240-a31d-533e69f6fb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:43.211481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40171742-abc4-4240-a31d-533e69f6fb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:43.213029 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40171742-abc4-4240-a31d-533e69f6fb31 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:43.224996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 980/1992] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:00:43.227570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40171742-abc4-4240-a31d-533e69f6fb31 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:43.229295 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-40171742-abc4-4240-a31d-533e69f6fb31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:43.246046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40171742-abc4-4240-a31d-533e69f6fb31 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:43.252811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b7a69-0d83-48b3-a6b2-2bd4277ae417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:43.253744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7a69-0d83-48b3-a6b2-2bd4277ae417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:43.254055 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7a69-0d83-48b3-a6b2-2bd4277ae417 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:43.254357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7a69-0d83-48b3-a6b2-2bd4277ae417 admin admin] PATH_INFO: `/v3/projects/dc204e5f55344e23ac0bfeca5baf70e5` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:43.255630 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b7a69-0d83-48b3-a6b2-2bd4277ae417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc204e5f55344e23ac0bfeca5baf70e5)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:43.257857 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b7a69-0d83-48b3-a6b2-2bd4277ae417 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:43.289067 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-0dac9b21-8fb4-4df5-8109-7ddfc02e4741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387d44d2bf164072897de8a791bf7af1'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:43.564558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-0dac9b21-8fb4-4df5-8109-7ddfc02e4741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387d44d2bf164072897de8a791bf7af1'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:43.565500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-0dac9b21-8fb4-4df5-8109-7ddfc02e4741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387d44d2bf164072897de8a791bf7af1'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:43.576852 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-0dac9b21-8fb4-4df5-8109-7ddfc02e4741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387d44d2bf164072897de8a791bf7af1'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:43.591413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-d27b7a69-0d83-48b3-a6b2-2bd4277ae417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc204e5f55344e23ac0bfeca5baf70e5', 'request_id': 'req-d27b7a69-0d83-48b3-a6b2-2bd4277ae417'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:43.603108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-0dac9b21-8fb4-4df5-8109-7ddfc02e4741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387d44d2bf164072897de8a791bf7af1'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:43.610038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1013/1993] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:43 2022] DELETE /identity/v3/users/387d44d2bf164072897de8a791bf7af1 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:43.610946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac9b21-8fb4-4df5-8109-7ddfc02e4741 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:43.612230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-0dac9b21-8fb4-4df5-8109-7ddfc02e4741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:43.681255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac9b21-8fb4-4df5-8109-7ddfc02e4741 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:43.687536 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fefee6-0bec-4c01-8b05-182ee72adb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:43.687536 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fefee6-0bec-4c01-8b05-182ee72adb6d admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:43.687536 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fefee6-0bec-4c01-8b05-182ee72adb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:43.687536 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fefee6-0bec-4c01-8b05-182ee72adb6d admin admin] PATH_INFO: `/v3/projects/7e30b3111d4e4f3481e26570a62379ea/users/1144cf39b3784abe97b57057e3bb126d/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:43.695841 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fefee6-0bec-4c01-8b05-182ee72adb6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e30b3111d4e4f3481e26570a62379ea, user_id=1144cf39b3784abe97b57057e3bb126d, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:43.698561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fefee6-0bec-4c01-8b05-182ee72adb6d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:43.711455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1014/1994] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:43 2022] PUT /identity/v3/projects/7e30b3111d4e4f3481e26570a62379ea/users/1144cf39b3784abe97b57057e3bb126d/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:43.712964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec5997-a593-48a8-8b4b-3750b0604cfa None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:43.713943 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec5997-a593-48a8-8b4b-3750b0604cfa None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:43.714500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec5997-a593-48a8-8b4b-3750b0604cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:43.727528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-d27b7a69-0d83-48b3-a6b2-2bd4277ae417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc204e5f55344e23ac0bfeca5baf70e5', 'request_id': 'req-d27b7a69-0d83-48b3-a6b2-2bd4277ae417'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:43.761836 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-d27b7a69-0d83-48b3-a6b2-2bd4277ae417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc204e5f55344e23ac0bfeca5baf70e5', 'request_id': 'req-d27b7a69-0d83-48b3-a6b2-2bd4277ae417'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:43.778719 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-d27b7a69-0d83-48b3-a6b2-2bd4277ae417 admin admin] The token cache is being invalidate because project dc204e5f55344e23ac0bfeca5baf70e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:43.779613 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-d27b7a69-0d83-48b3-a6b2-2bd4277ae417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:43.781991 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-89ec5997-a593-48a8-8b4b-3750b0604cfa None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:43.782507 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-d27b7a69-0d83-48b3-a6b2-2bd4277ae417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:43.784095 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-89ec5997-a593-48a8-8b4b-3750b0604cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:43.785762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 981/1995] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:43 2022] DELETE /identity/v3/projects/dc204e5f55344e23ac0bfeca5baf70e5 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:43.788746 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e62895-daba-4d74-baa1-b53e9b5d9855 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:43.790867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e62895-daba-4d74-baa1-b53e9b5d9855 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:43.790867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e62895-daba-4d74-baa1-b53e9b5d9855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:43.823983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-34e62895-daba-4d74-baa1-b53e9b5d9855 None None] MFA Rules not processed for user `1144cf39b3784abe97b57057e3bb126d`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:43.825570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-34e62895-daba-4d74-baa1-b53e9b5d9855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:43.871289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1015/1996] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:43.872293 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec5997-a593-48a8-8b4b-3750b0604cfa None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:43.881936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-89ec5997-a593-48a8-8b4b-3750b0604cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:43.896505 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec5997-a593-48a8-8b4b-3750b0604cfa None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:43.913808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a9294-cd04-417c-9106-144ec4b634e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:43.914898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a9294-cd04-417c-9106-144ec4b634e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:43.915138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a9294-cd04-417c-9106-144ec4b634e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:43.915424 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a9294-cd04-417c-9106-144ec4b634e8 admin admin] PATH_INFO: `/v3/users/0e70131ee0b647c1b4a02a9114b68252` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:43.916727 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a9294-cd04-417c-9106-144ec4b634e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e70131ee0b647c1b4a02a9114b68252)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:43.918742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a9294-cd04-417c-9106-144ec4b634e8 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:43.938214 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 982/1997] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:43.939429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e62895-daba-4d74-baa1-b53e9b5d9855 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:43.941970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-34e62895-daba-4d74-baa1-b53e9b5d9855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:44.019246 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e62895-daba-4d74-baa1-b53e9b5d9855 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:44.027208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324ded6-9e11-49ea-92bb-a161a4a41666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:44.027208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324ded6-9e11-49ea-92bb-a161a4a41666 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:44.027208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324ded6-9e11-49ea-92bb-a161a4a41666 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:44.027208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324ded6-9e11-49ea-92bb-a161a4a41666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:44.038183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324ded6-9e11-49ea-92bb-a161a4a41666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:44.039797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324ded6-9e11-49ea-92bb-a161a4a41666 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:44.055156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 983/1998] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:44.060766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324ded6-9e11-49ea-92bb-a161a4a41666 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:44.060766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e324ded6-9e11-49ea-92bb-a161a4a41666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:44.121731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324ded6-9e11-49ea-92bb-a161a4a41666 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:44.125748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bf3d1-0095-47a6-8903-a7b451dfc05c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:44.126408 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bf3d1-0095-47a6-8903-a7b451dfc05c service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:44.126805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bf3d1-0095-47a6-8903-a7b451dfc05c service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:44.126970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0bf3d1-0095-47a6-8903-a7b451dfc05c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:44.128930 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4d0bf3d1-0095-47a6-8903-a7b451dfc05c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:44.179306 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-5b4a9294-cd04-417c-9106-144ec4b634e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e70131ee0b647c1b4a02a9114b68252'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:44.192251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bf3d1-0095-47a6-8903-a7b451dfc05c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:44.193731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0bf3d1-0095-47a6-8903-a7b451dfc05c service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:44.202762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 984/1999] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:44.233878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-5b4a9294-cd04-417c-9106-144ec4b634e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e70131ee0b647c1b4a02a9114b68252'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:44.234550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-5b4a9294-cd04-417c-9106-144ec4b634e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e70131ee0b647c1b4a02a9114b68252'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:44.253469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-5b4a9294-cd04-417c-9106-144ec4b634e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e70131ee0b647c1b4a02a9114b68252'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:44.279265 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-5b4a9294-cd04-417c-9106-144ec4b634e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e70131ee0b647c1b4a02a9114b68252'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:44.289023 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1016/2000] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:43 2022] DELETE /identity/v3/users/0e70131ee0b647c1b4a02a9114b68252 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:44.571231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bf3d1-0095-47a6-8903-a7b451dfc05c service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:44.573085 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4d0bf3d1-0095-47a6-8903-a7b451dfc05c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:44.605720 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0bf3d1-0095-47a6-8903-a7b451dfc05c service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:44.688164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd89bd-e5a3-42ed-904f-1e8435f2e260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:44.689037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd89bd-e5a3-42ed-904f-1e8435f2e260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:44.689322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd89bd-e5a3-42ed-904f-1e8435f2e260 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:44.689604 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd89bd-e5a3-42ed-904f-1e8435f2e260 admin admin] PATH_INFO: `/v3/projects/50302481979e40a597945973b1e01835` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:44.690815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd89bd-e5a3-42ed-904f-1e8435f2e260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50302481979e40a597945973b1e01835)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:44.693321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd89bd-e5a3-42ed-904f-1e8435f2e260 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:44.820083 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:44.825020 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a9294-cd04-417c-9106-144ec4b634e8 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:44.827104 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5b4a9294-cd04-417c-9106-144ec4b634e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:44.844864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a9294-cd04-417c-9106-144ec4b634e8 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:44.847157 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-42bd89bd-e5a3-42ed-904f-1e8435f2e260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50302481979e40a597945973b1e01835', 'request_id': 'req-42bd89bd-e5a3-42ed-904f-1e8435f2e260'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:44.913593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa6157-3bab-4fc3-8258-dfd852a4c884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:44.914677 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa6157-3bab-4fc3-8258-dfd852a4c884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:44.914969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa6157-3bab-4fc3-8258-dfd852a4c884 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:44.915248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa6157-3bab-4fc3-8258-dfd852a4c884 admin admin] PATH_INFO: `/v3/projects/83a5c248735f468cbf7117f9324825cc` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:44.916509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa6157-3bab-4fc3-8258-dfd852a4c884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a5c248735f468cbf7117f9324825cc)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:44.918471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa6157-3bab-4fc3-8258-dfd852a4c884 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:44.940623 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-42bd89bd-e5a3-42ed-904f-1e8435f2e260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50302481979e40a597945973b1e01835', 'request_id': 'req-42bd89bd-e5a3-42ed-904f-1e8435f2e260'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:44.949872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-42bd89bd-e5a3-42ed-904f-1e8435f2e260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50302481979e40a597945973b1e01835', 'request_id': 'req-42bd89bd-e5a3-42ed-904f-1e8435f2e260'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:44.960999 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-42bd89bd-e5a3-42ed-904f-1e8435f2e260 admin admin] The token cache is being invalidate because project 50302481979e40a597945973b1e01835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:44.961291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-42bd89bd-e5a3-42ed-904f-1e8435f2e260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:44.961943 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-42bd89bd-e5a3-42ed-904f-1e8435f2e260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:44.963669 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 985/2001] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:44 2022] DELETE /identity/v3/projects/50302481979e40a597945973b1e01835 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:44.967352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd89bd-e5a3-42ed-904f-1e8435f2e260 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:44.968624 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-42bd89bd-e5a3-42ed-904f-1e8435f2e260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:44.981217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd89bd-e5a3-42ed-904f-1e8435f2e260 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:44.985732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45c8d2-126b-4de8-b342-4414ab9fb325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:44.986690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45c8d2-126b-4de8-b342-4414ab9fb325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:44.986984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45c8d2-126b-4de8-b342-4414ab9fb325 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:44.987258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45c8d2-126b-4de8-b342-4414ab9fb325 admin admin] PATH_INFO: `/v3/users/3b078e3631cf49f8b3672cd796163ae0` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:44.988438 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45c8d2-126b-4de8-b342-4414ab9fb325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b078e3631cf49f8b3672cd796163ae0)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:44.991061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45c8d2-126b-4de8-b342-4414ab9fb325 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:45.051649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7faa6157-3bab-4fc3-8258-dfd852a4c884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a5c248735f468cbf7117f9324825cc', 'request_id': 'req-7faa6157-3bab-4fc3-8258-dfd852a4c884'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:45.058331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7faa6157-3bab-4fc3-8258-dfd852a4c884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a5c248735f468cbf7117f9324825cc', 'request_id': 'req-7faa6157-3bab-4fc3-8258-dfd852a4c884'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:45.064231 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7faa6157-3bab-4fc3-8258-dfd852a4c884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a5c248735f468cbf7117f9324825cc', 'request_id': 'req-7faa6157-3bab-4fc3-8258-dfd852a4c884'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:45.204149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7faa6157-3bab-4fc3-8258-dfd852a4c884 admin admin] The token cache is being invalidate because project 83a5c248735f468cbf7117f9324825cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:45.212582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7faa6157-3bab-4fc3-8258-dfd852a4c884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:45.212582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7faa6157-3bab-4fc3-8258-dfd852a4c884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:45.212582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1017/2002] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:44 2022] DELETE /identity/v3/projects/83a5c248735f468cbf7117f9324825cc => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:45.213298 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde7976-b2ae-4672-96d6-1593f9aad558 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:45.213604 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde7976-b2ae-4672-96d6-1593f9aad558 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:45.214060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde7976-b2ae-4672-96d6-1593f9aad558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:45.218816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7d45c8d2-126b-4de8-b342-4414ab9fb325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b078e3631cf49f8b3672cd796163ae0'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:45.219540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7d45c8d2-126b-4de8-b342-4414ab9fb325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b078e3631cf49f8b3672cd796163ae0'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:45.235869 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-bdde7976-b2ae-4672-96d6-1593f9aad558 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:45.237083 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-bdde7976-b2ae-4672-96d6-1593f9aad558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:45.295735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1018/2003] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:45.303872 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97416e-a842-4111-b262-7b88e844987a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:45.304162 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97416e-a842-4111-b262-7b88e844987a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:45.304443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97416e-a842-4111-b262-7b88e844987a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:45.319241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7d45c8d2-126b-4de8-b342-4414ab9fb325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b078e3631cf49f8b3672cd796163ae0'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:45.322535 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:45.332583 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-2f97416e-a842-4111-b262-7b88e844987a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:45.334036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2f97416e-a842-4111-b262-7b88e844987a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:45.345794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1019/2004] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:45.352618 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97416e-a842-4111-b262-7b88e844987a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:45.355664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7d45c8d2-126b-4de8-b342-4414ab9fb325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b078e3631cf49f8b3672cd796163ae0'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:45.363187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97416e-a842-4111-b262-7b88e844987a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:45.363870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7d45c8d2-126b-4de8-b342-4414ab9fb325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b078e3631cf49f8b3672cd796163ae0'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:45.369317 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70635908-bb05-4f04-bec2-513fb291ca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:45.369993 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70635908-bb05-4f04-bec2-513fb291ca07 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:45.370282 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70635908-bb05-4f04-bec2-513fb291ca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:45.370754 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70635908-bb05-4f04-bec2-513fb291ca07 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:45.371123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 986/2005] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:44 2022] DELETE /identity/v3/users/3b078e3631cf49f8b3672cd796163ae0 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:00:45.372112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70635908-bb05-4f04-bec2-513fb291ca07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:45.372348 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70635908-bb05-4f04-bec2-513fb291ca07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:45.381587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70635908-bb05-4f04-bec2-513fb291ca07 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:45.395012 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1020/2006] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 20:00:45.400202 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45c8d2-126b-4de8-b342-4414ab9fb325 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:45.402075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-7d45c8d2-126b-4de8-b342-4414ab9fb325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:45.475487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45c8d2-126b-4de8-b342-4414ab9fb325 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:45.485561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff26a7e-32db-4c6b-9894-47cff829a20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:45.486757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff26a7e-32db-4c6b-9894-47cff829a20b admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:45.487228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff26a7e-32db-4c6b-9894-47cff829a20b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:45.487826 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff26a7e-32db-4c6b-9894-47cff829a20b admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:45.488785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff26a7e-32db-4c6b-9894-47cff829a20b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:45.491883 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff26a7e-32db-4c6b-9894-47cff829a20b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:45.582834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 987/2007] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:45 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:45.587616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70635908-bb05-4f04-bec2-513fb291ca07 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:45.599323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70635908-bb05-4f04-bec2-513fb291ca07 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:45.659208 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d7da7-0d83-48d2-867d-8a9b2187d1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:45.660007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d7da7-0d83-48d2-867d-8a9b2187d1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:45.660297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d7da7-0d83-48d2-867d-8a9b2187d1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:45.660588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d7da7-0d83-48d2-867d-8a9b2187d1d5 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:45.661281 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d7da7-0d83-48d2-867d-8a9b2187d1d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:45.663374 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d7da7-0d83-48d2-867d-8a9b2187d1d5 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:45.779831 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1021/2008] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:45 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:45.783741 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff26a7e-32db-4c6b-9894-47cff829a20b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:45.796221 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff26a7e-32db-4c6b-9894-47cff829a20b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:45.801860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b5c80-b74e-4dcc-bd4c-382b0f5f322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:45.803231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b5c80-b74e-4dcc-bd4c-382b0f5f322e admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:45.803608 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b5c80-b74e-4dcc-bd4c-382b0f5f322e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:45.804041 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b5c80-b74e-4dcc-bd4c-382b0f5f322e admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:45.805767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b5c80-b74e-4dcc-bd4c-382b0f5f322e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:45.808781 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b5c80-b74e-4dcc-bd4c-382b0f5f322e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:45.822569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 988/2009] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:00:45.826599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d7da7-0d83-48d2-867d-8a9b2187d1d5 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:45.838382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d7da7-0d83-48d2-867d-8a9b2187d1d5 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:45.843951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c2be5-87c9-4eff-b780-29bfdefd0c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:45.848416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c2be5-87c9-4eff-b780-29bfdefd0c8a admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:45.848416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c2be5-87c9-4eff-b780-29bfdefd0c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:45.848416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c2be5-87c9-4eff-b780-29bfdefd0c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:45.848416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c2be5-87c9-4eff-b780-29bfdefd0c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:45.848416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c2be5-87c9-4eff-b780-29bfdefd0c8a admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:45.859765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1022/2010] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:00:45.863744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b5c80-b74e-4dcc-bd4c-382b0f5f322e admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:45.876546 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b5c80-b74e-4dcc-bd4c-382b0f5f322e admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:45.883177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b3824-1465-4296-8aa1-6ec45df626af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:45.885791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b3824-1465-4296-8aa1-6ec45df626af admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:45.885791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b3824-1465-4296-8aa1-6ec45df626af admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:45.885791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b3824-1465-4296-8aa1-6ec45df626af admin admin] PATH_INFO: `/v3/projects/8f86091779d042beb54783fc6d6d5b9a/users/ba7083a82ac04c4990400495f1cec0c5/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:45.902722 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b3824-1465-4296-8aa1-6ec45df626af admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f86091779d042beb54783fc6d6d5b9a, user_id=ba7083a82ac04c4990400495f1cec0c5, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:45.905417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b3824-1465-4296-8aa1-6ec45df626af admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:46.005200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c2be5-87c9-4eff-b780-29bfdefd0c8a admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:46.008195 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-eb8c2be5-87c9-4eff-b780-29bfdefd0c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:46.012645 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 989/2011] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:45 2022] PUT /identity/v3/projects/8f86091779d042beb54783fc6d6d5b9a/users/ba7083a82ac04c4990400495f1cec0c5/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:46.022949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017451c-d3b2-482d-88ca-0506862b8c75 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:46.023467 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017451c-d3b2-482d-88ca-0506862b8c75 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:46.023766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017451c-d3b2-482d-88ca-0506862b8c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:46.024914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c2be5-87c9-4eff-b780-29bfdefd0c8a admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:46.057256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-c017451c-d3b2-482d-88ca-0506862b8c75 None None] MFA Rules not processed for user `ba7083a82ac04c4990400495f1cec0c5`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:46.058856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c017451c-d3b2-482d-88ca-0506862b8c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:46.092915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:46.093773 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:46.094065 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:46.094366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51 admin admin] PATH_INFO: `/v3/projects/209049e64e2640c6afcff0807fbfd146` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:46.095639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209049e64e2640c6afcff0807fbfd146)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:46.097598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:46.133194 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 990/2012] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:46.134665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0873e-4f47-4692-873c-dd8bcaf6485a None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:46.134967 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0873e-4f47-4692-873c-dd8bcaf6485a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:46.135257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0873e-4f47-4692-873c-dd8bcaf6485a None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:46.136660 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 991/2013] 10.222.0.15 () {54 vars in 921 bytes} [Fri May 27 20:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 20:00:46.137423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0873e-4f47-4692-873c-dd8bcaf6485a None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:46.151609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0873e-4f47-4692-873c-dd8bcaf6485a None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:46.156401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965ce81-ea38-4bd9-9917-a405d660a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:46.157793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965ce81-ea38-4bd9-9917-a405d660a848 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:46.158087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965ce81-ea38-4bd9-9917-a405d660a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:46.158393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965ce81-ea38-4bd9-9917-a405d660a848 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:46.159113 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965ce81-ea38-4bd9-9917-a405d660a848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:46.161048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965ce81-ea38-4bd9-9917-a405d660a848 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:46.245124 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209049e64e2640c6afcff0807fbfd146', 'request_id': 'req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:46.251791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209049e64e2640c6afcff0807fbfd146', 'request_id': 'req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:46.258996 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209049e64e2640c6afcff0807fbfd146', 'request_id': 'req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:46.270810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 992/2014] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:46 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:46.270810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2ff44-b67a-4dfb-a673-303423b0edfb None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:46.270810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2ff44-b67a-4dfb-a673-303423b0edfb None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:46.270810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2ff44-b67a-4dfb-a673-303423b0edfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:46.292317 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b7f2ff44-b67a-4dfb-a673-303423b0edfb None None] MFA Rules not processed for user `394b43cef91f4990b4707cb7a6798068`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:46.293731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b7f2ff44-b67a-4dfb-a673-303423b0edfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:46.360360 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 993/2015] 10.222.0.15 () {58 vars in 1018 bytes} [Fri May 27 20:00:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:46.361370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2ff44-b67a-4dfb-a673-303423b0edfb None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:46.429528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2ff44-b67a-4dfb-a673-303423b0edfb None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:46.430300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51 admin admin] The token cache is being invalidate because project 209049e64e2640c6afcff0807fbfd146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:46.433312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:46.434004 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:46.434296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd0c32-b515-4095-b22a-4316ab34e779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:46.435008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd0c32-b515-4095-b22a-4316ab34e779 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:46.435298 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd0c32-b515-4095-b22a-4316ab34e779 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:46.435580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd0c32-b515-4095-b22a-4316ab34e779 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:46.436277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd0c32-b515-4095-b22a-4316ab34e779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:46.436782 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1023/2016] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:46 2022] DELETE /identity/v3/projects/209049e64e2640c6afcff0807fbfd146 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:46.440032 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd0c32-b515-4095-b22a-4316ab34e779 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:46.441316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:46.443061 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:46.513817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c5d8f-2fd1-45aa-93b8-512cf6a07a51 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:46.518689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812343d-b348-41c9-9cf9-ece076c60837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:46.519578 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812343d-b348-41c9-9cf9-ece076c60837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:46.519866 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812343d-b348-41c9-9cf9-ece076c60837 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:46.520149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812343d-b348-41c9-9cf9-ece076c60837 admin admin] PATH_INFO: `/v3/users/a611257ac46548a89b9a0d37b282bcf0` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:46.522907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812343d-b348-41c9-9cf9-ece076c60837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a611257ac46548a89b9a0d37b282bcf0)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:46.526227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812343d-b348-41c9-9cf9-ece076c60837 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:46.566258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 994/2017] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:46 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:46.566258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd0c32-b515-4095-b22a-4316ab34e779 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:46.569429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c2bd0c32-b515-4095-b22a-4316ab34e779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:46.583993 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd0c32-b515-4095-b22a-4316ab34e779 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:46.593586 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee6913-0e52-4afe-9f8d-a72ee0af474c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394b43cef91f4990b4707cb7a6798068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:46.594244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee6913-0e52-4afe-9f8d-a72ee0af474c service placement] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:46.594589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee6913-0e52-4afe-9f8d-a72ee0af474c service placement] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:46.594877 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee6913-0e52-4afe-9f8d-a72ee0af474c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:46.596884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-a7ee6913-0e52-4afe-9f8d-a72ee0af474c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:46.609229 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee6913-0e52-4afe-9f8d-a72ee0af474c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:46.610263 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee6913-0e52-4afe-9f8d-a72ee0af474c service placement] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:46.620915 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 995/2018] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:46.622331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67d9b2-9f26-4c48-9d9f-dee067e88399 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:46.622657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67d9b2-9f26-4c48-9d9f-dee067e88399 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:46.622970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67d9b2-9f26-4c48-9d9f-dee067e88399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:46.649876 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-6f67d9b2-9f26-4c48-9d9f-dee067e88399 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:46.650590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-6f67d9b2-9f26-4c48-9d9f-dee067e88399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:46.661910 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 996/2019] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:46.662819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67d9b2-9f26-4c48-9d9f-dee067e88399 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:46.669167 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-6f67d9b2-9f26-4c48-9d9f-dee067e88399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:46.716899 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3812343d-b348-41c9-9cf9-ece076c60837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a611257ac46548a89b9a0d37b282bcf0'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:46.726931 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67d9b2-9f26-4c48-9d9f-dee067e88399 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:46.730580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83b272-88df-4a57-8d37-b9ee38236f8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:46.731232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83b272-88df-4a57-8d37-b9ee38236f8c service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:46.731649 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83b272-88df-4a57-8d37-b9ee38236f8c service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:46.731930 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83b272-88df-4a57-8d37-b9ee38236f8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:46.733735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-5d83b272-88df-4a57-8d37-b9ee38236f8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:46.796553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3812343d-b348-41c9-9cf9-ece076c60837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a611257ac46548a89b9a0d37b282bcf0'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:46.796817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83b272-88df-4a57-8d37-b9ee38236f8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:46.797833 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3812343d-b348-41c9-9cf9-ece076c60837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a611257ac46548a89b9a0d37b282bcf0'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:46.798143 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83b272-88df-4a57-8d37-b9ee38236f8c service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:46.809362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 997/2020] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:46.810209 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83b272-88df-4a57-8d37-b9ee38236f8c service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:46.810646 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3812343d-b348-41c9-9cf9-ece076c60837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a611257ac46548a89b9a0d37b282bcf0'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:46.811712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-5d83b272-88df-4a57-8d37-b9ee38236f8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:46.825256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3812343d-b348-41c9-9cf9-ece076c60837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a611257ac46548a89b9a0d37b282bcf0'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:46.827642 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83b272-88df-4a57-8d37-b9ee38236f8c service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:46.832662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1024/2021] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:46 2022] DELETE /identity/v3/users/a611257ac46548a89b9a0d37b282bcf0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:46.833230 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce2306-c985-4e36-97a5-abded27980c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:46.833917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce2306-c985-4e36-97a5-abded27980c9 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:46.834210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce2306-c985-4e36-97a5-abded27980c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:46.834530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce2306-c985-4e36-97a5-abded27980c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:46.834899 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c2db3-8574-41c9-84ae-b653b5c0fe02 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:46.835269 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce2306-c985-4e36-97a5-abded27980c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:46.835515 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c2db3-8574-41c9-84ae-b653b5c0fe02 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:46.835963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c2db3-8574-41c9-84ae-b653b5c0fe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:46.840790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce2306-c985-4e36-97a5-abded27980c9 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:46.857158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 998/2022] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:46.859537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-345c2db3-8574-41c9-84ae-b653b5c0fe02 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:46.860949 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-345c2db3-8574-41c9-84ae-b653b5c0fe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:46.861652 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce2306-c985-4e36-97a5-abded27980c9 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:46.865126 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-25ce2306-c985-4e36-97a5-abded27980c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:46.920535 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce2306-c985-4e36-97a5-abded27980c9 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:46.933042 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1025/2023] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:46.937308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c2db3-8574-41c9-84ae-b653b5c0fe02 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:46.947470 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c2db3-8574-41c9-84ae-b653b5c0fe02 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:46.953112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec92dae-2f04-4b74-8a83-0015fac3c2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:46.953871 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec92dae-2f04-4b74-8a83-0015fac3c2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:46.954161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec92dae-2f04-4b74-8a83-0015fac3c2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:46.954477 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec92dae-2f04-4b74-8a83-0015fac3c2b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:46.955212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec92dae-2f04-4b74-8a83-0015fac3c2b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:46.955519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec92dae-2f04-4b74-8a83-0015fac3c2b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:46.957287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec92dae-2f04-4b74-8a83-0015fac3c2b1 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:46.970543 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1026/2024] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 20:00:46.974900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec92dae-2f04-4b74-8a83-0015fac3c2b1 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:46.985153 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec92dae-2f04-4b74-8a83-0015fac3c2b1 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:46.992074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d5bc5-64f1-4279-b039-adda0f8039bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:46.992743 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d5bc5-64f1-4279-b039-adda0f8039bb admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:46.993043 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d5bc5-64f1-4279-b039-adda0f8039bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:46.993374 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d5bc5-64f1-4279-b039-adda0f8039bb admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:46.994084 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d5bc5-64f1-4279-b039-adda0f8039bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:46.996055 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d5bc5-64f1-4279-b039-adda0f8039bb admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:46.996895 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb16f48-8096-4272-a65e-5a22863cdef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:46.998044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb16f48-8096-4272-a65e-5a22863cdef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:46.998458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb16f48-8096-4272-a65e-5a22863cdef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:46.998805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb16f48-8096-4272-a65e-5a22863cdef7 admin admin] PATH_INFO: `/v3/projects/e7ca8ea7b54548418ffc78f806f6e4f7/users/a4f5934ee7c645b89034645a64faeaa2/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:47.019226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:47.025443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb16f48-8096-4272-a65e-5a22863cdef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ca8ea7b54548418ffc78f806f6e4f7, user_id=a4f5934ee7c645b89034645a64faeaa2, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:47.028750 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb16f48-8096-4272-a65e-5a22863cdef7 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:47.107366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 999/2025] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:46 2022] PUT /identity/v3/projects/e7ca8ea7b54548418ffc78f806f6e4f7/users/a4f5934ee7c645b89034645a64faeaa2/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:00:47.107366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb16f48-8096-4272-a65e-5a22863cdef7 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:47.108126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1027/2026] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:46 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:00:47.109234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d5bc5-64f1-4279-b039-adda0f8039bb admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:47.110946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-3eb16f48-8096-4272-a65e-5a22863cdef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:47.186502 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d5bc5-64f1-4279-b039-adda0f8039bb admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:47.193563 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7cf4a-b39d-49e9-8230-349c3a104e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:47.194597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7cf4a-b39d-49e9-8230-349c3a104e24 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:47.195056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7cf4a-b39d-49e9-8230-349c3a104e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:47.195438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7cf4a-b39d-49e9-8230-349c3a104e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:47.198431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7cf4a-b39d-49e9-8230-349c3a104e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:47.201085 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7cf4a-b39d-49e9-8230-349c3a104e24 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:47.213103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1028/2027] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:47.214059 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7cf4a-b39d-49e9-8230-349c3a104e24 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:47.224200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7cf4a-b39d-49e9-8230-349c3a104e24 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:47.224512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb16f48-8096-4272-a65e-5a22863cdef7 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:47.228833 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2991ba-c7c0-4295-a32a-5c8ea5241c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:47.229119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e2957-0dc2-49b5-bf9f-b102b507470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:47.229495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2991ba-c7c0-4295-a32a-5c8ea5241c98 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:47.229792 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2991ba-c7c0-4295-a32a-5c8ea5241c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:47.229999 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e2957-0dc2-49b5-bf9f-b102b507470c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:47.230099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2991ba-c7c0-4295-a32a-5c8ea5241c98 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:47.230284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e2957-0dc2-49b5-bf9f-b102b507470c admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:47.230610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e2957-0dc2-49b5-bf9f-b102b507470c admin admin] PATH_INFO: `/v3/projects/215b516cde5a40c6acc830b6b15e7638` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:47.230849 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2991ba-c7c0-4295-a32a-5c8ea5241c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:47.231786 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e2957-0dc2-49b5-bf9f-b102b507470c admin admin] RBAC: Authorizing `identity:delete_project(project_id=215b516cde5a40c6acc830b6b15e7638)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:47.232783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2991ba-c7c0-4295-a32a-5c8ea5241c98 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:47.234271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e2957-0dc2-49b5-bf9f-b102b507470c admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:47.357522 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1029/2028] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:47 2022] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:47.358365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2991ba-c7c0-4295-a32a-5c8ea5241c98 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:47.371529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2991ba-c7c0-4295-a32a-5c8ea5241c98 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:47.375533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-0b7e2957-0dc2-49b5-bf9f-b102b507470c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '215b516cde5a40c6acc830b6b15e7638', 'request_id': 'req-0b7e2957-0dc2-49b5-bf9f-b102b507470c'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:47.386924 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:47.433553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d170f-dfa3-411a-870c-d152b08141a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:47.434514 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d170f-dfa3-411a-870c-d152b08141a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:47.434817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d170f-dfa3-411a-870c-d152b08141a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:47.435097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d170f-dfa3-411a-870c-d152b08141a8 admin admin] PATH_INFO: `/v3/projects/e7ca8ea7b54548418ffc78f806f6e4f7/users/a4f5934ee7c645b89034645a64faeaa2/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:47.437370 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d170f-dfa3-411a-870c-d152b08141a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7ca8ea7b54548418ffc78f806f6e4f7, user_id=a4f5934ee7c645b89034645a64faeaa2, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:47.440135 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d170f-dfa3-411a-870c-d152b08141a8 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:47.451454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1030/2029] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:47 2022] PUT /identity/v3/projects/e7ca8ea7b54548418ffc78f806f6e4f7/users/a4f5934ee7c645b89034645a64faeaa2/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:47.452256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d170f-dfa3-411a-870c-d152b08141a8 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:47.521432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d170f-dfa3-411a-870c-d152b08141a8 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:47.526102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75402479-706a-4a92-8081-c5138d8b61e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:47.526818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75402479-706a-4a92-8081-c5138d8b61e9 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:47.527108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75402479-706a-4a92-8081-c5138d8b61e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:47.528268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75402479-706a-4a92-8081-c5138d8b61e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:47.528268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75402479-706a-4a92-8081-c5138d8b61e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:47.529703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75402479-706a-4a92-8081-c5138d8b61e9 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:47.540500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1031/2030] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:47.541812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e0d2d-f6b2-4725-9d28-84ae16cd3803 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:47.542105 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e0d2d-f6b2-4725-9d28-84ae16cd3803 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:47.542575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e0d2d-f6b2-4725-9d28-84ae16cd3803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:47.547870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-0b7e2957-0dc2-49b5-bf9f-b102b507470c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '215b516cde5a40c6acc830b6b15e7638', 'request_id': 'req-0b7e2957-0dc2-49b5-bf9f-b102b507470c'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:47.555683 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-0b7e2957-0dc2-49b5-bf9f-b102b507470c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '215b516cde5a40c6acc830b6b15e7638', 'request_id': 'req-0b7e2957-0dc2-49b5-bf9f-b102b507470c'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:47.572458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-0b7e2957-0dc2-49b5-bf9f-b102b507470c admin admin] The token cache is being invalidate because project 215b516cde5a40c6acc830b6b15e7638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:47.572703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-0b7e2957-0dc2-49b5-bf9f-b102b507470c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:47.573381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-0b7e2957-0dc2-49b5-bf9f-b102b507470c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:47.575446 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1000/2031] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:47 2022] DELETE /identity/v3/projects/215b516cde5a40c6acc830b6b15e7638 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:47.575881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-fd6e0d2d-f6b2-4725-9d28-84ae16cd3803 None None] MFA Rules not processed for user `a4f5934ee7c645b89034645a64faeaa2`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:47.576009 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e2957-0dc2-49b5-bf9f-b102b507470c admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:47.577033 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-fd6e0d2d-f6b2-4725-9d28-84ae16cd3803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:47.577307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-0b7e2957-0dc2-49b5-bf9f-b102b507470c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:47.592349 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e2957-0dc2-49b5-bf9f-b102b507470c admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:47.599720 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f715e4-33b8-4816-ab21-c13a6dee419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:47.600357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f715e4-33b8-4816-ab21-c13a6dee419a admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:47.600643 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f715e4-33b8-4816-ab21-c13a6dee419a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:47.600923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f715e4-33b8-4816-ab21-c13a6dee419a admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:47.601667 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f715e4-33b8-4816-ab21-c13a6dee419a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:47.603510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f715e4-33b8-4816-ab21-c13a6dee419a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:47.615097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1001/2032] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:47.615437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a02b0-8b70-440c-adfa-ce35f66abbf8 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:47.615728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a02b0-8b70-440c-adfa-ce35f66abbf8 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:47.616006 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a02b0-8b70-440c-adfa-ce35f66abbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:47.645176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-df8a02b0-8b70-440c-adfa-ce35f66abbf8 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:47.645176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-df8a02b0-8b70-440c-adfa-ce35f66abbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:47.645176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1002/2033] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:47.645176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a02b0-8b70-440c-adfa-ce35f66abbf8 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:47.652654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1032/2034] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:47.654069 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793c975-03af-450c-9dfe-4ab81b6188ab None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:47.654391 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793c975-03af-450c-9dfe-4ab81b6188ab None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:47.654674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793c975-03af-450c-9dfe-4ab81b6188ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:47.656405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a02b0-8b70-440c-adfa-ce35f66abbf8 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:47.661106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fe120-0152-4968-89f1-6f91b8fea07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:47.662607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fe120-0152-4968-89f1-6f91b8fea07d admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:47.663114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fe120-0152-4968-89f1-6f91b8fea07d admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:47.663383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fe120-0152-4968-89f1-6f91b8fea07d admin admin] PATH_INFO: `/v3/projects/742b1fda3b6842a4aa9aa22def8414e8/users/4096143c8116475e9a929a057914bcd1/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:47.673839 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-3793c975-03af-450c-9dfe-4ab81b6188ab None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:47.675066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-3793c975-03af-450c-9dfe-4ab81b6188ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:47.679092 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fe120-0152-4968-89f1-6f91b8fea07d admin admin] RBAC: Authorizing `identity:create_grant(project_id=742b1fda3b6842a4aa9aa22def8414e8, user_id=4096143c8116475e9a929a057914bcd1, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:47.682026 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fe120-0152-4968-89f1-6f91b8fea07d admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:47.683264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1033/2035] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:47.687275 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793c975-03af-450c-9dfe-4ab81b6188ab None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:47.696908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793c975-03af-450c-9dfe-4ab81b6188ab None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:47.701847 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6297d-d162-409a-90be-f40001507400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:47.702533 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6297d-d162-409a-90be-f40001507400 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:47.702820 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6297d-d162-409a-90be-f40001507400 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:47.703095 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6297d-d162-409a-90be-f40001507400 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:47.703911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6297d-d162-409a-90be-f40001507400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:47.704209 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6297d-d162-409a-90be-f40001507400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:47.705795 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6297d-d162-409a-90be-f40001507400 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:47.717795 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1034/2036] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 20:00:47.722094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6297d-d162-409a-90be-f40001507400 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:47.732017 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6297d-d162-409a-90be-f40001507400 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:47.736657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedba74-2936-4011-9ffa-a27e05579810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:47.737310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedba74-2936-4011-9ffa-a27e05579810 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:47.737605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedba74-2936-4011-9ffa-a27e05579810 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:47.737881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedba74-2936-4011-9ffa-a27e05579810 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:47.738664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedba74-2936-4011-9ffa-a27e05579810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:47.741721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedba74-2936-4011-9ffa-a27e05579810 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:47.780021 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1003/2037] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:47 2022] PUT /identity/v3/projects/742b1fda3b6842a4aa9aa22def8414e8/users/4096143c8116475e9a929a057914bcd1/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:47.780861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fe120-0152-4968-89f1-6f91b8fea07d admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:47.782446 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-ae2fe120-0152-4968-89f1-6f91b8fea07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:47.838325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fe120-0152-4968-89f1-6f91b8fea07d admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:47.842048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedade83-0254-4675-9159-62f8c033d161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:47.842727 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedade83-0254-4675-9159-62f8c033d161 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:47.843008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedade83-0254-4675-9159-62f8c033d161 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:47.843288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedade83-0254-4675-9159-62f8c033d161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:47.845067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-eedade83-0254-4675-9159-62f8c033d161 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:47.896810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1035/2038] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:47 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:00:47.896810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848efcd-dab4-4ee7-bad6-70a04bb2114f None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:47.896810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848efcd-dab4-4ee7-bad6-70a04bb2114f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:47.896810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848efcd-dab4-4ee7-bad6-70a04bb2114f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:47.908226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedade83-0254-4675-9159-62f8c033d161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:47.909688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedade83-0254-4675-9159-62f8c033d161 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:47.918899 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1004/2039] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:47.919688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedade83-0254-4675-9159-62f8c033d161 service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:47.920842 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-f848efcd-dab4-4ee7-bad6-70a04bb2114f None None] MFA Rules not processed for user `4096143c8116475e9a929a057914bcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:47.922059 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f848efcd-dab4-4ee7-bad6-70a04bb2114f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:47.988531 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedade83-0254-4675-9159-62f8c033d161 service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:47.997602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1036/2040] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:47.998879 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848efcd-dab4-4ee7-bad6-70a04bb2114f None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:48.056226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf093b9-3ed3-471a-93c8-a69a55fe33d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:48.057079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf093b9-3ed3-471a-93c8-a69a55fe33d9 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:48.057501 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf093b9-3ed3-471a-93c8-a69a55fe33d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:48.057800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf093b9-3ed3-471a-93c8-a69a55fe33d9 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:48.058535 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf093b9-3ed3-471a-93c8-a69a55fe33d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:48.060511 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf093b9-3ed3-471a-93c8-a69a55fe33d9 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:48.068427 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848efcd-dab4-4ee7-bad6-70a04bb2114f None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:48.073171 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec2c66-b36a-40c5-91c9-61a0ebb3f3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:48.073837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2c66-b36a-40c5-91c9-61a0ebb3f3fe admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:48.074130 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2c66-b36a-40c5-91c9-61a0ebb3f3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:48.074452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec2c66-b36a-40c5-91c9-61a0ebb3f3fe admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:48.075154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec2c66-b36a-40c5-91c9-61a0ebb3f3fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:48.077178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec2c66-b36a-40c5-91c9-61a0ebb3f3fe admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:48.159905 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1005/2041] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:47 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:48.163782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf093b9-3ed3-471a-93c8-a69a55fe33d9 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:48.175265 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf093b9-3ed3-471a-93c8-a69a55fe33d9 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:48.182883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1037/2042] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:47 2022] POST /identity/v3/projects => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:48.183407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a4b5c-cf03-4b39-87ef-c20b9945bcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:48.183806 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec2c66-b36a-40c5-91c9-61a0ebb3f3fe admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:48.184098 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a4b5c-cf03-4b39-87ef-c20b9945bcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:48.184387 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a4b5c-cf03-4b39-87ef-c20b9945bcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:48.184670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a4b5c-cf03-4b39-87ef-c20b9945bcc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:48.185405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a4b5c-cf03-4b39-87ef-c20b9945bcc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:48.187063 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a4b5c-cf03-4b39-87ef-c20b9945bcc9 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:48.202777 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1006/2043] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:00:48.204063 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a4b5c-cf03-4b39-87ef-c20b9945bcc9 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:48.216841 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a4b5c-cf03-4b39-87ef-c20b9945bcc9 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:48.257795 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec2c66-b36a-40c5-91c9-61a0ebb3f3fe admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:48.262680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035316f5-07d9-41db-b5ed-5d3db6a891c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:48.263353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035316f5-07d9-41db-b5ed-5d3db6a891c2 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:48.263639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035316f5-07d9-41db-b5ed-5d3db6a891c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:48.263918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035316f5-07d9-41db-b5ed-5d3db6a891c2 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:48.264616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035316f5-07d9-41db-b5ed-5d3db6a891c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:48.266641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035316f5-07d9-41db-b5ed-5d3db6a891c2 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:48.280181 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ff9bb-7886-4a76-a8fa-0fcbeb6bebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:48.281532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ff9bb-7886-4a76-a8fa-0fcbeb6bebca admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:48.281532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ff9bb-7886-4a76-a8fa-0fcbeb6bebca admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:48.281532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ff9bb-7886-4a76-a8fa-0fcbeb6bebca admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:48.282323 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ff9bb-7886-4a76-a8fa-0fcbeb6bebca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:48.284156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ff9bb-7886-4a76-a8fa-0fcbeb6bebca admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:48.294731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1007/2044] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:48.298905 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ff9bb-7886-4a76-a8fa-0fcbeb6bebca admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:48.308118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ff9bb-7886-4a76-a8fa-0fcbeb6bebca admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:48.312788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143cfe0-45d7-4445-af2d-530a97f6dbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:48.313678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143cfe0-45d7-4445-af2d-530a97f6dbe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:48.315096 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143cfe0-45d7-4445-af2d-530a97f6dbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:48.315096 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143cfe0-45d7-4445-af2d-530a97f6dbe3 admin admin] PATH_INFO: `/v3/projects/1d9842699e1f45c3ae977c835a7ba33b/users/493cdd245a434e4a8476fcff6a7b7ec0/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:48.328805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143cfe0-45d7-4445-af2d-530a97f6dbe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9842699e1f45c3ae977c835a7ba33b, user_id=493cdd245a434e4a8476fcff6a7b7ec0, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:48.331471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6143cfe0-45d7-4445-af2d-530a97f6dbe3 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:48.398429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1038/2045] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:48 2022] POST /identity/v3/users => generated 291 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:48.402552 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035316f5-07d9-41db-b5ed-5d3db6a891c2 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:48.413280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035316f5-07d9-41db-b5ed-5d3db6a891c2 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:48.417834 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b885532-81cc-4010-b116-7fc17eaa491b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:48.418548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b885532-81cc-4010-b116-7fc17eaa491b admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:48.418841 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b885532-81cc-4010-b116-7fc17eaa491b admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:48.419128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b885532-81cc-4010-b116-7fc17eaa491b admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:48.419898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b885532-81cc-4010-b116-7fc17eaa491b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:48.421538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b885532-81cc-4010-b116-7fc17eaa491b admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:48.431956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1039/2046] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:00:48.435942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b885532-81cc-4010-b116-7fc17eaa491b admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:48.446426 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b885532-81cc-4010-b116-7fc17eaa491b admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:48.451919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1008/2047] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:48 2022] PUT /identity/v3/projects/1d9842699e1f45c3ae977c835a7ba33b/users/493cdd245a434e4a8476fcff6a7b7ec0/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:00:48.462642 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58487cf1-d7f7-4941-93f6-35edf48c5c73 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:48.463045 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58487cf1-d7f7-4941-93f6-35edf48c5c73 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:48.463434 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58487cf1-d7f7-4941-93f6-35edf48c5c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:48.516716 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-58487cf1-d7f7-4941-93f6-35edf48c5c73 None None] MFA Rules not processed for user `493cdd245a434e4a8476fcff6a7b7ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:48.518739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-58487cf1-d7f7-4941-93f6-35edf48c5c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:48.526795 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0348eb-6e97-4a99-9e69-42ba98e7e310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:48.528224 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0348eb-6e97-4a99-9e69-42ba98e7e310 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:48.528580 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0348eb-6e97-4a99-9e69-42ba98e7e310 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:48.528937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0348eb-6e97-4a99-9e69-42ba98e7e310 admin admin] PATH_INFO: `/v3/projects/3844c6507b5e4ae6b072fe301c57e271/users/762c120c5d8447d8bec5fe2c1c00acbe/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:48.544653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0348eb-6e97-4a99-9e69-42ba98e7e310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3844c6507b5e4ae6b072fe301c57e271, user_id=762c120c5d8447d8bec5fe2c1c00acbe, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:48.547489 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0348eb-6e97-4a99-9e69-42ba98e7e310 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:48.593014 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1009/2048] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:48.605707 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58487cf1-d7f7-4941-93f6-35edf48c5c73 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:48.607131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-58487cf1-d7f7-4941-93f6-35edf48c5c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:48.664550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1040/2049] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:48 2022] PUT /identity/v3/projects/3844c6507b5e4ae6b072fe301c57e271/users/762c120c5d8447d8bec5fe2c1c00acbe/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:00:48.669035 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0348eb-6e97-4a99-9e69-42ba98e7e310 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:48.683723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58487cf1-d7f7-4941-93f6-35edf48c5c73 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:48.751600 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf781e3-80bc-4250-be2b-ec5c4ef77bd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:48.752360 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf781e3-80bc-4250-be2b-ec5c4ef77bd9 service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:48.752541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf781e3-80bc-4250-be2b-ec5c4ef77bd9 service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:48.752945 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf781e3-80bc-4250-be2b-ec5c4ef77bd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:48.767468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0348eb-6e97-4a99-9e69-42ba98e7e310 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:48.782980 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bac807-e552-4479-8671-f7d4544a91a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:48.783836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bac807-e552-4479-8671-f7d4544a91a9 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:48.784192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bac807-e552-4479-8671-f7d4544a91a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:48.784456 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bac807-e552-4479-8671-f7d4544a91a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:48.785396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bac807-e552-4479-8671-f7d4544a91a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:48.787145 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bac807-e552-4479-8671-f7d4544a91a9 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:48.798660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1041/2050] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:00:48.799525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bac807-e552-4479-8671-f7d4544a91a9 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:48.829082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf781e3-80bc-4250-be2b-ec5c4ef77bd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:48.830991 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf781e3-80bc-4250-be2b-ec5c4ef77bd9 service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:48.841962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1010/2051] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:48.843040 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf781e3-80bc-4250-be2b-ec5c4ef77bd9 service nova] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:48.859893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf781e3-80bc-4250-be2b-ec5c4ef77bd9 service nova] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:48.870812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bac807-e552-4479-8671-f7d4544a91a9 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:48.871684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80dc0c-6815-434c-9755-e63876d0de34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:48.871684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80dc0c-6815-434c-9755-e63876d0de34 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:48.871684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80dc0c-6815-434c-9755-e63876d0de34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:48.871684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80dc0c-6815-434c-9755-e63876d0de34 admin admin] PATH_INFO: `/v3/projects/3844c6507b5e4ae6b072fe301c57e271/users/762c120c5d8447d8bec5fe2c1c00acbe/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:48.872021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57dc93-394b-4773-ae15-5ed25a58705f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:48.872116 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80dc0c-6815-434c-9755-e63876d0de34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3844c6507b5e4ae6b072fe301c57e271, user_id=762c120c5d8447d8bec5fe2c1c00acbe, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:48.872203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57dc93-394b-4773-ae15-5ed25a58705f service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:48.872203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57dc93-394b-4773-ae15-5ed25a58705f service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:48.872203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57dc93-394b-4773-ae15-5ed25a58705f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:48.873696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-cf57dc93-394b-4773-ae15-5ed25a58705f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:48.874000 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80dc0c-6815-434c-9755-e63876d0de34 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:48.890402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1011/2052] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:48 2022] PUT /identity/v3/projects/3844c6507b5e4ae6b072fe301c57e271/users/762c120c5d8447d8bec5fe2c1c00acbe/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:48.900268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615369c7-c725-4407-831c-218abba00898 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:48.900474 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615369c7-c725-4407-831c-218abba00898 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:48.900816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615369c7-c725-4407-831c-218abba00898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:48.933780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-615369c7-c725-4407-831c-218abba00898 None None] MFA Rules not processed for user `762c120c5d8447d8bec5fe2c1c00acbe`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:48.935079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-615369c7-c725-4407-831c-218abba00898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:48.960354 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57dc93-394b-4773-ae15-5ed25a58705f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:48.961770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57dc93-394b-4773-ae15-5ed25a58705f service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:48.972473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1042/2053] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:49.008662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1012/2054] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:48 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:49.152822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57dc93-394b-4773-ae15-5ed25a58705f service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:49.161985 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57dc93-394b-4773-ae15-5ed25a58705f service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:49.211806 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f9891-dd60-47ef-946f-7443e8c99f9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:49.212475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f9891-dd60-47ef-946f-7443e8c99f9e service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:49.212711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f9891-dd60-47ef-946f-7443e8c99f9e service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:49.212996 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f9891-dd60-47ef-946f-7443e8c99f9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:49.222219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f9891-dd60-47ef-946f-7443e8c99f9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:49.223744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f9891-dd60-47ef-946f-7443e8c99f9e service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:49.233391 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1043/2055] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:49 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:49.560008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:50.034685 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615369c7-c725-4407-831c-218abba00898 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:50.044509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615369c7-c725-4407-831c-218abba00898 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:50.048074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c546b-ad38-4510-b445-9c18332043b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:50.048716 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c546b-ad38-4510-b445-9c18332043b3 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:50.049008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c546b-ad38-4510-b445-9c18332043b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:50.049291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c546b-ad38-4510-b445-9c18332043b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:50.106207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c546b-ad38-4510-b445-9c18332043b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:50.107733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c546b-ad38-4510-b445-9c18332043b3 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:50.117400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1013/2056] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:50.260023 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:51.480262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:51.696443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:52.103953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f9891-dd60-47ef-946f-7443e8c99f9e service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:52.105427 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-671f9891-dd60-47ef-946f-7443e8c99f9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:52.188300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f9891-dd60-47ef-946f-7443e8c99f9e service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:52.192985 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbca3a-d99f-4d6f-9a3b-941d7620f25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:52.193862 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbca3a-d99f-4d6f-9a3b-941d7620f25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:52.194165 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbca3a-d99f-4d6f-9a3b-941d7620f25d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:52.194475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbca3a-d99f-4d6f-9a3b-941d7620f25d admin admin] PATH_INFO: `/v3/users/ba7083a82ac04c4990400495f1cec0c5` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:52.195701 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbca3a-d99f-4d6f-9a3b-941d7620f25d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba7083a82ac04c4990400495f1cec0c5)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:52.197643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbca3a-d99f-4d6f-9a3b-941d7620f25d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:52.390749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c546b-ad38-4510-b445-9c18332043b3 service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:52.392256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-417c546b-ad38-4510-b445-9c18332043b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:52.406875 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c546b-ad38-4510-b445-9c18332043b3 service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:52.412137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91cce2-bb5d-4a02-ab38-a62c556919e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:52.412910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-16fbca3a-d99f-4d6f-9a3b-941d7620f25d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba7083a82ac04c4990400495f1cec0c5'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:52.413045 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91cce2-bb5d-4a02-ab38-a62c556919e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:52.413301 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91cce2-bb5d-4a02-ab38-a62c556919e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:52.413581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91cce2-bb5d-4a02-ab38-a62c556919e9 admin admin] PATH_INFO: `/v3/users/f533eecf106341de9c8afe6c13938429` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:52.414880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91cce2-bb5d-4a02-ab38-a62c556919e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f533eecf106341de9c8afe6c13938429)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:52.416928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91cce2-bb5d-4a02-ab38-a62c556919e9 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:52.513191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-16fbca3a-d99f-4d6f-9a3b-941d7620f25d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba7083a82ac04c4990400495f1cec0c5'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:52.513940 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-16fbca3a-d99f-4d6f-9a3b-941d7620f25d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba7083a82ac04c4990400495f1cec0c5'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:52.522552 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-16fbca3a-d99f-4d6f-9a3b-941d7620f25d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba7083a82ac04c4990400495f1cec0c5'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:52.540963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-16fbca3a-d99f-4d6f-9a3b-941d7620f25d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba7083a82ac04c4990400495f1cec0c5'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:52.548715 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:52.550516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1044/2057] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:52 2022] DELETE /identity/v3/users/ba7083a82ac04c4990400495f1cec0c5 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:52.555085 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdd9b5-0a91-4c4e-b109-34447817c753 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:52.555377 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdd9b5-0a91-4c4e-b109-34447817c753 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:52.555659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdd9b5-0a91-4c4e-b109-34447817c753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:52.574841 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-60bdd9b5-0a91-4c4e-b109-34447817c753 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:52.583086 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-60bdd9b5-0a91-4c4e-b109-34447817c753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:52.640524 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1045/2058] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:52.650205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdd9b5-0a91-4c4e-b109-34447817c753 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:52.651599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-60bdd9b5-0a91-4c4e-b109-34447817c753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:52.675590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5a91cce2-bb5d-4a02-ab38-a62c556919e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f533eecf106341de9c8afe6c13938429'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:52.676276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5a91cce2-bb5d-4a02-ab38-a62c556919e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f533eecf106341de9c8afe6c13938429'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:52.710695 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdd9b5-0a91-4c4e-b109-34447817c753 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:52.714545 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a7695-94de-45c0-92c2-bc7df118e94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:52.715192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a7695-94de-45c0-92c2-bc7df118e94e service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:52.715481 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a7695-94de-45c0-92c2-bc7df118e94e service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:52.715761 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a7695-94de-45c0-92c2-bc7df118e94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:52.724820 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a7695-94de-45c0-92c2-bc7df118e94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:52.726281 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a7695-94de-45c0-92c2-bc7df118e94e service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:52.735875 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1046/2059] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:00:52.798551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:52.805048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5a91cce2-bb5d-4a02-ab38-a62c556919e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f533eecf106341de9c8afe6c13938429'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:52.819798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5a91cce2-bb5d-4a02-ab38-a62c556919e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f533eecf106341de9c8afe6c13938429'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:52.828241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5a91cce2-bb5d-4a02-ab38-a62c556919e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f533eecf106341de9c8afe6c13938429'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:52.835291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1014/2060] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:52 2022] DELETE /identity/v3/users/f533eecf106341de9c8afe6c13938429 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:00:52.841975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95b8f4-fc32-4676-84cc-47a0a3bb05f3 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:52.841975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95b8f4-fc32-4676-84cc-47a0a3bb05f3 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:52.841975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95b8f4-fc32-4676-84cc-47a0a3bb05f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:52.859499 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-9b95b8f4-fc32-4676-84cc-47a0a3bb05f3 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:52.860714 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9b95b8f4-fc32-4676-84cc-47a0a3bb05f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:52.923802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1047/2061] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:52.933578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91cce2-bb5d-4a02-ab38-a62c556919e9 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:52.935147 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-5a91cce2-bb5d-4a02-ab38-a62c556919e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:52.999195 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91cce2-bb5d-4a02-ab38-a62c556919e9 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:53.003437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42986279-7cf6-4cd4-bc11-07b9a07d375c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:53.004282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42986279-7cf6-4cd4-bc11-07b9a07d375c service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:53.005146 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42986279-7cf6-4cd4-bc11-07b9a07d375c service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:53.005639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42986279-7cf6-4cd4-bc11-07b9a07d375c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:53.016330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42986279-7cf6-4cd4-bc11-07b9a07d375c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:53.018377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42986279-7cf6-4cd4-bc11-07b9a07d375c service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:53.029501 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1015/2062] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:00:53.215847 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95b8f4-fc32-4676-84cc-47a0a3bb05f3 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:53.217373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9b95b8f4-fc32-4676-84cc-47a0a3bb05f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:53.229310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95b8f4-fc32-4676-84cc-47a0a3bb05f3 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:53.236166 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17caa11-7b23-467a-8ef1-cd7deee11d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:53.237173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17caa11-7b23-467a-8ef1-cd7deee11d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:53.237355 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17caa11-7b23-467a-8ef1-cd7deee11d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:53.237636 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17caa11-7b23-467a-8ef1-cd7deee11d60 admin admin] PATH_INFO: `/v3/users/493cdd245a434e4a8476fcff6a7b7ec0` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:53.238896 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17caa11-7b23-467a-8ef1-cd7deee11d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=493cdd245a434e4a8476fcff6a7b7ec0)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:53.240923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17caa11-7b23-467a-8ef1-cd7deee11d60 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:53.257538 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42986279-7cf6-4cd4-bc11-07b9a07d375c service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:53.259269 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-42986279-7cf6-4cd4-bc11-07b9a07d375c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:53.277031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42986279-7cf6-4cd4-bc11-07b9a07d375c service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:53.284602 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bcd5b-17d3-4bc1-ba1a-5d4541a89402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:53.285659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bcd5b-17d3-4bc1-ba1a-5d4541a89402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:53.286066 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bcd5b-17d3-4bc1-ba1a-5d4541a89402 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:53.286474 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bcd5b-17d3-4bc1-ba1a-5d4541a89402 admin admin] PATH_INFO: `/v3/projects/8f86091779d042beb54783fc6d6d5b9a` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:53.287769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bcd5b-17d3-4bc1-ba1a-5d4541a89402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f86091779d042beb54783fc6d6d5b9a)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:53.290028 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bcd5b-17d3-4bc1-ba1a-5d4541a89402 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:53.558286 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b17caa11-7b23-467a-8ef1-cd7deee11d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '493cdd245a434e4a8476fcff6a7b7ec0'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:53.569905 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-714bcd5b-17d3-4bc1-ba1a-5d4541a89402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f86091779d042beb54783fc6d6d5b9a', 'request_id': 'req-714bcd5b-17d3-4bc1-ba1a-5d4541a89402'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:53.633115 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b17caa11-7b23-467a-8ef1-cd7deee11d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '493cdd245a434e4a8476fcff6a7b7ec0'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:53.633800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b17caa11-7b23-467a-8ef1-cd7deee11d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '493cdd245a434e4a8476fcff6a7b7ec0'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:53.641485 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b17caa11-7b23-467a-8ef1-cd7deee11d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '493cdd245a434e4a8476fcff6a7b7ec0'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:53.653653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b17caa11-7b23-467a-8ef1-cd7deee11d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '493cdd245a434e4a8476fcff6a7b7ec0'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:53.657089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:53.662289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1048/2063] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:53 2022] DELETE /identity/v3/users/493cdd245a434e4a8476fcff6a7b7ec0 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:53.663021 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17caa11-7b23-467a-8ef1-cd7deee11d60 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:53.664439 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b17caa11-7b23-467a-8ef1-cd7deee11d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:53.707326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-714bcd5b-17d3-4bc1-ba1a-5d4541a89402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f86091779d042beb54783fc6d6d5b9a', 'request_id': 'req-714bcd5b-17d3-4bc1-ba1a-5d4541a89402'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:53.714661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-714bcd5b-17d3-4bc1-ba1a-5d4541a89402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f86091779d042beb54783fc6d6d5b9a', 'request_id': 'req-714bcd5b-17d3-4bc1-ba1a-5d4541a89402'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:53.725554 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-714bcd5b-17d3-4bc1-ba1a-5d4541a89402 admin admin] The token cache is being invalidate because project 8f86091779d042beb54783fc6d6d5b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:53.725855 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-714bcd5b-17d3-4bc1-ba1a-5d4541a89402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:53.726544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-714bcd5b-17d3-4bc1-ba1a-5d4541a89402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:53.728095 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1016/2064] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:53 2022] DELETE /identity/v3/projects/8f86091779d042beb54783fc6d6d5b9a => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:53.729420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17caa11-7b23-467a-8ef1-cd7deee11d60 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:53.732352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85869e-575d-42a2-95cc-b98b552ff641 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:53.732645 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85869e-575d-42a2-95cc-b98b552ff641 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:53.732928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85869e-575d-42a2-95cc-b98b552ff641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:53.735254 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b063e3e-2281-4f45-965e-b3ec3f9182a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:53.736162 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b063e3e-2281-4f45-965e-b3ec3f9182a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:53.736457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b063e3e-2281-4f45-965e-b3ec3f9182a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:53.736744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b063e3e-2281-4f45-965e-b3ec3f9182a9 admin admin] PATH_INFO: `/v3/projects/e93bb10d96fd4c53a560bea09f4bd0f4` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:53.737965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b063e3e-2281-4f45-965e-b3ec3f9182a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93bb10d96fd4c53a560bea09f4bd0f4)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:53.740151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b063e3e-2281-4f45-965e-b3ec3f9182a9 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:53.751122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-2d85869e-575d-42a2-95cc-b98b552ff641 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:53.752320 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2d85869e-575d-42a2-95cc-b98b552ff641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:53.761231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1017/2065] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:53.762062 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85869e-575d-42a2-95cc-b98b552ff641 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:53.763424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2d85869e-575d-42a2-95cc-b98b552ff641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:53.776238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85869e-575d-42a2-95cc-b98b552ff641 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:53.780888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4e704-a7d0-4e2e-939a-6a633aea2a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:53.781836 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4e704-a7d0-4e2e-939a-6a633aea2a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:53.782122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4e704-a7d0-4e2e-939a-6a633aea2a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:53.785833 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4e704-a7d0-4e2e-939a-6a633aea2a63 admin admin] PATH_INFO: `/v3/users/a4f5934ee7c645b89034645a64faeaa2` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:53.785833 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4e704-a7d0-4e2e-939a-6a633aea2a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f5934ee7c645b89034645a64faeaa2)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:53.785833 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4e704-a7d0-4e2e-939a-6a633aea2a63 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:53.872835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7b063e3e-2281-4f45-965e-b3ec3f9182a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93bb10d96fd4c53a560bea09f4bd0f4', 'request_id': 'req-7b063e3e-2281-4f45-965e-b3ec3f9182a9'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:53.879090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7b063e3e-2281-4f45-965e-b3ec3f9182a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93bb10d96fd4c53a560bea09f4bd0f4', 'request_id': 'req-7b063e3e-2281-4f45-965e-b3ec3f9182a9'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:53.884998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7b063e3e-2281-4f45-965e-b3ec3f9182a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93bb10d96fd4c53a560bea09f4bd0f4', 'request_id': 'req-7b063e3e-2281-4f45-965e-b3ec3f9182a9'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:53.898457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:53.952056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7b063e3e-2281-4f45-965e-b3ec3f9182a9 admin admin] The token cache is being invalidate because project e93bb10d96fd4c53a560bea09f4bd0f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:53.952350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7b063e3e-2281-4f45-965e-b3ec3f9182a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:53.953043 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-7b063e3e-2281-4f45-965e-b3ec3f9182a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:53.954672 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1049/2066] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:53 2022] DELETE /identity/v3/projects/e93bb10d96fd4c53a560bea09f4bd0f4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:53.955427 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b063e3e-2281-4f45-965e-b3ec3f9182a9 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:53.956733 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-7b063e3e-2281-4f45-965e-b3ec3f9182a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:53.988996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a4b4e704-a7d0-4e2e-939a-6a633aea2a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f5934ee7c645b89034645a64faeaa2'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:54.005304 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a4b4e704-a7d0-4e2e-939a-6a633aea2a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f5934ee7c645b89034645a64faeaa2'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:54.014123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b063e3e-2281-4f45-965e-b3ec3f9182a9 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:54.017817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288cc9-6f94-47f7-9413-2d8a1a314590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:54.018470 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288cc9-6f94-47f7-9413-2d8a1a314590 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:54.018757 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288cc9-6f94-47f7-9413-2d8a1a314590 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:54.019041 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63288cc9-6f94-47f7-9413-2d8a1a314590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:54.021442 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-63288cc9-6f94-47f7-9413-2d8a1a314590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:54.085746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63288cc9-6f94-47f7-9413-2d8a1a314590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:54.087408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63288cc9-6f94-47f7-9413-2d8a1a314590 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:54.098392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1050/2067] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:54.099097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288cc9-6f94-47f7-9413-2d8a1a314590 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:54.100392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-63288cc9-6f94-47f7-9413-2d8a1a314590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:54.111041 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a4b4e704-a7d0-4e2e-939a-6a633aea2a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f5934ee7c645b89034645a64faeaa2'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:54.113037 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63288cc9-6f94-47f7-9413-2d8a1a314590 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:54.118706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd6900-42f1-4b94-923e-413809bb20c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:54.120194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd6900-42f1-4b94-923e-413809bb20c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:54.120194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd6900-42f1-4b94-923e-413809bb20c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:54.120401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd6900-42f1-4b94-923e-413809bb20c2 admin admin] PATH_INFO: `/v3/users/3c6ffd5db7f945ee8161ced6cff6e108` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:54.121666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd6900-42f1-4b94-923e-413809bb20c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c6ffd5db7f945ee8161ced6cff6e108)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:54.124422 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd6900-42f1-4b94-923e-413809bb20c2 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:54.127205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a4b4e704-a7d0-4e2e-939a-6a633aea2a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f5934ee7c645b89034645a64faeaa2'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:54.135891 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a4b4e704-a7d0-4e2e-939a-6a633aea2a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f5934ee7c645b89034645a64faeaa2'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:54.144500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1018/2068] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:53 2022] DELETE /identity/v3/users/a4f5934ee7c645b89034645a64faeaa2 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:54.397437 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3bcd6900-42f1-4b94-923e-413809bb20c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c6ffd5db7f945ee8161ced6cff6e108'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:54.503712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3bcd6900-42f1-4b94-923e-413809bb20c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c6ffd5db7f945ee8161ced6cff6e108'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:54.504338 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3bcd6900-42f1-4b94-923e-413809bb20c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c6ffd5db7f945ee8161ced6cff6e108'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:54.515729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3bcd6900-42f1-4b94-923e-413809bb20c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c6ffd5db7f945ee8161ced6cff6e108'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:54.529217 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3bcd6900-42f1-4b94-923e-413809bb20c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c6ffd5db7f945ee8161ced6cff6e108'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:54.538655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1051/2069] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:54 2022] DELETE /identity/v3/users/3c6ffd5db7f945ee8161ced6cff6e108 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:54.626664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4e704-a7d0-4e2e-939a-6a633aea2a63 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:54.628027 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-a4b4e704-a7d0-4e2e-939a-6a633aea2a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:54.645291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd6900-42f1-4b94-923e-413809bb20c2 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:54.646916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-3bcd6900-42f1-4b94-923e-413809bb20c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:54.735833 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4e704-a7d0-4e2e-939a-6a633aea2a63 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:54.748129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:54.773338 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd6900-42f1-4b94-923e-413809bb20c2 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:54.778678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f33586-ee8f-4683-872d-5ad574dfc9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:54.779557 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f33586-ee8f-4683-872d-5ad574dfc9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:54.779876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f33586-ee8f-4683-872d-5ad574dfc9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:54.780207 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f33586-ee8f-4683-872d-5ad574dfc9ca admin admin] PATH_INFO: `/v3/projects/1d9842699e1f45c3ae977c835a7ba33b` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:54.781657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f33586-ee8f-4683-872d-5ad574dfc9ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9842699e1f45c3ae977c835a7ba33b)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:54.783748 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f33586-ee8f-4683-872d-5ad574dfc9ca admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:54.803285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273984f3-5dc5-4d77-b40f-cc684bc632db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:54.804211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273984f3-5dc5-4d77-b40f-cc684bc632db admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:54.804497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273984f3-5dc5-4d77-b40f-cc684bc632db admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:54.804785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273984f3-5dc5-4d77-b40f-cc684bc632db admin admin] PATH_INFO: `/v3/users/2e7a03fe6e01456298f81a6a45f345da` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:54.805962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273984f3-5dc5-4d77-b40f-cc684bc632db admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e7a03fe6e01456298f81a6a45f345da)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:54.807991 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273984f3-5dc5-4d77-b40f-cc684bc632db admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:55.037386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-273984f3-5dc5-4d77-b40f-cc684bc632db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e7a03fe6e01456298f81a6a45f345da'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.038135 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-273984f3-5dc5-4d77-b40f-cc684bc632db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e7a03fe6e01456298f81a6a45f345da'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.038266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d7f33586-ee8f-4683-872d-5ad574dfc9ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9842699e1f45c3ae977c835a7ba33b', 'request_id': 'req-d7f33586-ee8f-4683-872d-5ad574dfc9ca'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.044826 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d7f33586-ee8f-4683-872d-5ad574dfc9ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9842699e1f45c3ae977c835a7ba33b', 'request_id': 'req-d7f33586-ee8f-4683-872d-5ad574dfc9ca'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.050460 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:55.051128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d7f33586-ee8f-4683-872d-5ad574dfc9ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9842699e1f45c3ae977c835a7ba33b', 'request_id': 'req-d7f33586-ee8f-4683-872d-5ad574dfc9ca'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.150945 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-273984f3-5dc5-4d77-b40f-cc684bc632db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e7a03fe6e01456298f81a6a45f345da'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.165173 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-273984f3-5dc5-4d77-b40f-cc684bc632db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e7a03fe6e01456298f81a6a45f345da'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.184808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-273984f3-5dc5-4d77-b40f-cc684bc632db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e7a03fe6e01456298f81a6a45f345da'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.195372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1019/2070] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:54 2022] DELETE /identity/v3/users/2e7a03fe6e01456298f81a6a45f345da => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:55.195372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273984f3-5dc5-4d77-b40f-cc684bc632db admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:55.196606 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-273984f3-5dc5-4d77-b40f-cc684bc632db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:55.220854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d7f33586-ee8f-4683-872d-5ad574dfc9ca admin admin] The token cache is being invalidate because project 1d9842699e1f45c3ae977c835a7ba33b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:55.221152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d7f33586-ee8f-4683-872d-5ad574dfc9ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.221832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d7f33586-ee8f-4683-872d-5ad574dfc9ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.223593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1052/2071] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:54 2022] DELETE /identity/v3/projects/1d9842699e1f45c3ae977c835a7ba33b => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:55.224543 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f33586-ee8f-4683-872d-5ad574dfc9ca admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:55.225757 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d7f33586-ee8f-4683-872d-5ad574dfc9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:55.262201 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273984f3-5dc5-4d77-b40f-cc684bc632db admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:55.268089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c85bf-0a4d-4d17-9dbe-de641fa75404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:55.268956 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c85bf-0a4d-4d17-9dbe-de641fa75404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:55.269523 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c85bf-0a4d-4d17-9dbe-de641fa75404 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:55.269633 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c85bf-0a4d-4d17-9dbe-de641fa75404 admin admin] PATH_INFO: `/v3/projects/e7ca8ea7b54548418ffc78f806f6e4f7` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:55.271599 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c85bf-0a4d-4d17-9dbe-de641fa75404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7ca8ea7b54548418ffc78f806f6e4f7)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:55.273545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c85bf-0a4d-4d17-9dbe-de641fa75404 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:55.293749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f33586-ee8f-4683-872d-5ad574dfc9ca admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:55.298671 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7114e-1ffb-4fd5-a0a6-2464a418f933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:55.299546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7114e-1ffb-4fd5-a0a6-2464a418f933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:55.299838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7114e-1ffb-4fd5-a0a6-2464a418f933 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:55.300141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7114e-1ffb-4fd5-a0a6-2464a418f933 admin admin] PATH_INFO: `/v3/projects/de7da3e7aa1f4e3589fddeb9c1042500` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:55.301410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7114e-1ffb-4fd5-a0a6-2464a418f933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de7da3e7aa1f4e3589fddeb9c1042500)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:55.303401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7114e-1ffb-4fd5-a0a6-2464a418f933 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:55.388447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a63c85bf-0a4d-4d17-9dbe-de641fa75404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7ca8ea7b54548418ffc78f806f6e4f7', 'request_id': 'req-a63c85bf-0a4d-4d17-9dbe-de641fa75404'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.430683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-43a7114e-1ffb-4fd5-a0a6-2464a418f933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de7da3e7aa1f4e3589fddeb9c1042500', 'request_id': 'req-43a7114e-1ffb-4fd5-a0a6-2464a418f933'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.436637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-43a7114e-1ffb-4fd5-a0a6-2464a418f933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de7da3e7aa1f4e3589fddeb9c1042500', 'request_id': 'req-43a7114e-1ffb-4fd5-a0a6-2464a418f933'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.444086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a63c85bf-0a4d-4d17-9dbe-de641fa75404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7ca8ea7b54548418ffc78f806f6e4f7', 'request_id': 'req-a63c85bf-0a4d-4d17-9dbe-de641fa75404'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.444508 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-43a7114e-1ffb-4fd5-a0a6-2464a418f933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de7da3e7aa1f4e3589fddeb9c1042500', 'request_id': 'req-43a7114e-1ffb-4fd5-a0a6-2464a418f933'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.448691 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a63c85bf-0a4d-4d17-9dbe-de641fa75404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7ca8ea7b54548418ffc78f806f6e4f7', 'request_id': 'req-a63c85bf-0a4d-4d17-9dbe-de641fa75404'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.460518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a63c85bf-0a4d-4d17-9dbe-de641fa75404 admin admin] The token cache is being invalidate because project e7ca8ea7b54548418ffc78f806f6e4f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:55.460817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a63c85bf-0a4d-4d17-9dbe-de641fa75404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.461497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a63c85bf-0a4d-4d17-9dbe-de641fa75404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.463113 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1020/2072] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:55 2022] DELETE /identity/v3/projects/e7ca8ea7b54548418ffc78f806f6e4f7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:55.464486 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fc053-9883-4956-9584-4816f81f7415 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:55.464779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fc053-9883-4956-9584-4816f81f7415 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:55.465278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fc053-9883-4956-9584-4816f81f7415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:55.485932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-267fc053-9883-4956-9584-4816f81f7415 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:55.487339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-267fc053-9883-4956-9584-4816f81f7415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:55.546100 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1021/2073] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:55.547440 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3844a-72b2-4097-9d8e-220ea486c08a None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:55.547735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3844a-72b2-4097-9d8e-220ea486c08a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:55.548019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3844a-72b2-4097-9d8e-220ea486c08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:55.548263 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-43a7114e-1ffb-4fd5-a0a6-2464a418f933 admin admin] The token cache is being invalidate because project de7da3e7aa1f4e3589fddeb9c1042500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:55.548656 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-43a7114e-1ffb-4fd5-a0a6-2464a418f933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.555523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-43a7114e-1ffb-4fd5-a0a6-2464a418f933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.557161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1053/2074] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:55 2022] DELETE /identity/v3/projects/de7da3e7aa1f4e3589fddeb9c1042500 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:55.560454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156ee6f-b1c4-469f-ada5-cc6a7532ee5a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:55.560454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156ee6f-b1c4-469f-ada5-cc6a7532ee5a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:55.560454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156ee6f-b1c4-469f-ada5-cc6a7532ee5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:55.566829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-4db3844a-72b2-4097-9d8e-220ea486c08a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:55.569947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4db3844a-72b2-4097-9d8e-220ea486c08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:55.576741 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1022/2075] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:55.577650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3844a-72b2-4097-9d8e-220ea486c08a None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:55.578652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a156ee6f-b1c4-469f-ada5-cc6a7532ee5a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:55.578862 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4db3844a-72b2-4097-9d8e-220ea486c08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:55.579834 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a156ee6f-b1c4-469f-ada5-cc6a7532ee5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:55.590216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1054/2076] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:55.591611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11381f1c-a0e3-4cc4-9cf8-e3581b22dcc4 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:55.591944 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11381f1c-a0e3-4cc4-9cf8-e3581b22dcc4 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:55.592228 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11381f1c-a0e3-4cc4-9cf8-e3581b22dcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:55.612938 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-11381f1c-a0e3-4cc4-9cf8-e3581b22dcc4 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:55.614856 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-11381f1c-a0e3-4cc4-9cf8-e3581b22dcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:55.623345 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1055/2077] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:55.625991 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321779a6-ae6a-4817-96a4-a799296a471b None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:55.626465 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321779a6-ae6a-4817-96a4-a799296a471b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:55.626852 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321779a6-ae6a-4817-96a4-a799296a471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:55.638105 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3844a-72b2-4097-9d8e-220ea486c08a None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:55.642233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349671a8-aa63-4439-8e03-9d509254d078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:55.643000 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349671a8-aa63-4439-8e03-9d509254d078 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:55.643646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349671a8-aa63-4439-8e03-9d509254d078 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:55.643646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349671a8-aa63-4439-8e03-9d509254d078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:55.645824 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-349671a8-aa63-4439-8e03-9d509254d078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:55.649970 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-321779a6-ae6a-4817-96a4-a799296a471b None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:55.650834 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-321779a6-ae6a-4817-96a4-a799296a471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:55.658492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349671a8-aa63-4439-8e03-9d509254d078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:55.658944 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1056/2078] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:55.660059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349671a8-aa63-4439-8e03-9d509254d078 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:55.660168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ef771-be18-4365-92bd-56449c3e6358 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:55.660453 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ef771-be18-4365-92bd-56449c3e6358 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:55.660760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ef771-be18-4365-92bd-56449c3e6358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:55.670411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1023/2079] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:55.671765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17fe49-c6d8-46b0-9da6-0d2d407485af None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:55.672074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17fe49-c6d8-46b0-9da6-0d2d407485af None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:55.672495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17fe49-c6d8-46b0-9da6-0d2d407485af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:55.680227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-321ef771-be18-4365-92bd-56449c3e6358 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:55.681506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-321ef771-be18-4365-92bd-56449c3e6358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:55.690254 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1057/2080] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:55.691135 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ef771-be18-4365-92bd-56449c3e6358 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:55.692603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-321ef771-be18-4365-92bd-56449c3e6358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:55.695825 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-9b17fe49-c6d8-46b0-9da6-0d2d407485af None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:55.697446 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9b17fe49-c6d8-46b0-9da6-0d2d407485af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:55.704166 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ef771-be18-4365-92bd-56449c3e6358 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:55.709822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3968eab-5726-4aec-975d-5abd3b9bba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:55.710874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3968eab-5726-4aec-975d-5abd3b9bba78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:55.710987 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3968eab-5726-4aec-975d-5abd3b9bba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:55.711180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1024/2081] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:55.711303 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3968eab-5726-4aec-975d-5abd3b9bba78 admin admin] PATH_INFO: `/v3/users/4096143c8116475e9a929a057914bcd1` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:55.712780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17fe49-c6d8-46b0-9da6-0d2d407485af None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:55.712963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3968eab-5726-4aec-975d-5abd3b9bba78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4096143c8116475e9a929a057914bcd1)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:55.715026 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3968eab-5726-4aec-975d-5abd3b9bba78 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:55.724060 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17fe49-c6d8-46b0-9da6-0d2d407485af None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:55.730464 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373637ef-d71b-4757-8d0a-e3466d5905b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:55.731574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373637ef-d71b-4757-8d0a-e3466d5905b9 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:55.731871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373637ef-d71b-4757-8d0a-e3466d5905b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:55.732174 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373637ef-d71b-4757-8d0a-e3466d5905b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:55.733345 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373637ef-d71b-4757-8d0a-e3466d5905b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:55.733668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373637ef-d71b-4757-8d0a-e3466d5905b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:55.735395 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373637ef-d71b-4757-8d0a-e3466d5905b9 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:55.750382 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1025/2082] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:00:55.750382 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373637ef-d71b-4757-8d0a-e3466d5905b9 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:55.759403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373637ef-d71b-4757-8d0a-e3466d5905b9 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:55.764275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f3ec0-440d-4e07-b155-cc186a8c025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:55.764925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f3ec0-440d-4e07-b155-cc186a8c025f admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:55.765238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f3ec0-440d-4e07-b155-cc186a8c025f admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:55.765578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f3ec0-440d-4e07-b155-cc186a8c025f admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:55.766305 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f3ec0-440d-4e07-b155-cc186a8c025f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:55.766655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f3ec0-440d-4e07-b155-cc186a8c025f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:55.768285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017f3ec0-440d-4e07-b155-cc186a8c025f admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:55.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1026/2083] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:00:55.784756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f3ec0-440d-4e07-b155-cc186a8c025f admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:55.792744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f3ec0-440d-4e07-b155-cc186a8c025f admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:55.798086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884921e-ca13-4fbc-9a39-00885494ec76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:55.798778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884921e-ca13-4fbc-9a39-00885494ec76 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:55.799068 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884921e-ca13-4fbc-9a39-00885494ec76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:55.799347 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884921e-ca13-4fbc-9a39-00885494ec76 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:55.800072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884921e-ca13-4fbc-9a39-00885494ec76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:55.800381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884921e-ca13-4fbc-9a39-00885494ec76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:55.802008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884921e-ca13-4fbc-9a39-00885494ec76 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:55.813583 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1027/2084] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:00:55.814559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884921e-ca13-4fbc-9a39-00885494ec76 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:55.824175 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884921e-ca13-4fbc-9a39-00885494ec76 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:55.829187 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f7e46-8d04-4653-8ddb-470a82ff5260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:55.829853 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f7e46-8d04-4653-8ddb-470a82ff5260 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:55.830189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f7e46-8d04-4653-8ddb-470a82ff5260 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:55.830488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f7e46-8d04-4653-8ddb-470a82ff5260 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:55.831189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f7e46-8d04-4653-8ddb-470a82ff5260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:55.833777 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f7e46-8d04-4653-8ddb-470a82ff5260 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:55.929361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:55.935034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b3968eab-5726-4aec-975d-5abd3b9bba78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4096143c8116475e9a929a057914bcd1'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:55.943658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1028/2085] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:55 2022] POST /identity/v3/projects => generated 403 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:55.943658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f7e46-8d04-4653-8ddb-470a82ff5260 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.003025 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b3968eab-5726-4aec-975d-5abd3b9bba78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4096143c8116475e9a929a057914bcd1'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:56.003660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b3968eab-5726-4aec-975d-5abd3b9bba78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4096143c8116475e9a929a057914bcd1'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:56.011974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f7e46-8d04-4653-8ddb-470a82ff5260 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:56.013122 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b3968eab-5726-4aec-975d-5abd3b9bba78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4096143c8116475e9a929a057914bcd1'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:56.017094 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175d65d-3978-4375-a332-bc7cd5d4a555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:56.017775 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175d65d-3978-4375-a332-bc7cd5d4a555 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.018108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175d65d-3978-4375-a332-bc7cd5d4a555 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.018417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175d65d-3978-4375-a332-bc7cd5d4a555 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.019126 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175d65d-3978-4375-a332-bc7cd5d4a555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:56.021647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3175d65d-3978-4375-a332-bc7cd5d4a555 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:56.025901 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b3968eab-5726-4aec-975d-5abd3b9bba78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4096143c8116475e9a929a057914bcd1'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:56.032234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1058/2086] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:55 2022] DELETE /identity/v3/users/4096143c8116475e9a929a057914bcd1 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:56.034939 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3968eab-5726-4aec-975d-5abd3b9bba78 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.034939 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b3968eab-5726-4aec-975d-5abd3b9bba78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:56.095933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3968eab-5726-4aec-975d-5abd3b9bba78 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:56.100634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44e76f-6ab7-4b10-98af-b99f98bac230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:56.101305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44e76f-6ab7-4b10-98af-b99f98bac230 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.101568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44e76f-6ab7-4b10-98af-b99f98bac230 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.101873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44e76f-6ab7-4b10-98af-b99f98bac230 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.102558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44e76f-6ab7-4b10-98af-b99f98bac230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:56.105553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44e76f-6ab7-4b10-98af-b99f98bac230 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:56.140851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1029/2087] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:55 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:56.140851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175d65d-3978-4375-a332-bc7cd5d4a555 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.140851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-3175d65d-3978-4375-a332-bc7cd5d4a555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:56.188691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1059/2088] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:56 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:56.190133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654610b-ad59-479e-91bd-32594331141c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.190535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654610b-ad59-479e-91bd-32594331141c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.190888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654610b-ad59-479e-91bd-32594331141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.199479 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175d65d-3978-4375-a332-bc7cd5d4a555 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:56.209940 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-8654610b-ad59-479e-91bd-32594331141c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:56.211179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8654610b-ad59-479e-91bd-32594331141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:56.256977 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a251ef-2f35-47f0-a94a-07728e129b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:56.258417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a251ef-2f35-47f0-a94a-07728e129b41 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.258819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a251ef-2f35-47f0-a94a-07728e129b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.259206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a251ef-2f35-47f0-a94a-07728e129b41 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.259954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a251ef-2f35-47f0-a94a-07728e129b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:56.262044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a251ef-2f35-47f0-a94a-07728e129b41 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:56.268968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1060/2089] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:56.269818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654610b-ad59-479e-91bd-32594331141c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.271852 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8654610b-ad59-479e-91bd-32594331141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:56.284558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654610b-ad59-479e-91bd-32594331141c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:56.289369 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaed56b-7830-45bd-ab44-7acea6240fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:56.290221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaed56b-7830-45bd-ab44-7acea6240fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.290544 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaed56b-7830-45bd-ab44-7acea6240fad admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.290828 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaed56b-7830-45bd-ab44-7acea6240fad admin admin] PATH_INFO: `/v3/projects/1fe267dc7cb84e388f01ccfb0f2ab4d5` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.292041 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaed56b-7830-45bd-ab44-7acea6240fad admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe267dc7cb84e388f01ccfb0f2ab4d5)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:56.293965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaed56b-7830-45bd-ab44-7acea6240fad admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:56.345272 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1030/2090] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:56 2022] POST /identity/v3/users => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:56.345272 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a251ef-2f35-47f0-a94a-07728e129b41 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.345272 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-66a251ef-2f35-47f0-a94a-07728e129b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:56.347448 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:56.357266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a251ef-2f35-47f0-a94a-07728e129b41 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:56.361343 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294e9b1-43fc-4646-b464-9ebf59808dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:56.361997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294e9b1-43fc-4646-b464-9ebf59808dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.362286 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294e9b1-43fc-4646-b464-9ebf59808dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.362606 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294e9b1-43fc-4646-b464-9ebf59808dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.363296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294e9b1-43fc-4646-b464-9ebf59808dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:56.365857 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294e9b1-43fc-4646-b464-9ebf59808dd8 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:56.421053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6eaed56b-7830-45bd-ab44-7acea6240fad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe267dc7cb84e388f01ccfb0f2ab4d5', 'request_id': 'req-6eaed56b-7830-45bd-ab44-7acea6240fad'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:56.427690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6eaed56b-7830-45bd-ab44-7acea6240fad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe267dc7cb84e388f01ccfb0f2ab4d5', 'request_id': 'req-6eaed56b-7830-45bd-ab44-7acea6240fad'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:56.433063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6eaed56b-7830-45bd-ab44-7acea6240fad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe267dc7cb84e388f01ccfb0f2ab4d5', 'request_id': 'req-6eaed56b-7830-45bd-ab44-7acea6240fad'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:56.474494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1031/2091] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:56 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:56.474494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294e9b1-43fc-4646-b464-9ebf59808dd8 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.484747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294e9b1-43fc-4646-b464-9ebf59808dd8 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:56.501303 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6eaed56b-7830-45bd-ab44-7acea6240fad admin admin] The token cache is being invalidate because project 1fe267dc7cb84e388f01ccfb0f2ab4d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:56.501877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6eaed56b-7830-45bd-ab44-7acea6240fad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:56.502595 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6eaed56b-7830-45bd-ab44-7acea6240fad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:56.504223 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1061/2092] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:56 2022] DELETE /identity/v3/projects/1fe267dc7cb84e388f01ccfb0f2ab4d5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:56.505596 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaed56b-7830-45bd-ab44-7acea6240fad admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.506999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-6eaed56b-7830-45bd-ab44-7acea6240fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:56.545902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b35ec9-7205-4f45-a19e-aefa3de41c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:56.546615 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b35ec9-7205-4f45-a19e-aefa3de41c1f admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.546921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b35ec9-7205-4f45-a19e-aefa3de41c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.547309 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b35ec9-7205-4f45-a19e-aefa3de41c1f admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.547858 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b35ec9-7205-4f45-a19e-aefa3de41c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:56.549768 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b35ec9-7205-4f45-a19e-aefa3de41c1f admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:56.563478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaed56b-7830-45bd-ab44-7acea6240fad admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:56.567826 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786660e-ec5e-44d1-aabc-e91d3d4e77f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:56.568478 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786660e-ec5e-44d1-aabc-e91d3d4e77f7 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.568765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786660e-ec5e-44d1-aabc-e91d3d4e77f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.569047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786660e-ec5e-44d1-aabc-e91d3d4e77f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.570972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f786660e-ec5e-44d1-aabc-e91d3d4e77f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:56.582586 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786660e-ec5e-44d1-aabc-e91d3d4e77f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:56.584030 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786660e-ec5e-44d1-aabc-e91d3d4e77f7 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:56.593747 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1062/2093] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:56.594659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786660e-ec5e-44d1-aabc-e91d3d4e77f7 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.595882 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f786660e-ec5e-44d1-aabc-e91d3d4e77f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:56.607072 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786660e-ec5e-44d1-aabc-e91d3d4e77f7 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:56.611752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d297c9-c9c1-42c9-b0ce-d3e1fc5c5990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:56.612482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d297c9-c9c1-42c9-b0ce-d3e1fc5c5990 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.620956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d297c9-c9c1-42c9-b0ce-d3e1fc5c5990 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.620956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d297c9-c9c1-42c9-b0ce-d3e1fc5c5990 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.620956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d297c9-c9c1-42c9-b0ce-d3e1fc5c5990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:56.620956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d297c9-c9c1-42c9-b0ce-d3e1fc5c5990 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:56.627483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1063/2094] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:56.628323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d297c9-c9c1-42c9-b0ce-d3e1fc5c5990 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.630763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a8d297c9-c9c1-42c9-b0ce-d3e1fc5c5990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:56.643776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d297c9-c9c1-42c9-b0ce-d3e1fc5c5990 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:56.645574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1032/2095] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:56 2022] POST /identity/v3/users => generated 281 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:56.646774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b35ec9-7205-4f45-a19e-aefa3de41c1f admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.649071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:56.652254 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c6b35ec9-7205-4f45-a19e-aefa3de41c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:56.653216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25efb5-2299-4c13-907b-b14d129619ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:56.654945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25efb5-2299-4c13-907b-b14d129619ab admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.655409 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25efb5-2299-4c13-907b-b14d129619ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.655708 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25efb5-2299-4c13-907b-b14d129619ab admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.656598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25efb5-2299-4c13-907b-b14d129619ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:56.658266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25efb5-2299-4c13-907b-b14d129619ab admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:56.666281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b35ec9-7205-4f45-a19e-aefa3de41c1f admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:56.669919 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1064/2096] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:56.670784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25efb5-2299-4c13-907b-b14d129619ab admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.672103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db75e9-0220-4095-9ffe-f9fa75b77e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:56.673071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db75e9-0220-4095-9ffe-f9fa75b77e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.677998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db75e9-0220-4095-9ffe-f9fa75b77e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.677998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db75e9-0220-4095-9ffe-f9fa75b77e39 admin admin] PATH_INFO: `/v3/users/20c39bb208444f65a44cedbdd0da035b` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.677998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db75e9-0220-4095-9ffe-f9fa75b77e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c39bb208444f65a44cedbdd0da035b)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:56.677998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db75e9-0220-4095-9ffe-f9fa75b77e39 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:56.684350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25efb5-2299-4c13-907b-b14d129619ab admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:56.689144 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608179cf-a953-457f-ade2-797955bcfa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:56.689965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608179cf-a953-457f-ade2-797955bcfa8c admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.690259 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608179cf-a953-457f-ade2-797955bcfa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.690598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608179cf-a953-457f-ade2-797955bcfa8c admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.691337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608179cf-a953-457f-ade2-797955bcfa8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:56.693036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608179cf-a953-457f-ade2-797955bcfa8c admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:56.703941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1065/2097] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:56.704756 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608179cf-a953-457f-ade2-797955bcfa8c admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.706555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-608179cf-a953-457f-ade2-797955bcfa8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:56.719013 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608179cf-a953-457f-ade2-797955bcfa8c admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:56.724203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c116a-7ea8-454e-9a7e-a1ccbf53107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:56.724891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c116a-7ea8-454e-9a7e-a1ccbf53107a admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.725126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c116a-7ea8-454e-9a7e-a1ccbf53107a admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.725405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c116a-7ea8-454e-9a7e-a1ccbf53107a admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.726124 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c116a-7ea8-454e-9a7e-a1ccbf53107a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:56.727743 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c116a-7ea8-454e-9a7e-a1ccbf53107a admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:56.737325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1066/2098] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:56.738223 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c116a-7ea8-454e-9a7e-a1ccbf53107a admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.748250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c116a-7ea8-454e-9a7e-a1ccbf53107a admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:56.753046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a331686-b219-4325-af77-a7cfe2c4dfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:56.753680 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a331686-b219-4325-af77-a7cfe2c4dfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.753964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a331686-b219-4325-af77-a7cfe2c4dfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.754291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a331686-b219-4325-af77-a7cfe2c4dfa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.755192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a331686-b219-4325-af77-a7cfe2c4dfa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:56.756807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a331686-b219-4325-af77-a7cfe2c4dfa1 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:56.768223 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1067/2099] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:56.769225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a331686-b219-4325-af77-a7cfe2c4dfa1 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.781097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a331686-b219-4325-af77-a7cfe2c4dfa1 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:56.786489 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4c94d-8777-467f-8d96-3db35f08c389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:56.787382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4c94d-8777-467f-8d96-3db35f08c389 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.790491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4c94d-8777-467f-8d96-3db35f08c389 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.790491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4c94d-8777-467f-8d96-3db35f08c389 admin admin] PATH_INFO: `/v3/projects/46fb8e7b906f44a1879a94e1a56ab5d5/users/26280c423a1e4073b6955990d07be722/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.811463 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4c94d-8777-467f-8d96-3db35f08c389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46fb8e7b906f44a1879a94e1a56ab5d5, user_id=26280c423a1e4073b6955990d07be722, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:56.814144 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4c94d-8777-467f-8d96-3db35f08c389 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:56.857091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-e8db75e9-0220-4095-9ffe-f9fa75b77e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c39bb208444f65a44cedbdd0da035b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:56.857974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-e8db75e9-0220-4095-9ffe-f9fa75b77e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c39bb208444f65a44cedbdd0da035b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:56.913551 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1068/2100] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:56 2022] PUT /identity/v3/projects/46fb8e7b906f44a1879a94e1a56ab5d5/users/26280c423a1e4073b6955990d07be722/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:56.914428 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4c94d-8777-467f-8d96-3db35f08c389 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.950620 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-e8db75e9-0220-4095-9ffe-f9fa75b77e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c39bb208444f65a44cedbdd0da035b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:56.964286 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-e8db75e9-0220-4095-9ffe-f9fa75b77e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c39bb208444f65a44cedbdd0da035b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:56.971138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-e8db75e9-0220-4095-9ffe-f9fa75b77e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c39bb208444f65a44cedbdd0da035b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:56.973941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4c94d-8777-467f-8d96-3db35f08c389 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:56.980872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1033/2101] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:56 2022] DELETE /identity/v3/users/20c39bb208444f65a44cedbdd0da035b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:56.980872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db75e9-0220-4095-9ffe-f9fa75b77e39 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:56.983267 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641267f-1455-414f-9e00-f399cd8c9370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:56.984077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641267f-1455-414f-9e00-f399cd8c9370 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:56.984377 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641267f-1455-414f-9e00-f399cd8c9370 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:56.984664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641267f-1455-414f-9e00-f399cd8c9370 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:56.985472 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641267f-1455-414f-9e00-f399cd8c9370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:56.987744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641267f-1455-414f-9e00-f399cd8c9370 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:56.993718 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e8db75e9-0220-4095-9ffe-f9fa75b77e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:57.008749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1069/2102] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:57.008749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39f55c-ab1b-45ff-a329-2d994223ba5c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:57.008749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39f55c-ab1b-45ff-a329-2d994223ba5c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:57.008749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39f55c-ab1b-45ff-a329-2d994223ba5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:57.032595 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-ab39f55c-ab1b-45ff-a329-2d994223ba5c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:57.034275 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ab39f55c-ab1b-45ff-a329-2d994223ba5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:57.106378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db75e9-0220-4095-9ffe-f9fa75b77e39 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:57.112074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcf06d-9156-499c-b324-84dff5da8228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:57.112983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcf06d-9156-499c-b324-84dff5da8228 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:57.113275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcf06d-9156-499c-b324-84dff5da8228 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:57.113561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcf06d-9156-499c-b324-84dff5da8228 admin admin] PATH_INFO: `/v3/projects/df23b127bbeb416c85affe94247eb286/users/8521bf0e9bf3451a936586c387a79344/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:57.126795 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1070/2103] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:57.128359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39f55c-ab1b-45ff-a329-2d994223ba5c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:57.136649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ab39f55c-ab1b-45ff-a329-2d994223ba5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:57.139097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcf06d-9156-499c-b324-84dff5da8228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df23b127bbeb416c85affe94247eb286, user_id=8521bf0e9bf3451a936586c387a79344, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:57.143225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcf06d-9156-499c-b324-84dff5da8228 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:57.150253 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39f55c-ab1b-45ff-a329-2d994223ba5c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:57.155412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611c291-9076-4bb0-b529-d4fd2bf27a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:57.156291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611c291-9076-4bb0-b529-d4fd2bf27a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:57.156568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611c291-9076-4bb0-b529-d4fd2bf27a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:57.157042 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611c291-9076-4bb0-b529-d4fd2bf27a7b admin admin] PATH_INFO: `/v3/projects/742b1fda3b6842a4aa9aa22def8414e8` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:57.158230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611c291-9076-4bb0-b529-d4fd2bf27a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=742b1fda3b6842a4aa9aa22def8414e8)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:57.160230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611c291-9076-4bb0-b529-d4fd2bf27a7b admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:57.220495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1034/2104] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:56 2022] PUT /identity/v3/projects/df23b127bbeb416c85affe94247eb286/users/8521bf0e9bf3451a936586c387a79344/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:57.224749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcf06d-9156-499c-b324-84dff5da8228 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:57.224749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-dedcf06d-9156-499c-b324-84dff5da8228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:57.291978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c611c291-9076-4bb0-b529-d4fd2bf27a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '742b1fda3b6842a4aa9aa22def8414e8', 'request_id': 'req-c611c291-9076-4bb0-b529-d4fd2bf27a7b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:57.293383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcf06d-9156-499c-b324-84dff5da8228 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:57.298393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c611c291-9076-4bb0-b529-d4fd2bf27a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '742b1fda3b6842a4aa9aa22def8414e8', 'request_id': 'req-c611c291-9076-4bb0-b529-d4fd2bf27a7b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:57.304522 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c611c291-9076-4bb0-b529-d4fd2bf27a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '742b1fda3b6842a4aa9aa22def8414e8', 'request_id': 'req-c611c291-9076-4bb0-b529-d4fd2bf27a7b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:57.351737 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fb428-6f4e-499d-9e93-e076ff8ec0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:57.352727 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fb428-6f4e-499d-9e93-e076ff8ec0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:57.353195 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fb428-6f4e-499d-9e93-e076ff8ec0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:57.353612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fb428-6f4e-499d-9e93-e076ff8ec0e2 admin admin] PATH_INFO: `/v3/projects/1eb3ad1b4a3e4578bf3565ec80d776e1/users/b42afc447b4a4c819c242ba22d9d97a2/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:57.369244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fb428-6f4e-499d-9e93-e076ff8ec0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb3ad1b4a3e4578bf3565ec80d776e1, user_id=b42afc447b4a4c819c242ba22d9d97a2, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:57.371945 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fb428-6f4e-499d-9e93-e076ff8ec0e2 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:57.386497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c611c291-9076-4bb0-b529-d4fd2bf27a7b admin admin] The token cache is being invalidate because project 742b1fda3b6842a4aa9aa22def8414e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:57.386790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c611c291-9076-4bb0-b529-d4fd2bf27a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:57.387513 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c611c291-9076-4bb0-b529-d4fd2bf27a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:57.389057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1071/2105] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:57 2022] DELETE /identity/v3/projects/742b1fda3b6842a4aa9aa22def8414e8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:57.389850 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611c291-9076-4bb0-b529-d4fd2bf27a7b admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:57.391299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c611c291-9076-4bb0-b529-d4fd2bf27a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:57.446519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611c291-9076-4bb0-b529-d4fd2bf27a7b admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:57.450311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c0386-34b0-4dfe-8bf7-30ae2f983e52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:57.450986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c0386-34b0-4dfe-8bf7-30ae2f983e52 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:57.451527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c0386-34b0-4dfe-8bf7-30ae2f983e52 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:57.451816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c0386-34b0-4dfe-8bf7-30ae2f983e52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:57.453895 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-cd4c0386-34b0-4dfe-8bf7-30ae2f983e52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:57.468162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1035/2106] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:57 2022] PUT /identity/v3/projects/1eb3ad1b4a3e4578bf3565ec80d776e1/users/b42afc447b4a4c819c242ba22d9d97a2/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:57.468315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c0386-34b0-4dfe-8bf7-30ae2f983e52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:57.480269 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c0386-34b0-4dfe-8bf7-30ae2f983e52 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:57.480666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf68f8b-74ff-44a5-9892-4d4bd2cec06e None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:57.480666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf68f8b-74ff-44a5-9892-4d4bd2cec06e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:57.480666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf68f8b-74ff-44a5-9892-4d4bd2cec06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:57.481923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1072/2107] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:57.481923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c0386-34b0-4dfe-8bf7-30ae2f983e52 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:57.482772 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-cd4c0386-34b0-4dfe-8bf7-30ae2f983e52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:57.495999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c0386-34b0-4dfe-8bf7-30ae2f983e52 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:57.498036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-daf68f8b-74ff-44a5-9892-4d4bd2cec06e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:57.499224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-daf68f8b-74ff-44a5-9892-4d4bd2cec06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:57.553195 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c339785e-f418-4adc-bf25-556902228712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:57.554078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339785e-f418-4adc-bf25-556902228712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:57.554402 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339785e-f418-4adc-bf25-556902228712 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:57.554693 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339785e-f418-4adc-bf25-556902228712 admin admin] PATH_INFO: `/v3/users/762c120c5d8447d8bec5fe2c1c00acbe` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:57.555909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339785e-f418-4adc-bf25-556902228712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=762c120c5d8447d8bec5fe2c1c00acbe)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:57.557904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c339785e-f418-4adc-bf25-556902228712 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:57.562152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1036/2108] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:57.565982 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf68f8b-74ff-44a5-9892-4d4bd2cec06e None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:57.565982 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-daf68f8b-74ff-44a5-9892-4d4bd2cec06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:57.579925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf68f8b-74ff-44a5-9892-4d4bd2cec06e None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:57.585230 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9193e-59dd-4971-9d46-898a44a00d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:57.586096 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9193e-59dd-4971-9d46-898a44a00d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:57.586412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9193e-59dd-4971-9d46-898a44a00d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:57.586698 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9193e-59dd-4971-9d46-898a44a00d77 admin admin] PATH_INFO: `/v3/projects/4bf5ca7849b84b49b3680f3b17205213` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:57.588036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9193e-59dd-4971-9d46-898a44a00d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf5ca7849b84b49b3680f3b17205213)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:57.590002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f9193e-59dd-4971-9d46-898a44a00d77 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:57.736913 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c339785e-f418-4adc-bf25-556902228712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762c120c5d8447d8bec5fe2c1c00acbe'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:57.738105 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-65f9193e-59dd-4971-9d46-898a44a00d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf5ca7849b84b49b3680f3b17205213', 'request_id': 'req-65f9193e-59dd-4971-9d46-898a44a00d77'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:57.832691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c339785e-f418-4adc-bf25-556902228712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762c120c5d8447d8bec5fe2c1c00acbe'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:57.833428 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c339785e-f418-4adc-bf25-556902228712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762c120c5d8447d8bec5fe2c1c00acbe'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:57.840961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c339785e-f418-4adc-bf25-556902228712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762c120c5d8447d8bec5fe2c1c00acbe'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:57.852753 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c339785e-f418-4adc-bf25-556902228712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762c120c5d8447d8bec5fe2c1c00acbe'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:57.858751 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1073/2109] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:57 2022] DELETE /identity/v3/users/762c120c5d8447d8bec5fe2c1c00acbe => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:57.860080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa13e2-ef6a-426b-ae8e-c359bf48da90 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:57.860385 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa13e2-ef6a-426b-ae8e-c359bf48da90 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:57.860668 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa13e2-ef6a-426b-ae8e-c359bf48da90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:57.887969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-cafa13e2-ef6a-426b-ae8e-c359bf48da90 None None] MFA Rules not processed for user `b42afc447b4a4c819c242ba22d9d97a2`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:57.889393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-cafa13e2-ef6a-426b-ae8e-c359bf48da90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:57.902463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-65f9193e-59dd-4971-9d46-898a44a00d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf5ca7849b84b49b3680f3b17205213', 'request_id': 'req-65f9193e-59dd-4971-9d46-898a44a00d77'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:57.911809 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-65f9193e-59dd-4971-9d46-898a44a00d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf5ca7849b84b49b3680f3b17205213', 'request_id': 'req-65f9193e-59dd-4971-9d46-898a44a00d77'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:57.923836 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-65f9193e-59dd-4971-9d46-898a44a00d77 admin admin] The token cache is being invalidate because project 4bf5ca7849b84b49b3680f3b17205213 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:57.924218 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-65f9193e-59dd-4971-9d46-898a44a00d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:57.925041 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-65f9193e-59dd-4971-9d46-898a44a00d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:57.929496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1037/2110] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:57 2022] DELETE /identity/v3/projects/4bf5ca7849b84b49b3680f3b17205213 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:57.929496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9193e-59dd-4971-9d46-898a44a00d77 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:57.929496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-65f9193e-59dd-4971-9d46-898a44a00d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:57.960457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1074/2111] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:57.965321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa13e2-ef6a-426b-ae8e-c359bf48da90 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:57.966740 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-cafa13e2-ef6a-426b-ae8e-c359bf48da90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:57.994554 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9193e-59dd-4971-9d46-898a44a00d77 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:58.048350 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d7f31-6a42-448a-969f-f0400fbbf435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:58.049019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d7f31-6a42-448a-969f-f0400fbbf435 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:58.049308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa13e2-ef6a-426b-ae8e-c359bf48da90 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:58.049748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d7f31-6a42-448a-969f-f0400fbbf435 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:58.049748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d7f31-6a42-448a-969f-f0400fbbf435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:58.052000 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-505d7f31-6a42-448a-969f-f0400fbbf435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:58.055713 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b549c-2137-491d-b3cc-4a060967bd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:58.056650 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b549c-2137-491d-b3cc-4a060967bd4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:58.056986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b549c-2137-491d-b3cc-4a060967bd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:58.057274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b549c-2137-491d-b3cc-4a060967bd4f admin admin] PATH_INFO: `/v3/users/1144cf39b3784abe97b57057e3bb126d` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:58.058623 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b549c-2137-491d-b3cc-4a060967bd4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1144cf39b3784abe97b57057e3bb126d)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:58.060586 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b549c-2137-491d-b3cc-4a060967bd4f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:58.065990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d7f31-6a42-448a-969f-f0400fbbf435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:58.068180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d7f31-6a42-448a-969f-f0400fbbf435 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:58.079862 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1038/2112] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:58.080783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d7f31-6a42-448a-969f-f0400fbbf435 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:58.082132 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-505d7f31-6a42-448a-969f-f0400fbbf435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:58.125568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:58.144613 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d7f31-6a42-448a-969f-f0400fbbf435 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:58.148884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1966c-78d3-420c-b898-693da8d74d87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:58.149562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1966c-78d3-420c-b898-693da8d74d87 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:58.149849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1966c-78d3-420c-b898-693da8d74d87 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:58.150129 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1966c-78d3-420c-b898-693da8d74d87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:58.160247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1966c-78d3-420c-b898-693da8d74d87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:58.162811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1966c-78d3-420c-b898-693da8d74d87 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:58.195161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1039/2113] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:00:58.301358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-563b549c-2137-491d-b3cc-4a060967bd4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1144cf39b3784abe97b57057e3bb126d'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:58.357799 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-563b549c-2137-491d-b3cc-4a060967bd4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1144cf39b3784abe97b57057e3bb126d'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:58.359008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-563b549c-2137-491d-b3cc-4a060967bd4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1144cf39b3784abe97b57057e3bb126d'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:58.370744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-563b549c-2137-491d-b3cc-4a060967bd4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1144cf39b3784abe97b57057e3bb126d'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:58.392999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-563b549c-2137-491d-b3cc-4a060967bd4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1144cf39b3784abe97b57057e3bb126d'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:58.400305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1075/2114] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:00:57 2022] DELETE /identity/v3/users/1144cf39b3784abe97b57057e3bb126d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:58.445128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1966c-78d3-420c-b898-693da8d74d87 service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:58.446701 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-49d1966c-78d3-420c-b898-693da8d74d87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:58.462748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1966c-78d3-420c-b898-693da8d74d87 service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:58.547159 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7955909-3c2a-4e30-afc9-3c7ee8c40c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:58.548046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7955909-3c2a-4e30-afc9-3c7ee8c40c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:58.548337 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7955909-3c2a-4e30-afc9-3c7ee8c40c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:58.548617 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7955909-3c2a-4e30-afc9-3c7ee8c40c13 admin admin] PATH_INFO: `/v3/projects/3844c6507b5e4ae6b072fe301c57e271` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:58.549862 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7955909-3c2a-4e30-afc9-3c7ee8c40c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3844c6507b5e4ae6b072fe301c57e271)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:58.552409 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7955909-3c2a-4e30-afc9-3c7ee8c40c13 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:58.671973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f7955909-3c2a-4e30-afc9-3c7ee8c40c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3844c6507b5e4ae6b072fe301c57e271', 'request_id': 'req-f7955909-3c2a-4e30-afc9-3c7ee8c40c13'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:58.696316 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:58.770179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f7955909-3c2a-4e30-afc9-3c7ee8c40c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3844c6507b5e4ae6b072fe301c57e271', 'request_id': 'req-f7955909-3c2a-4e30-afc9-3c7ee8c40c13'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:58.777880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f7955909-3c2a-4e30-afc9-3c7ee8c40c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3844c6507b5e4ae6b072fe301c57e271', 'request_id': 'req-f7955909-3c2a-4e30-afc9-3c7ee8c40c13'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:58.788885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f7955909-3c2a-4e30-afc9-3c7ee8c40c13 admin admin] The token cache is being invalidate because project 3844c6507b5e4ae6b072fe301c57e271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:58.789175 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f7955909-3c2a-4e30-afc9-3c7ee8c40c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:58.789824 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f7955909-3c2a-4e30-afc9-3c7ee8c40c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:58.791605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1040/2115] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:58 2022] DELETE /identity/v3/projects/3844c6507b5e4ae6b072fe301c57e271 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:58.797814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a682-5230-4a9d-abcc-f253debebd3c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:58.797814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a682-5230-4a9d-abcc-f253debebd3c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:58.797814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761a682-5230-4a9d-abcc-f253debebd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:58.823609 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-8761a682-5230-4a9d-abcc-f253debebd3c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:58.824885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8761a682-5230-4a9d-abcc-f253debebd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:58.909174 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1076/2116] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:58.917678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088b848-cf2f-4ed9-b29e-794498ea3a32 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:58.918160 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088b848-cf2f-4ed9-b29e-794498ea3a32 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:58.918376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088b848-cf2f-4ed9-b29e-794498ea3a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:58.937588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-9088b848-cf2f-4ed9-b29e-794498ea3a32 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:58.947310 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9088b848-cf2f-4ed9-b29e-794498ea3a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:58.950657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1041/2117] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:58.952151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761a682-5230-4a9d-abcc-f253debebd3c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:58.967432 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc7f2-52ab-43ce-86e8-eb42fbae8af1 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:58.967561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761a682-5230-4a9d-abcc-f253debebd3c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:58.967658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc7f2-52ab-43ce-86e8-eb42fbae8af1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:58.967658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc7f2-52ab-43ce-86e8-eb42fbae8af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:58.969250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341e13d-6a51-4cc2-8f9e-4454d8f2c6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:58.970821 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341e13d-6a51-4cc2-8f9e-4454d8f2c6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:58.971493 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341e13d-6a51-4cc2-8f9e-4454d8f2c6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:58.971607 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341e13d-6a51-4cc2-8f9e-4454d8f2c6b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:58.972439 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341e13d-6a51-4cc2-8f9e-4454d8f2c6b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:00:58.972857 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341e13d-6a51-4cc2-8f9e-4454d8f2c6b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:58.975437 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341e13d-6a51-4cc2-8f9e-4454d8f2c6b9 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:59.010836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1077/2118] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:00:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:00:59.011690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341e13d-6a51-4cc2-8f9e-4454d8f2c6b9 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:59.013681 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8341e13d-6a51-4cc2-8f9e-4454d8f2c6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:59.028382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341e13d-6a51-4cc2-8f9e-4454d8f2c6b9 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:59.028768 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-10adc7f2-52ab-43ce-86e8-eb42fbae8af1 None None] MFA Rules not processed for user `26280c423a1e4073b6955990d07be722`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:59.030726 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-10adc7f2-52ab-43ce-86e8-eb42fbae8af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:59.034849 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0b74c-e1ce-44f9-97b7-c74e0f068729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:59.036575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0b74c-e1ce-44f9-97b7-c74e0f068729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:59.036707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0b74c-e1ce-44f9-97b7-c74e0f068729 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:59.036879 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0b74c-e1ce-44f9-97b7-c74e0f068729 admin admin] PATH_INFO: `/v3/projects/7e30b3111d4e4f3481e26570a62379ea` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:59.038519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0b74c-e1ce-44f9-97b7-c74e0f068729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e30b3111d4e4f3481e26570a62379ea)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:59.040622 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0b74c-e1ce-44f9-97b7-c74e0f068729 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:59.132306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1042/2119] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:59.136568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc7f2-52ab-43ce-86e8-eb42fbae8af1 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:59.149437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc7f2-52ab-43ce-86e8-eb42fbae8af1 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:59.158374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a37b6-93dd-471c-b79c-bf2f80caf3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:59.158374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a37b6-93dd-471c-b79c-bf2f80caf3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:59.158374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a37b6-93dd-471c-b79c-bf2f80caf3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:59.158374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a37b6-93dd-471c-b79c-bf2f80caf3d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:59.158741 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a37b6-93dd-471c-b79c-bf2f80caf3d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:59.161802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a37b6-93dd-471c-b79c-bf2f80caf3d9 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:59.190819 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-62b0b74c-e1ce-44f9-97b7-c74e0f068729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e30b3111d4e4f3481e26570a62379ea', 'request_id': 'req-62b0b74c-e1ce-44f9-97b7-c74e0f068729'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:59.201216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-62b0b74c-e1ce-44f9-97b7-c74e0f068729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e30b3111d4e4f3481e26570a62379ea', 'request_id': 'req-62b0b74c-e1ce-44f9-97b7-c74e0f068729'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:59.209739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-62b0b74c-e1ce-44f9-97b7-c74e0f068729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e30b3111d4e4f3481e26570a62379ea', 'request_id': 'req-62b0b74c-e1ce-44f9-97b7-c74e0f068729'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:59.293257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-62b0b74c-e1ce-44f9-97b7-c74e0f068729 admin admin] The token cache is being invalidate because project 7e30b3111d4e4f3481e26570a62379ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:00:59.293654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-62b0b74c-e1ce-44f9-97b7-c74e0f068729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:59.295906 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-62b0b74c-e1ce-44f9-97b7-c74e0f068729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:00:59.296042 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1043/2120] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:59 2022] POST /identity/v3/projects => generated 399 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:59.296138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1078/2121] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:00:59 2022] DELETE /identity/v3/projects/7e30b3111d4e4f3481e26570a62379ea => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:00:59.296507 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a37b6-93dd-471c-b79c-bf2f80caf3d9 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:59.298166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d19a37b6-93dd-471c-b79c-bf2f80caf3d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:59.306133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0b74c-e1ce-44f9-97b7-c74e0f068729 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:59.307601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-62b0b74c-e1ce-44f9-97b7-c74e0f068729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:59.408700 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a37b6-93dd-471c-b79c-bf2f80caf3d9 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:59.418027 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4031ff0-8f67-4ceb-b808-27de7f4070b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:59.419426 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4031ff0-8f67-4ceb-b808-27de7f4070b6 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:59.419426 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4031ff0-8f67-4ceb-b808-27de7f4070b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:59.419999 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4031ff0-8f67-4ceb-b808-27de7f4070b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:59.421582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4031ff0-8f67-4ceb-b808-27de7f4070b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:59.423823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4031ff0-8f67-4ceb-b808-27de7f4070b6 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:59.427092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0b74c-e1ce-44f9-97b7-c74e0f068729 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:59.438760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba6122-554d-4ae0-b284-075ee39ff1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:59.439726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba6122-554d-4ae0-b284-075ee39ff1ca admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:59.445125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba6122-554d-4ae0-b284-075ee39ff1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:59.445125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba6122-554d-4ae0-b284-075ee39ff1ca admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:59.445125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba6122-554d-4ae0-b284-075ee39ff1ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:59.445125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ba6122-554d-4ae0-b284-075ee39ff1ca admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:59.555024 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1079/2122] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:59 2022] POST /identity/v3/users => generated 300 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:00:59.556089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba6122-554d-4ae0-b284-075ee39ff1ca admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:59.556990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1044/2123] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:00:59 2022] POST /identity/v3/projects => generated 403 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:59.557866 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4031ff0-8f67-4ceb-b808-27de7f4070b6 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:59.567244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba6122-554d-4ae0-b284-075ee39ff1ca admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:59.625130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4031ff0-8f67-4ceb-b808-27de7f4070b6 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:59.630655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39d23c-e7e2-481d-8c19-8b82f0186866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:59.631420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39d23c-e7e2-481d-8c19-8b82f0186866 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:59.631740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39d23c-e7e2-481d-8c19-8b82f0186866 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:59.632025 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39d23c-e7e2-481d-8c19-8b82f0186866 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:59.632689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39d23c-e7e2-481d-8c19-8b82f0186866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:59.633172 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8acdd-a430-4142-a119-9b5f5b0ec4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:59.634437 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8acdd-a430-4142-a119-9b5f5b0ec4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:59.634808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39d23c-e7e2-481d-8c19-8b82f0186866 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:59.635181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8acdd-a430-4142-a119-9b5f5b0ec4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:59.635676 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8acdd-a430-4142-a119-9b5f5b0ec4d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:59.636644 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8acdd-a430-4142-a119-9b5f5b0ec4d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:59.638722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8acdd-a430-4142-a119-9b5f5b0ec4d1 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:59.661598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1080/2124] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:59.665768 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8acdd-a430-4142-a119-9b5f5b0ec4d1 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:59.675719 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8acdd-a430-4142-a119-9b5f5b0ec4d1 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:59.680710 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5bff1-d7df-41c9-a7b1-cbce8a227c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:59.681416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5bff1-d7df-41c9-a7b1-cbce8a227c29 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:59.681707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5bff1-d7df-41c9-a7b1-cbce8a227c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:59.681989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5bff1-d7df-41c9-a7b1-cbce8a227c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:59.682758 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5bff1-d7df-41c9-a7b1-cbce8a227c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:59.684373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5bff1-d7df-41c9-a7b1-cbce8a227c29 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:59.695325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1081/2125] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:00:59.699600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5bff1-d7df-41c9-a7b1-cbce8a227c29 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:59.709935 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5bff1-d7df-41c9-a7b1-cbce8a227c29 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:59.715340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f32f94-f4c6-47de-b9a0-199d4616411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:59.716666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f32f94-f4c6-47de-b9a0-199d4616411f admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:59.717035 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f32f94-f4c6-47de-b9a0-199d4616411f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:59.717322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f32f94-f4c6-47de-b9a0-199d4616411f admin admin] PATH_INFO: `/v3/projects/327dea900fc54552a05e14b0f61689bd/users/5f2cd10efdce4feabe0f1205a51e1135/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:59.731868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f32f94-f4c6-47de-b9a0-199d4616411f admin admin] RBAC: Authorizing `identity:create_grant(project_id=327dea900fc54552a05e14b0f61689bd, user_id=5f2cd10efdce4feabe0f1205a51e1135, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:59.734701 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f32f94-f4c6-47de-b9a0-199d4616411f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:59.753358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:00:59.760824 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1045/2126] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:00:59 2022] POST /identity/v3/users => generated 308 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:00:59.764662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515edcd4-0e2c-4bea-b6bb-1b3b94a30204 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:59.764959 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515edcd4-0e2c-4bea-b6bb-1b3b94a30204 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:59.765239 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515edcd4-0e2c-4bea-b6bb-1b3b94a30204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:59.793735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-515edcd4-0e2c-4bea-b6bb-1b3b94a30204 None None] MFA Rules not processed for user `8521bf0e9bf3451a936586c387a79344`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:59.795010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-515edcd4-0e2c-4bea-b6bb-1b3b94a30204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:59.837432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1082/2127] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:59 2022] PUT /identity/v3/projects/327dea900fc54552a05e14b0f61689bd/users/5f2cd10efdce4feabe0f1205a51e1135/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:00:59.838733 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f32f94-f4c6-47de-b9a0-199d4616411f admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:59.863370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1046/2128] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:00:59.864687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc6e84-9d10-4644-8167-812ce648e7ef None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:59.864988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc6e84-9d10-4644-8167-812ce648e7ef None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:59.865277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc6e84-9d10-4644-8167-812ce648e7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:59.894612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-f6fc6e84-9d10-4644-8167-812ce648e7ef None None] MFA Rules not processed for user `5f2cd10efdce4feabe0f1205a51e1135`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:00:59.896407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f6fc6e84-9d10-4644-8167-812ce648e7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:59.911972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f32f94-f4c6-47de-b9a0-199d4616411f admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:59.916623 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87dac2-1f6f-4836-afd6-8f702717172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:59.917288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87dac2-1f6f-4836-afd6-8f702717172c admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:59.917573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87dac2-1f6f-4836-afd6-8f702717172c admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:59.917852 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87dac2-1f6f-4836-afd6-8f702717172c admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:59.918613 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87dac2-1f6f-4836-afd6-8f702717172c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:59.920332 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e87dac2-1f6f-4836-afd6-8f702717172c admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:00:59.930038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1083/2129] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:00:59.930958 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87dac2-1f6f-4836-afd6-8f702717172c admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:59.932638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9e87dac2-1f6f-4836-afd6-8f702717172c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:00:59.964293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1047/2130] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:00:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:00:59.964293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc6e84-9d10-4644-8167-812ce648e7ef None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:00:59.972126 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc6e84-9d10-4644-8167-812ce648e7ef None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:59.977245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166e843-293a-4ad0-a00e-eb6e7d225d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:00:59.978191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166e843-293a-4ad0-a00e-eb6e7d225d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:00:59.978487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166e843-293a-4ad0-a00e-eb6e7d225d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:00:59.978774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d166e843-293a-4ad0-a00e-eb6e7d225d14 admin admin] PATH_INFO: `/v3/projects/ca4019b9b5da4812b03d098d9735fb0f/users/a62c32092f514fa6a86c4492a4de235b/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:00:59.995787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166e843-293a-4ad0-a00e-eb6e7d225d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4019b9b5da4812b03d098d9735fb0f, user_id=a62c32092f514fa6a86c4492a4de235b, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:00:59.996662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87dac2-1f6f-4836-afd6-8f702717172c admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:00:59.998587 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d166e843-293a-4ad0-a00e-eb6e7d225d14 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:00.001282 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a0a49-b689-4b48-9411-b654012e382e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:00.002042 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a0a49-b689-4b48-9411-b654012e382e service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:00.002461 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a0a49-b689-4b48-9411-b654012e382e service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:00.002838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a0a49-b689-4b48-9411-b654012e382e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:00.059574 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a0a49-b689-4b48-9411-b654012e382e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:00.060959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a0a49-b689-4b48-9411-b654012e382e service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:00.070515 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1084/2131] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:00:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:00.071350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a0a49-b689-4b48-9411-b654012e382e service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:00.082718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a0a49-b689-4b48-9411-b654012e382e service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:00.088088 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058292c-4f34-4a1d-a1a5-6628cab02bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:00.088747 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058292c-4f34-4a1d-a1a5-6628cab02bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:00.089054 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058292c-4f34-4a1d-a1a5-6628cab02bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:00.089318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058292c-4f34-4a1d-a1a5-6628cab02bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:00.090011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058292c-4f34-4a1d-a1a5-6628cab02bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:00.091955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058292c-4f34-4a1d-a1a5-6628cab02bb4 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:00.373966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1085/2133] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:01:00 2022] POST /identity/v3/projects => generated 401 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:00.374796 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1048/2133] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:00:59 2022] PUT /identity/v3/projects/ca4019b9b5da4812b03d098d9735fb0f/users/a62c32092f514fa6a86c4492a4de235b/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:00.375329 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058292c-4f34-4a1d-a1a5-6628cab02bb4 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:00.376738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166e843-293a-4ad0-a00e-eb6e7d225d14 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:00.446161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d166e843-293a-4ad0-a00e-eb6e7d225d14 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:00.451245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded03033-2972-47d5-b395-531556befac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:00.452145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded03033-2972-47d5-b395-531556befac7 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:00.457437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded03033-2972-47d5-b395-531556befac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:00.457437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded03033-2972-47d5-b395-531556befac7 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:00.457437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded03033-2972-47d5-b395-531556befac7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:00.457437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded03033-2972-47d5-b395-531556befac7 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:00.463892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058292c-4f34-4a1d-a1a5-6628cab02bb4 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:00.470455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bdcde-a24f-4694-b383-d79327d8c4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:00.471324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bdcde-a24f-4694-b383-d79327d8c4cc admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:00.471756 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bdcde-a24f-4694-b383-d79327d8c4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:00.472171 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bdcde-a24f-4694-b383-d79327d8c4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:00.473613 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bdcde-a24f-4694-b383-d79327d8c4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:00.475636 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bdcde-a24f-4694-b383-d79327d8c4cc admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:00.488196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1086/2134] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:00.493015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bdcde-a24f-4694-b383-d79327d8c4cc admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:00.503240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bdcde-a24f-4694-b383-d79327d8c4cc admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:00.508639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd077f-065e-4d38-b82c-9bd75836f59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:00.520432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd077f-065e-4d38-b82c-9bd75836f59f admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:00.520432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd077f-065e-4d38-b82c-9bd75836f59f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:00.520432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd077f-065e-4d38-b82c-9bd75836f59f admin admin] PATH_INFO: `/v3/projects/ca4019b9b5da4812b03d098d9735fb0f/users/a62c32092f514fa6a86c4492a4de235b/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:00.520432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd077f-065e-4d38-b82c-9bd75836f59f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4019b9b5da4812b03d098d9735fb0f, user_id=a62c32092f514fa6a86c4492a4de235b, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:00.520432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd077f-065e-4d38-b82c-9bd75836f59f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:00.527004 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1087/2135] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:00 2022] PUT /identity/v3/projects/ca4019b9b5da4812b03d098d9735fb0f/users/a62c32092f514fa6a86c4492a4de235b/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:01:00.546382 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1049/2136] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:01:00 2022] POST /identity/v3/users => generated 307 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:00.550170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd077f-065e-4d38-b82c-9bd75836f59f admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:00.612659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd077f-065e-4d38-b82c-9bd75836f59f admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:00.617716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236cf78-2dab-4c33-a92d-c6b4a4f976db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:00.618421 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236cf78-2dab-4c33-a92d-c6b4a4f976db admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:00.618707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236cf78-2dab-4c33-a92d-c6b4a4f976db admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:00.619115 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236cf78-2dab-4c33-a92d-c6b4a4f976db admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:00.620181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236cf78-2dab-4c33-a92d-c6b4a4f976db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:00.622377 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236cf78-2dab-4c33-a92d-c6b4a4f976db admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:00.639549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1088/2137] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:00.640774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded03033-2972-47d5-b395-531556befac7 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:00.653037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded03033-2972-47d5-b395-531556befac7 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:00.660215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b84ea-8e7d-407d-aefc-7a5ab25c3095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:00.662019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b84ea-8e7d-407d-aefc-7a5ab25c3095 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:00.662320 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b84ea-8e7d-407d-aefc-7a5ab25c3095 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:00.664151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b84ea-8e7d-407d-aefc-7a5ab25c3095 admin admin] PATH_INFO: `/v3/projects/b7fb81b59c5d486c939567707f665a6e/users/934f74b4cb2f446d8e61306f58866818/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:00.682579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b84ea-8e7d-407d-aefc-7a5ab25c3095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fb81b59c5d486c939567707f665a6e, user_id=934f74b4cb2f446d8e61306f58866818, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:00.685389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b84ea-8e7d-407d-aefc-7a5ab25c3095 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:00.800175 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1050/2138] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:00 2022] PUT /identity/v3/projects/b7fb81b59c5d486c939567707f665a6e/users/934f74b4cb2f446d8e61306f58866818/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:00.809320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236cf78-2dab-4c33-a92d-c6b4a4f976db admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:00.826730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236cf78-2dab-4c33-a92d-c6b4a4f976db admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:00.892139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc3b0c-0ae7-4bef-b8f8-e43f3af66ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:00.892895 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc3b0c-0ae7-4bef-b8f8-e43f3af66ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:00.893193 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc3b0c-0ae7-4bef-b8f8-e43f3af66ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:00.893689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc3b0c-0ae7-4bef-b8f8-e43f3af66ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:00.894476 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc3b0c-0ae7-4bef-b8f8-e43f3af66ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:00.896193 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc3b0c-0ae7-4bef-b8f8-e43f3af66ef1 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:00.907506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1089/2139] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:00 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:01:00.911828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b84ea-8e7d-407d-aefc-7a5ab25c3095 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:00.931270 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b84ea-8e7d-407d-aefc-7a5ab25c3095 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:00.936349 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073704e-17f5-4f1f-894b-12e11d9f699f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:00.937248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073704e-17f5-4f1f-894b-12e11d9f699f admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:00.937542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073704e-17f5-4f1f-894b-12e11d9f699f admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:00.937825 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073704e-17f5-4f1f-894b-12e11d9f699f admin admin] PATH_INFO: `/v3/projects/b7fb81b59c5d486c939567707f665a6e/users/934f74b4cb2f446d8e61306f58866818/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:00.940214 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073704e-17f5-4f1f-894b-12e11d9f699f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7fb81b59c5d486c939567707f665a6e, user_id=934f74b4cb2f446d8e61306f58866818, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:00.943811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073704e-17f5-4f1f-894b-12e11d9f699f admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:00.956002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1051/2140] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:00 2022] PUT /identity/v3/projects/b7fb81b59c5d486c939567707f665a6e/users/934f74b4cb2f446d8e61306f58866818/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:00.965995 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff94ed-f789-43b4-acc6-a36f53818da7 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:00.966762 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff94ed-f789-43b4-acc6-a36f53818da7 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:00.967046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff94ed-f789-43b4-acc6-a36f53818da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:01.001894 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-f8ff94ed-f789-43b4-acc6-a36f53818da7 None None] MFA Rules not processed for user `934f74b4cb2f446d8e61306f58866818`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:01.003766 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f8ff94ed-f789-43b4-acc6-a36f53818da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:01.079808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1090/2141] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:00 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:01.092266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073704e-17f5-4f1f-894b-12e11d9f699f admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:01.094938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-3073704e-17f5-4f1f-894b-12e11d9f699f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:01.160868 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073704e-17f5-4f1f-894b-12e11d9f699f admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:01.164603 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03342af-01b8-49d5-bcfb-b2f815646adf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:01.165259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03342af-01b8-49d5-bcfb-b2f815646adf service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:01.165551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03342af-01b8-49d5-bcfb-b2f815646adf service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:01.165943 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03342af-01b8-49d5-bcfb-b2f815646adf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:01.182315 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03342af-01b8-49d5-bcfb-b2f815646adf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:01.183862 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03342af-01b8-49d5-bcfb-b2f815646adf service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:01.195836 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1052/2142] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:01 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:01.415146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff94ed-f789-43b4-acc6-a36f53818da7 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:01.425108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff94ed-f789-43b4-acc6-a36f53818da7 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:01.429766 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54851065-d3eb-4819-baba-842a6d6adf5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:01.430537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54851065-d3eb-4819-baba-842a6d6adf5d service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:01.430981 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54851065-d3eb-4819-baba-842a6d6adf5d service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:01.433071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54851065-d3eb-4819-baba-842a6d6adf5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:01.489919 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54851065-d3eb-4819-baba-842a6d6adf5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:01.491409 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54851065-d3eb-4819-baba-842a6d6adf5d service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:01.500315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1091/2143] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:01.777437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:01.849677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7392d6-af76-4f7f-80ea-956861385877 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:01.849981 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7392d6-af76-4f7f-80ea-956861385877 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:01.850289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7392d6-af76-4f7f-80ea-956861385877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:01.891124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-0a7392d6-af76-4f7f-80ea-956861385877 None None] MFA Rules not processed for user `a62c32092f514fa6a86c4492a4de235b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:01.898042 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-0a7392d6-af76-4f7f-80ea-956861385877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:01.951804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd60bb0-ade7-4921-a1e3-4753b6dfb467 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:01.952351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd60bb0-ade7-4921-a1e3-4753b6dfb467 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:01.952993 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd60bb0-ade7-4921-a1e3-4753b6dfb467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:01.977182 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-7bd60bb0-ade7-4921-a1e3-4753b6dfb467 None None] MFA Rules not processed for user `8521bf0e9bf3451a936586c387a79344`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:01.978699 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-7bd60bb0-ade7-4921-a1e3-4753b6dfb467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:01.995970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1053/2144] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:01 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:01:02.039292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1092/2145] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:02.749671 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a293400-93da-43d6-b364-a99402225a7a None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:02.751739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:02.756960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a293400-93da-43d6-b364-a99402225a7a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:02.757321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a293400-93da-43d6-b364-a99402225a7a None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:02.758917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1054/2146] 10.222.0.15 () {54 vars in 921 bytes} [Fri May 27 20:01:02 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 20:01:02.769094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e92d0-3c1d-4bbc-a91e-289ce523e14d None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:02.769392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e92d0-3c1d-4bbc-a91e-289ce523e14d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:02.770294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e92d0-3c1d-4bbc-a91e-289ce523e14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:02.797120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-ad7e92d0-3c1d-4bbc-a91e-289ce523e14d None None] MFA Rules not processed for user `394b43cef91f4990b4707cb7a6798068`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:02.798332 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ad7e92d0-3c1d-4bbc-a91e-289ce523e14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:02.874792 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1093/2147] 10.222.0.15 () {58 vars in 1018 bytes} [Fri May 27 20:01:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:02.887415 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a293400-93da-43d6-b364-a99402225a7a None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:02.889274 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-0a293400-93da-43d6-b364-a99402225a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:02.916972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a293400-93da-43d6-b364-a99402225a7a None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:02.922461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075055d1-e880-4369-81f6-8ba00a4a253d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394b43cef91f4990b4707cb7a6798068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:02.923135 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075055d1-e880-4369-81f6-8ba00a4a253d service placement] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:02.923430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075055d1-e880-4369-81f6-8ba00a4a253d service placement] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:02.923714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075055d1-e880-4369-81f6-8ba00a4a253d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:02.933492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075055d1-e880-4369-81f6-8ba00a4a253d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:02.937041 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075055d1-e880-4369-81f6-8ba00a4a253d service placement] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:02.947207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1055/2148] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:03.604794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e92d0-3c1d-4bbc-a91e-289ce523e14d None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:03.667220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e92d0-3c1d-4bbc-a91e-289ce523e14d None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:03.676309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876871a7-821f-41d5-90a5-da65efe64f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:03.679704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876871a7-821f-41d5-90a5-da65efe64f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:03.679704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876871a7-821f-41d5-90a5-da65efe64f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:03.680392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876871a7-821f-41d5-90a5-da65efe64f79 admin admin] PATH_INFO: `/v3/users/26280c423a1e4073b6955990d07be722` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:03.681881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876871a7-821f-41d5-90a5-da65efe64f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26280c423a1e4073b6955990d07be722)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:03.686111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876871a7-821f-41d5-90a5-da65efe64f79 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:03.929571 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:03.934516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-876871a7-821f-41d5-90a5-da65efe64f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26280c423a1e4073b6955990d07be722'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:04.015587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-876871a7-821f-41d5-90a5-da65efe64f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26280c423a1e4073b6955990d07be722'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:04.016682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-876871a7-821f-41d5-90a5-da65efe64f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26280c423a1e4073b6955990d07be722'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:04.024530 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-876871a7-821f-41d5-90a5-da65efe64f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26280c423a1e4073b6955990d07be722'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:04.036760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-876871a7-821f-41d5-90a5-da65efe64f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26280c423a1e4073b6955990d07be722'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:04.043318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1094/2149] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:01:03 2022] DELETE /identity/v3/users/26280c423a1e4073b6955990d07be722 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:04.285623 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075055d1-e880-4369-81f6-8ba00a4a253d service placement] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:04.304216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075055d1-e880-4369-81f6-8ba00a4a253d service placement] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:04.367191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:04.371266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:04.371266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:04.371266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663 admin admin] PATH_INFO: `/v3/projects/46fb8e7b906f44a1879a94e1a56ab5d5` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:04.371266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46fb8e7b906f44a1879a94e1a56ab5d5)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:04.371732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:04.512732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46fb8e7b906f44a1879a94e1a56ab5d5', 'request_id': 'req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:04.632578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46fb8e7b906f44a1879a94e1a56ab5d5', 'request_id': 'req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:04.639293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46fb8e7b906f44a1879a94e1a56ab5d5', 'request_id': 'req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:04.650215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663 admin admin] The token cache is being invalidate because project 46fb8e7b906f44a1879a94e1a56ab5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:01:04.650543 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:04.654114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:04.654114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1056/2150] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:01:04 2022] DELETE /identity/v3/projects/46fb8e7b906f44a1879a94e1a56ab5d5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:01:04.656734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876871a7-821f-41d5-90a5-da65efe64f79 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:04.658182 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-876871a7-821f-41d5-90a5-da65efe64f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:04.670903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876871a7-821f-41d5-90a5-da65efe64f79 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:04.727270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1fd7b-8a76-447b-aa35-3676a0be1c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:04.728148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1fd7b-8a76-447b-aa35-3676a0be1c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:04.728439 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1fd7b-8a76-447b-aa35-3676a0be1c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:04.728724 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1fd7b-8a76-447b-aa35-3676a0be1c6e admin admin] PATH_INFO: `/v3/users/a62c32092f514fa6a86c4492a4de235b` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:04.731198 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1fd7b-8a76-447b-aa35-3676a0be1c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a62c32092f514fa6a86c4492a4de235b)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:04.733296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1fd7b-8a76-447b-aa35-3676a0be1c6e admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:04.826776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:04.887151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8ae1fd7b-8a76-447b-aa35-3676a0be1c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a62c32092f514fa6a86c4492a4de235b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:04.938434 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8ae1fd7b-8a76-447b-aa35-3676a0be1c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a62c32092f514fa6a86c4492a4de235b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:04.939092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8ae1fd7b-8a76-447b-aa35-3676a0be1c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a62c32092f514fa6a86c4492a4de235b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:04.947921 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8ae1fd7b-8a76-447b-aa35-3676a0be1c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a62c32092f514fa6a86c4492a4de235b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:04.961455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8ae1fd7b-8a76-447b-aa35-3676a0be1c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a62c32092f514fa6a86c4492a4de235b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:04.976355 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1095/2151] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:01:04 2022] DELETE /identity/v3/users/a62c32092f514fa6a86c4492a4de235b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:05.326542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:05.336815 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:05.339078 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:05.360837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6fbb9d-7d28-4927-8cc0-c65d1329b663 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:05.435609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8318c-ba4a-4ed7-989d-c410c2615dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:05.436637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8318c-ba4a-4ed7-989d-c410c2615dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:05.437547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8318c-ba4a-4ed7-989d-c410c2615dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:05.437547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8318c-ba4a-4ed7-989d-c410c2615dfc admin admin] PATH_INFO: `/v3/projects/ca4019b9b5da4812b03d098d9735fb0f` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:05.438632 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8318c-ba4a-4ed7-989d-c410c2615dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4019b9b5da4812b03d098d9735fb0f)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:05.440681 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8318c-ba4a-4ed7-989d-c410c2615dfc admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:05.581362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-18a8318c-ba4a-4ed7-989d-c410c2615dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4019b9b5da4812b03d098d9735fb0f', 'request_id': 'req-18a8318c-ba4a-4ed7-989d-c410c2615dfc'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:05.661391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-18a8318c-ba4a-4ed7-989d-c410c2615dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4019b9b5da4812b03d098d9735fb0f', 'request_id': 'req-18a8318c-ba4a-4ed7-989d-c410c2615dfc'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:05.669334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-18a8318c-ba4a-4ed7-989d-c410c2615dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4019b9b5da4812b03d098d9735fb0f', 'request_id': 'req-18a8318c-ba4a-4ed7-989d-c410c2615dfc'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:05.680397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-18a8318c-ba4a-4ed7-989d-c410c2615dfc admin admin] The token cache is being invalidate because project ca4019b9b5da4812b03d098d9735fb0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:01:05.680694 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-18a8318c-ba4a-4ed7-989d-c410c2615dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:05.681346 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-18a8318c-ba4a-4ed7-989d-c410c2615dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:05.682969 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1057/2152] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:01:05 2022] DELETE /identity/v3/projects/ca4019b9b5da4812b03d098d9735fb0f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:05.688101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0da344-2888-49f8-bccd-0a2fbe0e7244 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:05.688413 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0da344-2888-49f8-bccd-0a2fbe0e7244 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:05.688694 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0da344-2888-49f8-bccd-0a2fbe0e7244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:05.708209 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-ee0da344-2888-49f8-bccd-0a2fbe0e7244 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:05.709416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ee0da344-2888-49f8-bccd-0a2fbe0e7244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:05.782587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1096/2153] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:05.791050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b8dec-3b5e-4058-807b-7d934f0b9a72 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:05.791556 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b8dec-3b5e-4058-807b-7d934f0b9a72 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:05.791912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b8dec-3b5e-4058-807b-7d934f0b9a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:05.811402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-e82b8dec-3b5e-4058-807b-7d934f0b9a72 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:05.812854 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e82b8dec-3b5e-4058-807b-7d934f0b9a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:05.821448 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1058/2154] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:05.825661 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0da344-2888-49f8-bccd-0a2fbe0e7244 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:05.837608 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0da344-2888-49f8-bccd-0a2fbe0e7244 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:05.843045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1d74a-3df1-4beb-a66a-b9d8ce8a8c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:05.843371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1d74a-3df1-4beb-a66a-b9d8ce8a8c55 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:05.843663 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1d74a-3df1-4beb-a66a-b9d8ce8a8c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:05.843948 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1d74a-3df1-4beb-a66a-b9d8ce8a8c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:05.844686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1d74a-3df1-4beb-a66a-b9d8ce8a8c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:01:05.844998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1d74a-3df1-4beb-a66a-b9d8ce8a8c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:05.846759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1d74a-3df1-4beb-a66a-b9d8ce8a8c55 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:05.859544 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1097/2155] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:01:05.864245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b8dec-3b5e-4058-807b-7d934f0b9a72 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:05.874136 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b8dec-3b5e-4058-807b-7d934f0b9a72 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:05.879424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7eeaf-d7ee-45b2-b305-3b7c89a98337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:05.880130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7eeaf-d7ee-45b2-b305-3b7c89a98337 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:05.880416 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7eeaf-d7ee-45b2-b305-3b7c89a98337 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:05.880690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7eeaf-d7ee-45b2-b305-3b7c89a98337 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:05.881571 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7eeaf-d7ee-45b2-b305-3b7c89a98337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:05.883347 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7eeaf-d7ee-45b2-b305-3b7c89a98337 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:05.995646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1059/2156] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:01:05 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:01:05.996747 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1d74a-3df1-4beb-a66a-b9d8ce8a8c55 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:06.008276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1d74a-3df1-4beb-a66a-b9d8ce8a8c55 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:06.064975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bd9f9-76d0-4ca2-9915-d89b1796a8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:06.065925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bd9f9-76d0-4ca2-9915-d89b1796a8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:06.067251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bd9f9-76d0-4ca2-9915-d89b1796a8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:06.067251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bd9f9-76d0-4ca2-9915-d89b1796a8d6 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:06.067834 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bd9f9-76d0-4ca2-9915-d89b1796a8d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:06.069917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bd9f9-76d0-4ca2-9915-d89b1796a8d6 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:06.212485 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1098/2157] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:01:05 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:01:06.215377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7eeaf-d7ee-45b2-b305-3b7c89a98337 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:06.225683 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7eeaf-d7ee-45b2-b305-3b7c89a98337 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:06.230208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05ce6b-ab84-4596-9aea-77e153c0e595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:06.230824 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05ce6b-ab84-4596-9aea-77e153c0e595 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:06.231104 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05ce6b-ab84-4596-9aea-77e153c0e595 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:06.231404 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05ce6b-ab84-4596-9aea-77e153c0e595 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:06.232105 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05ce6b-ab84-4596-9aea-77e153c0e595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:06.233726 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05ce6b-ab84-4596-9aea-77e153c0e595 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:06.248183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1060/2158] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:06.250160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bd9f9-76d0-4ca2-9915-d89b1796a8d6 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:06.265214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bd9f9-76d0-4ca2-9915-d89b1796a8d6 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:06.274873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54921a1f-b256-4950-80a8-7971b5e90755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:06.275771 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54921a1f-b256-4950-80a8-7971b5e90755 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:06.276496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54921a1f-b256-4950-80a8-7971b5e90755 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:06.276784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54921a1f-b256-4950-80a8-7971b5e90755 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:06.277526 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54921a1f-b256-4950-80a8-7971b5e90755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:06.279307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54921a1f-b256-4950-80a8-7971b5e90755 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:06.297584 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1099/2159] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:06.304155 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05ce6b-ab84-4596-9aea-77e153c0e595 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:06.309659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05ce6b-ab84-4596-9aea-77e153c0e595 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:06.326249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad496d7a-39a7-41d3-a6ca-37a1d58703e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:06.327711 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad496d7a-39a7-41d3-a6ca-37a1d58703e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:06.328259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad496d7a-39a7-41d3-a6ca-37a1d58703e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:06.328348 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad496d7a-39a7-41d3-a6ca-37a1d58703e7 admin admin] PATH_INFO: `/v3/projects/c8f63506e9264c50b254369fb9c69fc0/users/9109ec7610c741a091bc3d793c1a4b75/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:06.347841 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad496d7a-39a7-41d3-a6ca-37a1d58703e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f63506e9264c50b254369fb9c69fc0, user_id=9109ec7610c741a091bc3d793c1a4b75, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:06.350998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad496d7a-39a7-41d3-a6ca-37a1d58703e7 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:06.478720 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1061/2160] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:06 2022] PUT /identity/v3/projects/c8f63506e9264c50b254369fb9c69fc0/users/9109ec7610c741a091bc3d793c1a4b75/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:06.489244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aab86-1066-40ac-95e5-f60e0baf412b None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:06.489506 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aab86-1066-40ac-95e5-f60e0baf412b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:06.489783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aab86-1066-40ac-95e5-f60e0baf412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:06.517813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-937aab86-1066-40ac-95e5-f60e0baf412b None None] MFA Rules not processed for user `9109ec7610c741a091bc3d793c1a4b75`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:06.518973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-937aab86-1066-40ac-95e5-f60e0baf412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:06.614137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1100/2161] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:06.618595 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad496d7a-39a7-41d3-a6ca-37a1d58703e7 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:06.707054 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:06.711560 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad496d7a-39a7-41d3-a6ca-37a1d58703e7 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:06.712263 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aab86-1066-40ac-95e5-f60e0baf412b None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:06.714000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-937aab86-1066-40ac-95e5-f60e0baf412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:06.717780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463f56c-d6f6-4c90-ac2b-13f17e8699d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:06.718890 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463f56c-d6f6-4c90-ac2b-13f17e8699d9 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:06.719383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463f56c-d6f6-4c90-ac2b-13f17e8699d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:06.719861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463f56c-d6f6-4c90-ac2b-13f17e8699d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:06.720750 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463f56c-d6f6-4c90-ac2b-13f17e8699d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:06.724171 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463f56c-d6f6-4c90-ac2b-13f17e8699d9 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:06.729964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aab86-1066-40ac-95e5-f60e0baf412b None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:06.735014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb41ff4f-11c5-4fb3-841c-967e225020eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:06.736009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41ff4f-11c5-4fb3-841c-967e225020eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:06.736301 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41ff4f-11c5-4fb3-841c-967e225020eb admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:06.736746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb41ff4f-11c5-4fb3-841c-967e225020eb admin admin] PATH_INFO: `/v3/users/5f2cd10efdce4feabe0f1205a51e1135` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:06.738169 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41ff4f-11c5-4fb3-841c-967e225020eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f2cd10efdce4feabe0f1205a51e1135)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:06.743975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb41ff4f-11c5-4fb3-841c-967e225020eb admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:06.824751 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1062/2162] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:01:06 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:06.825677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463f56c-d6f6-4c90-ac2b-13f17e8699d9 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:06.893303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463f56c-d6f6-4c90-ac2b-13f17e8699d9 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:06.898242 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01580c69-6d3a-4c41-90c0-e688ee67bb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:06.898951 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01580c69-6d3a-4c41-90c0-e688ee67bb46 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:06.899242 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01580c69-6d3a-4c41-90c0-e688ee67bb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:06.899524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01580c69-6d3a-4c41-90c0-e688ee67bb46 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:06.900254 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01580c69-6d3a-4c41-90c0-e688ee67bb46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:06.902172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01580c69-6d3a-4c41-90c0-e688ee67bb46 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:06.936825 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:06.946935 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-eb41ff4f-11c5-4fb3-841c-967e225020eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f2cd10efdce4feabe0f1205a51e1135'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:07.013444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1063/2163] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:01:06 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:07.017197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01580c69-6d3a-4c41-90c0-e688ee67bb46 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:07.027287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01580c69-6d3a-4c41-90c0-e688ee67bb46 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:07.031875 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56b713-bc38-4130-9a26-e17c887fdd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:07.032507 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56b713-bc38-4130-9a26-e17c887fdd86 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:07.032795 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56b713-bc38-4130-9a26-e17c887fdd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:07.033080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56b713-bc38-4130-9a26-e17c887fdd86 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:07.033795 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56b713-bc38-4130-9a26-e17c887fdd86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:07.036061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56b713-bc38-4130-9a26-e17c887fdd86 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:07.037254 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-eb41ff4f-11c5-4fb3-841c-967e225020eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f2cd10efdce4feabe0f1205a51e1135'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:07.038560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-eb41ff4f-11c5-4fb3-841c-967e225020eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f2cd10efdce4feabe0f1205a51e1135'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:07.047351 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1064/2164] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:01:07.048129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-eb41ff4f-11c5-4fb3-841c-967e225020eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f2cd10efdce4feabe0f1205a51e1135'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:07.054293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56b713-bc38-4130-9a26-e17c887fdd86 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:07.056708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cb56b713-bc38-4130-9a26-e17c887fdd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:07.071395 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56b713-bc38-4130-9a26-e17c887fdd86 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:07.071618 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-eb41ff4f-11c5-4fb3-841c-967e225020eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f2cd10efdce4feabe0f1205a51e1135'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:07.077511 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca103a-6bf0-40f6-b39b-710a80d3e1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:07.078663 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca103a-6bf0-40f6-b39b-710a80d3e1b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:07.079023 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca103a-6bf0-40f6-b39b-710a80d3e1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:07.079376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca103a-6bf0-40f6-b39b-710a80d3e1b0 admin admin] PATH_INFO: `/v3/projects/f237b024493f4f55882f7c20b0cf2c33/users/64426f33b69c476486888f698c62cfad/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:07.085998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1101/2165] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:01:06 2022] DELETE /identity/v3/users/5f2cd10efdce4feabe0f1205a51e1135 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:01:07.091880 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd08f9d-a82b-4682-93ba-c93ab274b711 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:07.092243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd08f9d-a82b-4682-93ba-c93ab274b711 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:07.092469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd08f9d-a82b-4682-93ba-c93ab274b711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:07.113336 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-3fd08f9d-a82b-4682-93ba-c93ab274b711 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:07.114609 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-3fd08f9d-a82b-4682-93ba-c93ab274b711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:07.115545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca103a-6bf0-40f6-b39b-710a80d3e1b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f237b024493f4f55882f7c20b0cf2c33, user_id=64426f33b69c476486888f698c62cfad, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:07.121158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca103a-6bf0-40f6-b39b-710a80d3e1b0 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:07.177143 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1102/2166] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:07.187867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd08f9d-a82b-4682-93ba-c93ab274b711 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:07.189321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-3fd08f9d-a82b-4682-93ba-c93ab274b711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:07.204987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1065/2167] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:07 2022] PUT /identity/v3/projects/f237b024493f4f55882f7c20b0cf2c33/users/64426f33b69c476486888f698c62cfad/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:07.205947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca103a-6bf0-40f6-b39b-710a80d3e1b0 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:07.278439 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd08f9d-a82b-4682-93ba-c93ab274b711 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:07.289221 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca103a-6bf0-40f6-b39b-710a80d3e1b0 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:07.294082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969bc7b-b16f-4985-886b-410858a5d960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:07.294845 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969bc7b-b16f-4985-886b-410858a5d960 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:07.295274 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969bc7b-b16f-4985-886b-410858a5d960 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:07.295607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969bc7b-b16f-4985-886b-410858a5d960 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:07.296341 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969bc7b-b16f-4985-886b-410858a5d960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:07.298433 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969bc7b-b16f-4985-886b-410858a5d960 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:07.313950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1066/2168] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:07.315087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969bc7b-b16f-4985-886b-410858a5d960 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:07.328963 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969bc7b-b16f-4985-886b-410858a5d960 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:07.335608 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810522ab-466c-48c3-9f18-3065b28666a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:07.336831 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810522ab-466c-48c3-9f18-3065b28666a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:07.337125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810522ab-466c-48c3-9f18-3065b28666a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:07.337410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810522ab-466c-48c3-9f18-3065b28666a8 admin admin] PATH_INFO: `/v3/projects/f237b024493f4f55882f7c20b0cf2c33/users/64426f33b69c476486888f698c62cfad/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:07.339748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810522ab-466c-48c3-9f18-3065b28666a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f237b024493f4f55882f7c20b0cf2c33, user_id=64426f33b69c476486888f698c62cfad, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:07.348038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0a9cd-fd4f-4f04-bbca-acc6ddd58892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:07.348038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0a9cd-fd4f-4f04-bbca-acc6ddd58892 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:07.348038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0a9cd-fd4f-4f04-bbca-acc6ddd58892 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:07.348038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0a9cd-fd4f-4f04-bbca-acc6ddd58892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:07.348574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810522ab-466c-48c3-9f18-3065b28666a8 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:07.352744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0a9cd-fd4f-4f04-bbca-acc6ddd58892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:07.354692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0a9cd-fd4f-4f04-bbca-acc6ddd58892 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:07.355556 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1067/2169] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:07 2022] PUT /identity/v3/projects/f237b024493f4f55882f7c20b0cf2c33/users/64426f33b69c476486888f698c62cfad/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:07.364343 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1103/2170] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:01:07.366947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7e9b2-e48b-4db8-8ca8-8b6a3517aea0 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:07.367293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7e9b2-e48b-4db8-8ca8-8b6a3517aea0 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:07.367537 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7e9b2-e48b-4db8-8ca8-8b6a3517aea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:07.454974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-50a7e9b2-e48b-4db8-8ca8-8b6a3517aea0 None None] MFA Rules not processed for user `64426f33b69c476486888f698c62cfad`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:07.455757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-50a7e9b2-e48b-4db8-8ca8-8b6a3517aea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:07.553979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1068/2171] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:07.566801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0a9cd-fd4f-4f04-bbca-acc6ddd58892 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:07.568308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ead0a9cd-fd4f-4f04-bbca-acc6ddd58892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:07.634006 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0a9cd-fd4f-4f04-bbca-acc6ddd58892 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:07.686052 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c108eb-13c7-46d8-bcd1-e7a088e84b18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:07.686741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c108eb-13c7-46d8-bcd1-e7a088e84b18 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:07.687030 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c108eb-13c7-46d8-bcd1-e7a088e84b18 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:07.687319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c108eb-13c7-46d8-bcd1-e7a088e84b18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:07.696738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c108eb-13c7-46d8-bcd1-e7a088e84b18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:07.698187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c108eb-13c7-46d8-bcd1-e7a088e84b18 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:07.709036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1104/2172] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:07.727489 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:07.738644 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7e9b2-e48b-4db8-8ca8-8b6a3517aea0 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:07.804308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7e9b2-e48b-4db8-8ca8-8b6a3517aea0 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:07.809034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6597526-59a4-4eb4-ad71-06e81743c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:07.809921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6597526-59a4-4eb4-ad71-06e81743c55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:07.810216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6597526-59a4-4eb4-ad71-06e81743c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:07.810551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6597526-59a4-4eb4-ad71-06e81743c55e admin admin] PATH_INFO: `/v3/users/9109ec7610c741a091bc3d793c1a4b75` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:07.813320 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6597526-59a4-4eb4-ad71-06e81743c55e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9109ec7610c741a091bc3d793c1a4b75)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:07.814498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6597526-59a4-4eb4-ad71-06e81743c55e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:07.938237 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c108eb-13c7-46d8-bcd1-e7a088e84b18 service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:07.939692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a8c108eb-13c7-46d8-bcd1-e7a088e84b18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:07.953424 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c108eb-13c7-46d8-bcd1-e7a088e84b18 service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:07.958032 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ca181-281b-4c5d-a3d4-29530d9c7aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:07.958934 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ca181-281b-4c5d-a3d4-29530d9c7aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:07.959222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ca181-281b-4c5d-a3d4-29530d9c7aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:07.959504 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ca181-281b-4c5d-a3d4-29530d9c7aa8 admin admin] PATH_INFO: `/v3/projects/327dea900fc54552a05e14b0f61689bd` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:07.962044 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ca181-281b-4c5d-a3d4-29530d9c7aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=327dea900fc54552a05e14b0f61689bd)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:07.964119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ca181-281b-4c5d-a3d4-29530d9c7aa8 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:08.038431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a6597526-59a4-4eb4-ad71-06e81743c55e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9109ec7610c741a091bc3d793c1a4b75'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:08.039116 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a6597526-59a4-4eb4-ad71-06e81743c55e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9109ec7610c741a091bc3d793c1a4b75'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:08.052965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:08.092954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a6597526-59a4-4eb4-ad71-06e81743c55e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9109ec7610c741a091bc3d793c1a4b75'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:08.094891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-368ca181-281b-4c5d-a3d4-29530d9c7aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '327dea900fc54552a05e14b0f61689bd', 'request_id': 'req-368ca181-281b-4c5d-a3d4-29530d9c7aa8'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:08.101684 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-368ca181-281b-4c5d-a3d4-29530d9c7aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '327dea900fc54552a05e14b0f61689bd', 'request_id': 'req-368ca181-281b-4c5d-a3d4-29530d9c7aa8'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:08.106915 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a6597526-59a4-4eb4-ad71-06e81743c55e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9109ec7610c741a091bc3d793c1a4b75'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:08.107820 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-368ca181-281b-4c5d-a3d4-29530d9c7aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '327dea900fc54552a05e14b0f61689bd', 'request_id': 'req-368ca181-281b-4c5d-a3d4-29530d9c7aa8'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:08.114061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a6597526-59a4-4eb4-ad71-06e81743c55e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9109ec7610c741a091bc3d793c1a4b75'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:08.120081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1069/2173] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:01:07 2022] DELETE /identity/v3/users/9109ec7610c741a091bc3d793c1a4b75 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:01:08.124818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52873-dd11-4a5c-924f-65f4add6a8c2 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:08.125193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52873-dd11-4a5c-924f-65f4add6a8c2 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:08.125537 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db52873-dd11-4a5c-924f-65f4add6a8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:08.144727 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-0db52873-dd11-4a5c-924f-65f4add6a8c2 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:08.145928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-0db52873-dd11-4a5c-924f-65f4add6a8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:08.185379 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-368ca181-281b-4c5d-a3d4-29530d9c7aa8 admin admin] The token cache is being invalidate because project 327dea900fc54552a05e14b0f61689bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:01:08.185704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-368ca181-281b-4c5d-a3d4-29530d9c7aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:08.186361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-368ca181-281b-4c5d-a3d4-29530d9c7aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:08.188268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1105/2174] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:01:07 2022] DELETE /identity/v3/projects/327dea900fc54552a05e14b0f61689bd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:01:08.192309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ca181-281b-4c5d-a3d4-29530d9c7aa8 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:08.193605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-368ca181-281b-4c5d-a3d4-29530d9c7aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:08.208089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1070/2175] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:01:08.217816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db52873-dd11-4a5c-924f-65f4add6a8c2 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:08.219259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-0db52873-dd11-4a5c-924f-65f4add6a8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:08.264819 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ca181-281b-4c5d-a3d4-29530d9c7aa8 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:08.271193 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b98d0-ad12-4f0f-ac67-1f6d4ded1d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:08.272219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b98d0-ad12-4f0f-ac67-1f6d4ded1d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:08.273809 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b98d0-ad12-4f0f-ac67-1f6d4ded1d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:08.273809 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b98d0-ad12-4f0f-ac67-1f6d4ded1d97 admin admin] PATH_INFO: `/v3/users/934f74b4cb2f446d8e61306f58866818` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:08.274759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b98d0-ad12-4f0f-ac67-1f6d4ded1d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=934f74b4cb2f446d8e61306f58866818)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:08.277072 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b98d0-ad12-4f0f-ac67-1f6d4ded1d97 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:08.291438 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db52873-dd11-4a5c-924f-65f4add6a8c2 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:08.295411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bda77-3a27-490c-880b-c2f8067130f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:08.296315 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bda77-3a27-490c-880b-c2f8067130f3 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:08.296800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bda77-3a27-490c-880b-c2f8067130f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:08.297090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bda77-3a27-490c-880b-c2f8067130f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:08.307081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bda77-3a27-490c-880b-c2f8067130f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:08.308567 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bda77-3a27-490c-880b-c2f8067130f3 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:08.318888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1071/2176] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:08.504003 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-bf9b98d0-ad12-4f0f-ac67-1f6d4ded1d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934f74b4cb2f446d8e61306f58866818'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:08.569907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-bf9b98d0-ad12-4f0f-ac67-1f6d4ded1d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934f74b4cb2f446d8e61306f58866818'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:08.570462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-bf9b98d0-ad12-4f0f-ac67-1f6d4ded1d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934f74b4cb2f446d8e61306f58866818'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:08.579697 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-bf9b98d0-ad12-4f0f-ac67-1f6d4ded1d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934f74b4cb2f446d8e61306f58866818'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:08.592492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:08.595776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-bf9b98d0-ad12-4f0f-ac67-1f6d4ded1d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934f74b4cb2f446d8e61306f58866818'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:08.603697 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1106/2177] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:01:08 2022] DELETE /identity/v3/users/934f74b4cb2f446d8e61306f58866818 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:01:08.765170 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bda77-3a27-490c-880b-c2f8067130f3 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:08.766647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-7f1bda77-3a27-490c-880b-c2f8067130f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:08.800103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bda77-3a27-490c-880b-c2f8067130f3 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:08.908574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66236ebf-49a5-4426-af4b-dec07ee59ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:08.909477 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66236ebf-49a5-4426-af4b-dec07ee59ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:08.909805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66236ebf-49a5-4426-af4b-dec07ee59ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:08.910091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66236ebf-49a5-4426-af4b-dec07ee59ab5 admin admin] PATH_INFO: `/v3/projects/c8f63506e9264c50b254369fb9c69fc0` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:08.911856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66236ebf-49a5-4426-af4b-dec07ee59ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8f63506e9264c50b254369fb9c69fc0)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:08.913918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66236ebf-49a5-4426-af4b-dec07ee59ab5 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:09.050210 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:09.075416 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-66236ebf-49a5-4426-af4b-dec07ee59ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8f63506e9264c50b254369fb9c69fc0', 'request_id': 'req-66236ebf-49a5-4426-af4b-dec07ee59ab5'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:09.157798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-66236ebf-49a5-4426-af4b-dec07ee59ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8f63506e9264c50b254369fb9c69fc0', 'request_id': 'req-66236ebf-49a5-4426-af4b-dec07ee59ab5'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:09.165027 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-66236ebf-49a5-4426-af4b-dec07ee59ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8f63506e9264c50b254369fb9c69fc0', 'request_id': 'req-66236ebf-49a5-4426-af4b-dec07ee59ab5'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:09.176233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-66236ebf-49a5-4426-af4b-dec07ee59ab5 admin admin] The token cache is being invalidate because project c8f63506e9264c50b254369fb9c69fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:01:09.176531 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-66236ebf-49a5-4426-af4b-dec07ee59ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:09.177177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-66236ebf-49a5-4426-af4b-dec07ee59ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:09.178953 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1072/2178] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:01:08 2022] DELETE /identity/v3/projects/c8f63506e9264c50b254369fb9c69fc0 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:09.182807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b98d0-ad12-4f0f-ac67-1f6d4ded1d97 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:09.184198 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-bf9b98d0-ad12-4f0f-ac67-1f6d4ded1d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:09.197812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b98d0-ad12-4f0f-ac67-1f6d4ded1d97 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:09.249570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66236ebf-49a5-4426-af4b-dec07ee59ab5 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:09.252949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-66236ebf-49a5-4426-af4b-dec07ee59ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:09.267936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234aed36-b719-4783-bb2b-3afd3dcd33b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:09.269605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234aed36-b719-4783-bb2b-3afd3dcd33b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:09.270246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234aed36-b719-4783-bb2b-3afd3dcd33b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:09.270555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234aed36-b719-4783-bb2b-3afd3dcd33b3 admin admin] PATH_INFO: `/v3/users/64426f33b69c476486888f698c62cfad` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:09.271661 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234aed36-b719-4783-bb2b-3afd3dcd33b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64426f33b69c476486888f698c62cfad)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:09.273754 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234aed36-b719-4783-bb2b-3afd3dcd33b3 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:09.326746 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66236ebf-49a5-4426-af4b-dec07ee59ab5 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:09.331350 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36574fdf-c716-4dc2-a4e3-1050fd80bfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:09.332745 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36574fdf-c716-4dc2-a4e3-1050fd80bfda admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:09.333029 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36574fdf-c716-4dc2-a4e3-1050fd80bfda admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:09.333338 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36574fdf-c716-4dc2-a4e3-1050fd80bfda admin admin] PATH_INFO: `/v3/projects/b7fb81b59c5d486c939567707f665a6e` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:09.334547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36574fdf-c716-4dc2-a4e3-1050fd80bfda admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7fb81b59c5d486c939567707f665a6e)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:09.336470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36574fdf-c716-4dc2-a4e3-1050fd80bfda admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:09.495471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-36574fdf-c716-4dc2-a4e3-1050fd80bfda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7fb81b59c5d486c939567707f665a6e', 'request_id': 'req-36574fdf-c716-4dc2-a4e3-1050fd80bfda'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:09.495699 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-234aed36-b719-4783-bb2b-3afd3dcd33b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64426f33b69c476486888f698c62cfad'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:09.569074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-234aed36-b719-4783-bb2b-3afd3dcd33b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64426f33b69c476486888f698c62cfad'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:09.569703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-234aed36-b719-4783-bb2b-3afd3dcd33b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64426f33b69c476486888f698c62cfad'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:09.577545 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-234aed36-b719-4783-bb2b-3afd3dcd33b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64426f33b69c476486888f698c62cfad'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:09.590219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-234aed36-b719-4783-bb2b-3afd3dcd33b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64426f33b69c476486888f698c62cfad'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:09.596410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1107/2179] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:01:09 2022] DELETE /identity/v3/users/64426f33b69c476486888f698c62cfad => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:09.649192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-36574fdf-c716-4dc2-a4e3-1050fd80bfda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7fb81b59c5d486c939567707f665a6e', 'request_id': 'req-36574fdf-c716-4dc2-a4e3-1050fd80bfda'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:09.660652 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-36574fdf-c716-4dc2-a4e3-1050fd80bfda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7fb81b59c5d486c939567707f665a6e', 'request_id': 'req-36574fdf-c716-4dc2-a4e3-1050fd80bfda'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:09.680390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-36574fdf-c716-4dc2-a4e3-1050fd80bfda admin admin] The token cache is being invalidate because project b7fb81b59c5d486c939567707f665a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:01:09.680741 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-36574fdf-c716-4dc2-a4e3-1050fd80bfda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:09.681402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-36574fdf-c716-4dc2-a4e3-1050fd80bfda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:09.683368 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1073/2180] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:01:09 2022] DELETE /identity/v3/projects/b7fb81b59c5d486c939567707f665a6e => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:09.688007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eca58a-76d8-4a13-9a71-a834e66344eb None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:09.688299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eca58a-76d8-4a13-9a71-a834e66344eb None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:09.688585 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eca58a-76d8-4a13-9a71-a834e66344eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:09.695345 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:09.707885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-26eca58a-76d8-4a13-9a71-a834e66344eb None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:09.709136 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-26eca58a-76d8-4a13-9a71-a834e66344eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:09.769876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1108/2181] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:09.777945 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f03d7-257b-4f96-8533-334c0072a556 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:09.778295 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f03d7-257b-4f96-8533-334c0072a556 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:09.778643 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f03d7-257b-4f96-8533-334c0072a556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:09.797532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b17f03d7-257b-4f96-8533-334c0072a556 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:09.798835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b17f03d7-257b-4f96-8533-334c0072a556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:09.807634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1074/2182] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:09.811859 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eca58a-76d8-4a13-9a71-a834e66344eb None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:09.822046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eca58a-76d8-4a13-9a71-a834e66344eb None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:09.826717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d59a0-8fb5-49c4-9481-97a00fc3eba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:09.827370 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d59a0-8fb5-49c4-9481-97a00fc3eba4 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:09.827719 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d59a0-8fb5-49c4-9481-97a00fc3eba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:09.827929 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d59a0-8fb5-49c4-9481-97a00fc3eba4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:09.828720 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d59a0-8fb5-49c4-9481-97a00fc3eba4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:01:09.829040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d59a0-8fb5-49c4-9481-97a00fc3eba4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:09.830664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d59a0-8fb5-49c4-9481-97a00fc3eba4 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:09.845972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1109/2183] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:01:09.847614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f03d7-257b-4f96-8533-334c0072a556 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:09.858886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f03d7-257b-4f96-8533-334c0072a556 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:09.864609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd2dd1-2ed2-4713-94bd-eb81c4763c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:09.865605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd2dd1-2ed2-4713-94bd-eb81c4763c98 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:09.865964 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd2dd1-2ed2-4713-94bd-eb81c4763c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:09.866313 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd2dd1-2ed2-4713-94bd-eb81c4763c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:09.867050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd2dd1-2ed2-4713-94bd-eb81c4763c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:09.868989 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd2dd1-2ed2-4713-94bd-eb81c4763c98 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:09.890051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:10.009135 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1075/2184] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:01:09 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:01:10.013409 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d59a0-8fb5-49c4-9481-97a00fc3eba4 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:10.023729 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d59a0-8fb5-49c4-9481-97a00fc3eba4 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:10.081229 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ca556-5ee6-4182-8d19-57f75183dca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:10.082428 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ca556-5ee6-4182-8d19-57f75183dca2 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:10.082724 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ca556-5ee6-4182-8d19-57f75183dca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:10.083005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ca556-5ee6-4182-8d19-57f75183dca2 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:10.083719 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ca556-5ee6-4182-8d19-57f75183dca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:10.086438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ca556-5ee6-4182-8d19-57f75183dca2 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:10.094309 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd2dd1-2ed2-4713-94bd-eb81c4763c98 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:10.096533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-3bcd2dd1-2ed2-4713-94bd-eb81c4763c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:10.110526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd2dd1-2ed2-4713-94bd-eb81c4763c98 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:10.115254 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8993d-f73e-43c0-8c5a-85bf1854830c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:10.116117 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8993d-f73e-43c0-8c5a-85bf1854830c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:10.116413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8993d-f73e-43c0-8c5a-85bf1854830c admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:10.116704 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8993d-f73e-43c0-8c5a-85bf1854830c admin admin] PATH_INFO: `/v3/projects/f237b024493f4f55882f7c20b0cf2c33` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:10.117897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8993d-f73e-43c0-8c5a-85bf1854830c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f237b024493f4f55882f7c20b0cf2c33)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:10.119932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8993d-f73e-43c0-8c5a-85bf1854830c admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:10.232545 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1110/2185] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:01:10 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:10.236600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ca556-5ee6-4182-8d19-57f75183dca2 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:10.245981 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ca556-5ee6-4182-8d19-57f75183dca2 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:10.250893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c809f-71ce-41d2-9c33-65673aac0b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:10.251527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c809f-71ce-41d2-9c33-65673aac0b49 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:10.251817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c809f-71ce-41d2-9c33-65673aac0b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:10.252100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c809f-71ce-41d2-9c33-65673aac0b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:10.252850 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c809f-71ce-41d2-9c33-65673aac0b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:10.255024 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c809f-71ce-41d2-9c33-65673aac0b49 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:10.264843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1111/2186] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:01:10.268418 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c809f-71ce-41d2-9c33-65673aac0b49 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:10.278949 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c809f-71ce-41d2-9c33-65673aac0b49 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:10.283742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ea839-eb1d-4ef0-80a5-c1b3d6d50c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:10.284381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea839-eb1d-4ef0-80a5-c1b3d6d50c97 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:10.284672 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea839-eb1d-4ef0-80a5-c1b3d6d50c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:10.284952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea839-eb1d-4ef0-80a5-c1b3d6d50c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:10.285674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ea839-eb1d-4ef0-80a5-c1b3d6d50c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:10.287308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ea839-eb1d-4ef0-80a5-c1b3d6d50c97 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:10.301445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1112/2187] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:01:10.329645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ea839-eb1d-4ef0-80a5-c1b3d6d50c97 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:10.329645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ea839-eb1d-4ef0-80a5-c1b3d6d50c97 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:10.329645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5da27-c255-49d6-b01b-e74fd4750a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:10.329645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5da27-c255-49d6-b01b-e74fd4750a56 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:10.330066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5da27-c255-49d6-b01b-e74fd4750a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:10.330066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5da27-c255-49d6-b01b-e74fd4750a56 admin admin] PATH_INFO: `/v3/projects/fcce3d108bda41ba8b517df89364efe9/users/ac766f08f7fb4cdbbb90b5e7c8e52226/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:10.334840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5da27-c255-49d6-b01b-e74fd4750a56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcce3d108bda41ba8b517df89364efe9, user_id=ac766f08f7fb4cdbbb90b5e7c8e52226, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:10.337460 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5da27-c255-49d6-b01b-e74fd4750a56 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:10.493797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1113/2188] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:10 2022] PUT /identity/v3/projects/fcce3d108bda41ba8b517df89364efe9/users/ac766f08f7fb4cdbbb90b5e7c8e52226/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:10.499641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2b847-c1fc-4f77-9e5a-de1469ecf7bf None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:10.499951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2b847-c1fc-4f77-9e5a-de1469ecf7bf None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:10.500221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2b847-c1fc-4f77-9e5a-de1469ecf7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:10.504478 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9ba8993d-f73e-43c0-8c5a-85bf1854830c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f237b024493f4f55882f7c20b0cf2c33', 'request_id': 'req-9ba8993d-f73e-43c0-8c5a-85bf1854830c'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:10.517499 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-2ad2b847-c1fc-4f77-9e5a-de1469ecf7bf None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:10.518768 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2ad2b847-c1fc-4f77-9e5a-de1469ecf7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:10.572759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9ba8993d-f73e-43c0-8c5a-85bf1854830c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f237b024493f4f55882f7c20b0cf2c33', 'request_id': 'req-9ba8993d-f73e-43c0-8c5a-85bf1854830c'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:10.581439 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9ba8993d-f73e-43c0-8c5a-85bf1854830c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f237b024493f4f55882f7c20b0cf2c33', 'request_id': 'req-9ba8993d-f73e-43c0-8c5a-85bf1854830c'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:10.584752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1114/2189] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:01:10.591169 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2b847-c1fc-4f77-9e5a-de1469ecf7bf None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:10.592588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2ad2b847-c1fc-4f77-9e5a-de1469ecf7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:10.593397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9ba8993d-f73e-43c0-8c5a-85bf1854830c admin admin] The token cache is being invalidate because project f237b024493f4f55882f7c20b0cf2c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:01:10.593706 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9ba8993d-f73e-43c0-8c5a-85bf1854830c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:10.594382 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9ba8993d-f73e-43c0-8c5a-85bf1854830c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:10.596123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1076/2190] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:01:10 2022] DELETE /identity/v3/projects/f237b024493f4f55882f7c20b0cf2c33 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:01:10.600726 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd3147-69ad-40cb-8c97-11c25ce7cdb1 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:10.601028 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd3147-69ad-40cb-8c97-11c25ce7cdb1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:10.601328 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd3147-69ad-40cb-8c97-11c25ce7cdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:10.619756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-87fd3147-69ad-40cb-8c97-11c25ce7cdb1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:10.620979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-87fd3147-69ad-40cb-8c97-11c25ce7cdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:10.630279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1077/2191] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:10.637495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed5399-3f47-47cf-97e3-5bc6c5a0da3a None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:10.637888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed5399-3f47-47cf-97e3-5bc6c5a0da3a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:10.638176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed5399-3f47-47cf-97e3-5bc6c5a0da3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:10.652033 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2b847-c1fc-4f77-9e5a-de1469ecf7bf None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:10.655781 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fcdf2-d86e-46dd-adbf-0935813602fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:10.656430 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fcdf2-d86e-46dd-adbf-0935813602fe service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:10.656717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fcdf2-d86e-46dd-adbf-0935813602fe service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:10.656995 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0fcdf2-d86e-46dd-adbf-0935813602fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:10.658496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-afed5399-3f47-47cf-97e3-5bc6c5a0da3a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:10.659015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-dd0fcdf2-d86e-46dd-adbf-0935813602fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:10.665948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-afed5399-3f47-47cf-97e3-5bc6c5a0da3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:10.668302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1078/2192] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:10.670971 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fcdf2-d86e-46dd-adbf-0935813602fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:10.672383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed5399-3f47-47cf-97e3-5bc6c5a0da3a None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:10.672538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0fcdf2-d86e-46dd-adbf-0935813602fe service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:10.681613 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed5399-3f47-47cf-97e3-5bc6c5a0da3a None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:10.682844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1115/2193] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:01:10.686388 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336b3b6-7673-4a84-8e32-9030c8e766a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:10.687036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336b3b6-7673-4a84-8e32-9030c8e766a6 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:10.687322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336b3b6-7673-4a84-8e32-9030c8e766a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:10.687601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336b3b6-7673-4a84-8e32-9030c8e766a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:10.688327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336b3b6-7673-4a84-8e32-9030c8e766a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:01:10.689051 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336b3b6-7673-4a84-8e32-9030c8e766a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:10.690206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336b3b6-7673-4a84-8e32-9030c8e766a6 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:10.702714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1079/2194] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 20:01:10.707567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fcdf2-d86e-46dd-adbf-0935813602fe service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:10.717561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0fcdf2-d86e-46dd-adbf-0935813602fe service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:10.722889 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1675812-b2f4-4a06-bc86-8d885c448b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:10.723614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1675812-b2f4-4a06-bc86-8d885c448b7f admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:10.723926 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1675812-b2f4-4a06-bc86-8d885c448b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:10.724206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1675812-b2f4-4a06-bc86-8d885c448b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:10.724896 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1675812-b2f4-4a06-bc86-8d885c448b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:10.726941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1675812-b2f4-4a06-bc86-8d885c448b7f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:10.735128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:10.809313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1116/2195] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:01:10 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:01:10.810608 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336b3b6-7673-4a84-8e32-9030c8e766a6 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:10.821562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336b3b6-7673-4a84-8e32-9030c8e766a6 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:10.885891 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff806615-459e-43fd-ae6d-fc6c28429e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:10.886616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff806615-459e-43fd-ae6d-fc6c28429e8a admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:10.886903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff806615-459e-43fd-ae6d-fc6c28429e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:10.887182 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff806615-459e-43fd-ae6d-fc6c28429e8a admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:10.887909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff806615-459e-43fd-ae6d-fc6c28429e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:10.888305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:10.890228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff806615-459e-43fd-ae6d-fc6c28429e8a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:10.981673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1080/2196] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:01:10 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:01:10.985732 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1675812-b2f4-4a06-bc86-8d885c448b7f admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:10.996103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1675812-b2f4-4a06-bc86-8d885c448b7f admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:11.001027 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d7cc-08e4-45d1-a234-745dd4e29c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:11.001678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d7cc-08e4-45d1-a234-745dd4e29c04 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:11.001964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d7cc-08e4-45d1-a234-745dd4e29c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:11.002244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d7cc-08e4-45d1-a234-745dd4e29c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:11.003008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5d7cc-08e4-45d1-a234-745dd4e29c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:11.005111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5d7cc-08e4-45d1-a234-745dd4e29c04 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:11.016190 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1117/2197] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:11.021181 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff806615-459e-43fd-ae6d-fc6c28429e8a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:11.031458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff806615-459e-43fd-ae6d-fc6c28429e8a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:11.036936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2985736-498f-47de-9e8d-3ff8b54b2a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:11.041524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2985736-498f-47de-9e8d-3ff8b54b2a32 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:11.041524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2985736-498f-47de-9e8d-3ff8b54b2a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:11.041524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2985736-498f-47de-9e8d-3ff8b54b2a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:11.041524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2985736-498f-47de-9e8d-3ff8b54b2a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:11.041524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2985736-498f-47de-9e8d-3ff8b54b2a32 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:11.051289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1081/2198] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:11.055498 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d7cc-08e4-45d1-a234-745dd4e29c04 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:11.066840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d7cc-08e4-45d1-a234-745dd4e29c04 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:11.084082 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec268bb-3f06-45d7-932b-4d04310dccf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:11.084987 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec268bb-3f06-45d7-932b-4d04310dccf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:11.085276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec268bb-3f06-45d7-932b-4d04310dccf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:11.085560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec268bb-3f06-45d7-932b-4d04310dccf2 admin admin] PATH_INFO: `/v3/projects/f158b4b9bf9f4dde8dad8ceb46cca958/users/7db75345e7974209be99277359d17bac/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:11.100601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec268bb-3f06-45d7-932b-4d04310dccf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f158b4b9bf9f4dde8dad8ceb46cca958, user_id=7db75345e7974209be99277359d17bac, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:11.103476 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec268bb-3f06-45d7-932b-4d04310dccf2 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:11.163878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1118/2199] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:11 2022] PUT /identity/v3/projects/f158b4b9bf9f4dde8dad8ceb46cca958/users/7db75345e7974209be99277359d17bac/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:11.174081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51225b-0436-42c0-a867-d39d5d479420 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:11.174413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51225b-0436-42c0-a867-d39d5d479420 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:11.174714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51225b-0436-42c0-a867-d39d5d479420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:11.201746 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-fe51225b-0436-42c0-a867-d39d5d479420 None None] MFA Rules not processed for user `7db75345e7974209be99277359d17bac`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:11.203042 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-fe51225b-0436-42c0-a867-d39d5d479420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:11.274768 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1082/2200] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:11.279390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec268bb-3f06-45d7-932b-4d04310dccf2 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:11.354950 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec268bb-3f06-45d7-932b-4d04310dccf2 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:11.360180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c6b7c-e5dc-4a69-b139-b0b121be3e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:11.360837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c6b7c-e5dc-4a69-b139-b0b121be3e01 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:11.361159 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c6b7c-e5dc-4a69-b139-b0b121be3e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:11.366205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c6b7c-e5dc-4a69-b139-b0b121be3e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:11.366205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c6b7c-e5dc-4a69-b139-b0b121be3e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:11.366205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c6b7c-e5dc-4a69-b139-b0b121be3e01 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:11.481901 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1119/2201] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:01:11 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:11.486231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51225b-0436-42c0-a867-d39d5d479420 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:11.500052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51225b-0436-42c0-a867-d39d5d479420 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:11.585354 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c41b0-57d1-46ef-a5f5-6f2a741da9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:11.586051 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c41b0-57d1-46ef-a5f5-6f2a741da9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:11.586460 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c41b0-57d1-46ef-a5f5-6f2a741da9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:11.586747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c41b0-57d1-46ef-a5f5-6f2a741da9d3 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:11.587453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c41b0-57d1-46ef-a5f5-6f2a741da9d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:11.589482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c41b0-57d1-46ef-a5f5-6f2a741da9d3 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:11.669670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1083/2202] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:01:11 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:01:11.673928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c6b7c-e5dc-4a69-b139-b0b121be3e01 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:11.686759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c6b7c-e5dc-4a69-b139-b0b121be3e01 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:11.689486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95b421-b046-4f7c-8815-c34ae9e5e286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:11.690153 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95b421-b046-4f7c-8815-c34ae9e5e286 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:11.690523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95b421-b046-4f7c-8815-c34ae9e5e286 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:11.690845 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95b421-b046-4f7c-8815-c34ae9e5e286 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:11.691586 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95b421-b046-4f7c-8815-c34ae9e5e286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:11.693226 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95b421-b046-4f7c-8815-c34ae9e5e286 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:11.703989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1120/2203] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:11.708839 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c41b0-57d1-46ef-a5f5-6f2a741da9d3 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:11.720510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c41b0-57d1-46ef-a5f5-6f2a741da9d3 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:11.729503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea345713-8957-4c20-bfe0-976c1b3b8513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:11.730443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea345713-8957-4c20-bfe0-976c1b3b8513 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:11.730729 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea345713-8957-4c20-bfe0-976c1b3b8513 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:11.731110 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea345713-8957-4c20-bfe0-976c1b3b8513 admin admin] PATH_INFO: `/v3/projects/815c5b4c0cc448989db99326bf716ad6/users/0172c2f6c4604b788e791fae2cb758c5/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:11.751414 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea345713-8957-4c20-bfe0-976c1b3b8513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=815c5b4c0cc448989db99326bf716ad6, user_id=0172c2f6c4604b788e791fae2cb758c5, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:11.754724 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea345713-8957-4c20-bfe0-976c1b3b8513 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:11.835062 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1084/2204] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:11 2022] PUT /identity/v3/projects/815c5b4c0cc448989db99326bf716ad6/users/0172c2f6c4604b788e791fae2cb758c5/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:11.839160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95b421-b046-4f7c-8815-c34ae9e5e286 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:11.850090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95b421-b046-4f7c-8815-c34ae9e5e286 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:11.885870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:11.918634 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620a1d0-35d8-420a-a638-44ccea61bb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:11.919673 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620a1d0-35d8-420a-a638-44ccea61bb01 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:11.919965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620a1d0-35d8-420a-a638-44ccea61bb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:11.920504 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620a1d0-35d8-420a-a638-44ccea61bb01 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:11.921265 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620a1d0-35d8-420a-a638-44ccea61bb01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:11.923139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620a1d0-35d8-420a-a638-44ccea61bb01 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:11.934614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1121/2205] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:11.938698 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea345713-8957-4c20-bfe0-976c1b3b8513 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:11.950184 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea345713-8957-4c20-bfe0-976c1b3b8513 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:11.955288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df723604-4e1f-4e17-97fd-955d94f4f179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:11.956210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723604-4e1f-4e17-97fd-955d94f4f179 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:11.957080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723604-4e1f-4e17-97fd-955d94f4f179 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:11.957355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723604-4e1f-4e17-97fd-955d94f4f179 admin admin] PATH_INFO: `/v3/projects/815c5b4c0cc448989db99326bf716ad6/users/0172c2f6c4604b788e791fae2cb758c5/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:11.959386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df723604-4e1f-4e17-97fd-955d94f4f179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=815c5b4c0cc448989db99326bf716ad6, user_id=0172c2f6c4604b788e791fae2cb758c5, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:11.962810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df723604-4e1f-4e17-97fd-955d94f4f179 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:11.974014 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1085/2206] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:11 2022] PUT /identity/v3/projects/815c5b4c0cc448989db99326bf716ad6/users/0172c2f6c4604b788e791fae2cb758c5/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:11.985870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec3226-96fa-4a6a-ba22-3d87f52bbe54 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:11.986240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec3226-96fa-4a6a-ba22-3d87f52bbe54 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:11.986639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec3226-96fa-4a6a-ba22-3d87f52bbe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:12.020568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-b4ec3226-96fa-4a6a-ba22-3d87f52bbe54 None None] MFA Rules not processed for user `0172c2f6c4604b788e791fae2cb758c5`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:12.021963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b4ec3226-96fa-4a6a-ba22-3d87f52bbe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:12.095157 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:12.101775 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1122/2207] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:12.119071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df723604-4e1f-4e17-97fd-955d94f4f179 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:12.121366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-df723604-4e1f-4e17-97fd-955d94f4f179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:12.186769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df723604-4e1f-4e17-97fd-955d94f4f179 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:12.190496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84b0fe-2c9a-4067-82a5-79fa9c9b6f72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:12.191290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84b0fe-2c9a-4067-82a5-79fa9c9b6f72 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:12.191578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84b0fe-2c9a-4067-82a5-79fa9c9b6f72 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:12.191920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84b0fe-2c9a-4067-82a5-79fa9c9b6f72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:12.201227 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84b0fe-2c9a-4067-82a5-79fa9c9b6f72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:12.202697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84b0fe-2c9a-4067-82a5-79fa9c9b6f72 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:12.222492 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1086/2208] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:12.296920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d250e-7bbf-40d3-83bf-6fb1dabcedf9 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:12.297838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d250e-7bbf-40d3-83bf-6fb1dabcedf9 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:12.298134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d250e-7bbf-40d3-83bf-6fb1dabcedf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:12.332709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-494d250e-7bbf-40d3-83bf-6fb1dabcedf9 None None] MFA Rules not processed for user `ac766f08f7fb4cdbbb90b5e7c8e52226`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:12.334076 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-494d250e-7bbf-40d3-83bf-6fb1dabcedf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:12.416311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1123/2209] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:12.574628 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:12.663996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84b0fe-2c9a-4067-82a5-79fa9c9b6f72 service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:12.665383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-6d84b0fe-2c9a-4067-82a5-79fa9c9b6f72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:12.678106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84b0fe-2c9a-4067-82a5-79fa9c9b6f72 service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:12.681916 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a1ba8-70b7-4ae5-8103-f7388c5e759f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:12.682621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a1ba8-70b7-4ae5-8103-f7388c5e759f service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:12.682914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a1ba8-70b7-4ae5-8103-f7388c5e759f service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:12.683199 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a1ba8-70b7-4ae5-8103-f7388c5e759f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:12.691687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a1ba8-70b7-4ae5-8103-f7388c5e759f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:12.693106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252a1ba8-70b7-4ae5-8103-f7388c5e759f service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:12.701855 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1087/2210] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:13.018464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:13.275227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d250e-7bbf-40d3-83bf-6fb1dabcedf9 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:13.293311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d250e-7bbf-40d3-83bf-6fb1dabcedf9 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:13.311551 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b6a12-20df-4c5d-a6bb-55d0b8c65c8a tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0172c2f6c4604b788e791fae2cb758c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '815c5b4c0cc448989db99326bf716ad6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:13.312083 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b6a12-20df-4c5d-a6bb-55d0b8c65c8a tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:13.312345 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b6a12-20df-4c5d-a6bb-55d0b8c65c8a tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:13.312756 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b6a12-20df-4c5d-a6bb-55d0b8c65c8a tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:13.313558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b6a12-20df-4c5d-a6bb-55d0b8c65c8a tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:01:13.313883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b6a12-20df-4c5d-a6bb-55d0b8c65c8a tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:13.315577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b6a12-20df-4c5d-a6bb-55d0b8c65c8a tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:13.334835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1124/2211] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:01:13.344127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a1ba8-70b7-4ae5-8103-f7388c5e759f service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:13.359609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a1ba8-70b7-4ae5-8103-f7388c5e759f service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:13.366196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55356e49-8b61-4e7e-ab1a-bff48bb5752b tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0172c2f6c4604b788e791fae2cb758c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '815c5b4c0cc448989db99326bf716ad6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:13.367228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55356e49-8b61-4e7e-ab1a-bff48bb5752b tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:13.370247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55356e49-8b61-4e7e-ab1a-bff48bb5752b tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:13.370247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55356e49-8b61-4e7e-ab1a-bff48bb5752b tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:13.370247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55356e49-8b61-4e7e-ab1a-bff48bb5752b tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:13.371046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55356e49-8b61-4e7e-ab1a-bff48bb5752b tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:13.460497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1088/2212] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:01:13 2022] POST /identity/v3/projects => generated 353 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:13.464636 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b6a12-20df-4c5d-a6bb-55d0b8c65c8a tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:13.475285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b6a12-20df-4c5d-a6bb-55d0b8c65c8a tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:13.537477 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c65f6-de17-4417-9058-465fec2d4448 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0172c2f6c4604b788e791fae2cb758c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '815c5b4c0cc448989db99326bf716ad6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:13.538229 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c65f6-de17-4417-9058-465fec2d4448 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:13.538598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c65f6-de17-4417-9058-465fec2d4448 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:13.538895 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c65f6-de17-4417-9058-465fec2d4448 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:13.539753 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c65f6-de17-4417-9058-465fec2d4448 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:01:13.539957 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c65f6-de17-4417-9058-465fec2d4448 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:13.541708 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c65f6-de17-4417-9058-465fec2d4448 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:13.557496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1125/2213] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:01:13.592759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55356e49-8b61-4e7e-ab1a-bff48bb5752b tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:13.602929 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55356e49-8b61-4e7e-ab1a-bff48bb5752b tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:13.607747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0172c2f6c4604b788e791fae2cb758c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '815c5b4c0cc448989db99326bf716ad6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:13.608627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:13.608921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:13.609206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] PATH_INFO: `/v3/projects/46f40b97148b49be9ab4bf4323d1e660` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:13.610442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] RBAC: Authorizing `identity:delete_project(project_id=46f40b97148b49be9ab4bf4323d1e660)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:13.613122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:13.711645 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46f40b97148b49be9ab4bf4323d1e660', 'request_id': 'req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:13.797051 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46f40b97148b49be9ab4bf4323d1e660', 'request_id': 'req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:13.798020 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:13.804282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46f40b97148b49be9ab4bf4323d1e660', 'request_id': 'req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:13.814675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] The token cache is being invalidate because project 46f40b97148b49be9ab4bf4323d1e660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:01:13.814964 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:13.815776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:13.817328 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1089/2214] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:01:13 2022] DELETE /identity/v3/projects/46f40b97148b49be9ab4bf4323d1e660 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:14.404593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862cf6b-c409-4be2-b67b-77d37c5e20fc None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:14.405155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862cf6b-c409-4be2-b67b-77d37c5e20fc None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:14.405385 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862cf6b-c409-4be2-b67b-77d37c5e20fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:14.426325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c862cf6b-c409-4be2-b67b-77d37c5e20fc None None] MFA Rules not processed for user `ac766f08f7fb4cdbbb90b5e7c8e52226`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:14.428046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c862cf6b-c409-4be2-b67b-77d37c5e20fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:14.494440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1126/2215] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:14.609740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:14.611660 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:14.717794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df41f9-f0ee-4ace-af7d-437be2ef3cd6 tempest-VolumeQuotaClassesTest-545583595 tempest-VolumeQuotaClassesTest-545583595-project-admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:14.723514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20af37c-5236-4c9f-93ab-c1127c95a940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:14.724528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af37c-5236-4c9f-93ab-c1127c95a940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:14.725137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af37c-5236-4c9f-93ab-c1127c95a940 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:14.725682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20af37c-5236-4c9f-93ab-c1127c95a940 admin admin] PATH_INFO: `/v3/users/7db75345e7974209be99277359d17bac` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:14.727036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20af37c-5236-4c9f-93ab-c1127c95a940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7db75345e7974209be99277359d17bac)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:14.729080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20af37c-5236-4c9f-93ab-c1127c95a940 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:14.739655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:14.986087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f20af37c-5236-4c9f-93ab-c1127c95a940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7db75345e7974209be99277359d17bac'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:14.987709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f20af37c-5236-4c9f-93ab-c1127c95a940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7db75345e7974209be99277359d17bac'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:15.121069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f20af37c-5236-4c9f-93ab-c1127c95a940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7db75345e7974209be99277359d17bac'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:15.135390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f20af37c-5236-4c9f-93ab-c1127c95a940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7db75345e7974209be99277359d17bac'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:15.144001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:15.145183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f20af37c-5236-4c9f-93ab-c1127c95a940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7db75345e7974209be99277359d17bac'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:15.153857 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1090/2216] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:01:14 2022] DELETE /identity/v3/users/7db75345e7974209be99277359d17bac => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:15.157973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f27c1-bb34-4d64-87a7-52e56f95efd6 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:15.158650 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f27c1-bb34-4d64-87a7-52e56f95efd6 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:15.159182 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f27c1-bb34-4d64-87a7-52e56f95efd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:15.179317 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-af1f27c1-bb34-4d64-87a7-52e56f95efd6 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:15.182658 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-af1f27c1-bb34-4d64-87a7-52e56f95efd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:15.243178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1127/2217] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:01:15.253846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20af37c-5236-4c9f-93ab-c1127c95a940 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:15.255446 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f20af37c-5236-4c9f-93ab-c1127c95a940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:15.326081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20af37c-5236-4c9f-93ab-c1127c95a940 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:15.331639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117244d-71ce-461c-8840-0bb886c015e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:15.332310 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117244d-71ce-461c-8840-0bb886c015e8 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:15.332733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117244d-71ce-461c-8840-0bb886c015e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:15.333024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117244d-71ce-461c-8840-0bb886c015e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:15.343941 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117244d-71ce-461c-8840-0bb886c015e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:15.345556 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117244d-71ce-461c-8840-0bb886c015e8 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:15.357252 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1091/2218] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:01:15.848401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f27c1-bb34-4d64-87a7-52e56f95efd6 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:15.850546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-af1f27c1-bb34-4d64-87a7-52e56f95efd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:15.872227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f27c1-bb34-4d64-87a7-52e56f95efd6 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:15.880781 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208c794-f58c-4295-9471-bffe386a357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:15.881665 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208c794-f58c-4295-9471-bffe386a357f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:15.882109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208c794-f58c-4295-9471-bffe386a357f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:15.882775 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208c794-f58c-4295-9471-bffe386a357f admin admin] PATH_INFO: `/v3/projects/f158b4b9bf9f4dde8dad8ceb46cca958` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:15.884349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208c794-f58c-4295-9471-bffe386a357f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f158b4b9bf9f4dde8dad8ceb46cca958)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:15.887069 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208c794-f58c-4295-9471-bffe386a357f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:16.007060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a208c794-f58c-4295-9471-bffe386a357f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f158b4b9bf9f4dde8dad8ceb46cca958', 'request_id': 'req-a208c794-f58c-4295-9471-bffe386a357f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:16.014856 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a208c794-f58c-4295-9471-bffe386a357f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f158b4b9bf9f4dde8dad8ceb46cca958', 'request_id': 'req-a208c794-f58c-4295-9471-bffe386a357f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:16.023176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a208c794-f58c-4295-9471-bffe386a357f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f158b4b9bf9f4dde8dad8ceb46cca958', 'request_id': 'req-a208c794-f58c-4295-9471-bffe386a357f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:16.179631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a208c794-f58c-4295-9471-bffe386a357f admin admin] The token cache is being invalidate because project f158b4b9bf9f4dde8dad8ceb46cca958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:01:16.180306 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a208c794-f58c-4295-9471-bffe386a357f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:16.181237 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a208c794-f58c-4295-9471-bffe386a357f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:16.183286 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1128/2219] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:01:15 2022] DELETE /identity/v3/projects/f158b4b9bf9f4dde8dad8ceb46cca958 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:16.187038 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117244d-71ce-461c-8840-0bb886c015e8 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:16.220743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117244d-71ce-461c-8840-0bb886c015e8 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:16.282074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534470b-e5fd-4bb1-a4a0-a6aedbb6f7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:16.283196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534470b-e5fd-4bb1-a4a0-a6aedbb6f7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:16.283487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534470b-e5fd-4bb1-a4a0-a6aedbb6f7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:16.283774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534470b-e5fd-4bb1-a4a0-a6aedbb6f7a9 admin admin] PATH_INFO: `/v3/users/0172c2f6c4604b788e791fae2cb758c5` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:16.286088 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534470b-e5fd-4bb1-a4a0-a6aedbb6f7a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0172c2f6c4604b788e791fae2cb758c5)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:16.288110 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534470b-e5fd-4bb1-a4a0-a6aedbb6f7a9 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:16.538953 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-1534470b-e5fd-4bb1-a4a0-a6aedbb6f7a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0172c2f6c4604b788e791fae2cb758c5'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:16.539652 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-1534470b-e5fd-4bb1-a4a0-a6aedbb6f7a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0172c2f6c4604b788e791fae2cb758c5'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:16.611975 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-1534470b-e5fd-4bb1-a4a0-a6aedbb6f7a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0172c2f6c4604b788e791fae2cb758c5'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:16.626363 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-1534470b-e5fd-4bb1-a4a0-a6aedbb6f7a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0172c2f6c4604b788e791fae2cb758c5'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:16.634059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-1534470b-e5fd-4bb1-a4a0-a6aedbb6f7a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0172c2f6c4604b788e791fae2cb758c5'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:16.640760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1092/2220] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:01:16 2022] DELETE /identity/v3/users/0172c2f6c4604b788e791fae2cb758c5 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:16.835550 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:17.071690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:17.108039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208c794-f58c-4295-9471-bffe386a357f admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:17.109555 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a208c794-f58c-4295-9471-bffe386a357f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:17.165381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208c794-f58c-4295-9471-bffe386a357f admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:17.229675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfe531-de03-403d-a337-a03498d74c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:17.230751 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfe531-de03-403d-a337-a03498d74c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:17.231042 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfe531-de03-403d-a337-a03498d74c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:17.231370 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfe531-de03-403d-a337-a03498d74c6f admin admin] PATH_INFO: `/v3/projects/815c5b4c0cc448989db99326bf716ad6` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:17.232588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfe531-de03-403d-a337-a03498d74c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=815c5b4c0cc448989db99326bf716ad6)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:17.234535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfe531-de03-403d-a337-a03498d74c6f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:17.513693 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8dcfe531-de03-403d-a337-a03498d74c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '815c5b4c0cc448989db99326bf716ad6', 'request_id': 'req-8dcfe531-de03-403d-a337-a03498d74c6f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:17.520415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8dcfe531-de03-403d-a337-a03498d74c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '815c5b4c0cc448989db99326bf716ad6', 'request_id': 'req-8dcfe531-de03-403d-a337-a03498d74c6f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:17.526248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8dcfe531-de03-403d-a337-a03498d74c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '815c5b4c0cc448989db99326bf716ad6', 'request_id': 'req-8dcfe531-de03-403d-a337-a03498d74c6f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:17.630812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8dcfe531-de03-403d-a337-a03498d74c6f admin admin] The token cache is being invalidate because project 815c5b4c0cc448989db99326bf716ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:01:17.635007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8dcfe531-de03-403d-a337-a03498d74c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:17.635007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8dcfe531-de03-403d-a337-a03498d74c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:17.635007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1129/2221] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:01:17 2022] DELETE /identity/v3/projects/815c5b4c0cc448989db99326bf716ad6 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:17.638866 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efaf77-2a98-4b67-9a26-1c5d6180091c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:17.639316 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efaf77-2a98-4b67-9a26-1c5d6180091c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:17.639416 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efaf77-2a98-4b67-9a26-1c5d6180091c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:17.683921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-04efaf77-2a98-4b67-9a26-1c5d6180091c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:17.685164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-04efaf77-2a98-4b67-9a26-1c5d6180091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:17.743230 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1093/2222] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:17.751211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0612db-9e6c-48ed-8ee0-ddb0f04c463c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:17.751505 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0612db-9e6c-48ed-8ee0-ddb0f04c463c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:17.751781 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0612db-9e6c-48ed-8ee0-ddb0f04c463c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:17.771658 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-db0612db-9e6c-48ed-8ee0-ddb0f04c463c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:17.772903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-db0612db-9e6c-48ed-8ee0-ddb0f04c463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:17.783306 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1130/2223] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:01:17.787597 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efaf77-2a98-4b67-9a26-1c5d6180091c None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:17.798885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efaf77-2a98-4b67-9a26-1c5d6180091c None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:17.803656 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cfc44-3fd9-42e3-93fe-76333ea87c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:17.804347 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cfc44-3fd9-42e3-93fe-76333ea87c96 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:17.804629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cfc44-3fd9-42e3-93fe-76333ea87c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:17.804906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cfc44-3fd9-42e3-93fe-76333ea87c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:17.805637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cfc44-3fd9-42e3-93fe-76333ea87c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:01:17.805950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cfc44-3fd9-42e3-93fe-76333ea87c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:17.807591 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cfc44-3fd9-42e3-93fe-76333ea87c96 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:17.822735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1094/2224] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:01:17.828717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0612db-9e6c-48ed-8ee0-ddb0f04c463c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:17.835413 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0612db-9e6c-48ed-8ee0-ddb0f04c463c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:17.840106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378c383-2acb-4dca-936c-e91e24309c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:17.840798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378c383-2acb-4dca-936c-e91e24309c81 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:17.841093 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378c383-2acb-4dca-936c-e91e24309c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:17.841374 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378c383-2acb-4dca-936c-e91e24309c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:17.842118 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378c383-2acb-4dca-936c-e91e24309c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:17.844125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378c383-2acb-4dca-936c-e91e24309c81 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:17.961348 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1131/2225] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:01:17 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:17.965675 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cfc44-3fd9-42e3-93fe-76333ea87c96 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:17.968860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:17.980771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cfc44-3fd9-42e3-93fe-76333ea87c96 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:18.037877 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699a88a-57b1-41e9-8ac7-36e0c1169709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:18.038591 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699a88a-57b1-41e9-8ac7-36e0c1169709 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:18.038897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699a88a-57b1-41e9-8ac7-36e0c1169709 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:18.039167 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699a88a-57b1-41e9-8ac7-36e0c1169709 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:18.039873 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699a88a-57b1-41e9-8ac7-36e0c1169709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:18.041905 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699a88a-57b1-41e9-8ac7-36e0c1169709 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:18.119539 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1095/2226] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:01:17 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:01:18.120801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378c383-2acb-4dca-936c-e91e24309c81 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:18.132997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378c383-2acb-4dca-936c-e91e24309c81 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:18.137918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1c601-4325-44f0-a579-9b3e5f2723c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:18.138663 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1c601-4325-44f0-a579-9b3e5f2723c7 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:18.138914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1c601-4325-44f0-a579-9b3e5f2723c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:18.139369 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1c601-4325-44f0-a579-9b3e5f2723c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:18.140108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1c601-4325-44f0-a579-9b3e5f2723c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:18.141884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1c601-4325-44f0-a579-9b3e5f2723c7 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:18.153206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1132/2227] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:18.157409 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699a88a-57b1-41e9-8ac7-36e0c1169709 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:18.168555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699a88a-57b1-41e9-8ac7-36e0c1169709 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:18.173435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de35d89-50d6-4d27-879c-f20a11eebb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:18.174100 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35d89-50d6-4d27-879c-f20a11eebb73 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:18.174420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35d89-50d6-4d27-879c-f20a11eebb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:18.174710 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35d89-50d6-4d27-879c-f20a11eebb73 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:18.176220 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de35d89-50d6-4d27-879c-f20a11eebb73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:18.177946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de35d89-50d6-4d27-879c-f20a11eebb73 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:18.188021 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1096/2228] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:18.192763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1c601-4325-44f0-a579-9b3e5f2723c7 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:18.202788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1c601-4325-44f0-a579-9b3e5f2723c7 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:18.208054 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3760ca7-f690-42e4-8f69-3ede7c47fe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:18.208934 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3760ca7-f690-42e4-8f69-3ede7c47fe8b admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:18.221384 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3760ca7-f690-42e4-8f69-3ede7c47fe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:18.221384 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3760ca7-f690-42e4-8f69-3ede7c47fe8b admin admin] PATH_INFO: `/v3/projects/3a8c621029994392ae9f4faa28c37bd7/users/110bf83e0bb844b0b81c29f2a960e7e1/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:18.223678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3760ca7-f690-42e4-8f69-3ede7c47fe8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8c621029994392ae9f4faa28c37bd7, user_id=110bf83e0bb844b0b81c29f2a960e7e1, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:18.226318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3760ca7-f690-42e4-8f69-3ede7c47fe8b admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:18.241223 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:18.299500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1133/2229] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:18 2022] PUT /identity/v3/projects/3a8c621029994392ae9f4faa28c37bd7/users/110bf83e0bb844b0b81c29f2a960e7e1/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:18.311537 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5e932-9f58-4abb-b2d1-c79fcbf03e5b None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:18.311973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5e932-9f58-4abb-b2d1-c79fcbf03e5b None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:18.312259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5e932-9f58-4abb-b2d1-c79fcbf03e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:18.345654 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-38e5e932-9f58-4abb-b2d1-c79fcbf03e5b None None] MFA Rules not processed for user `110bf83e0bb844b0b81c29f2a960e7e1`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:18.346832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-38e5e932-9f58-4abb-b2d1-c79fcbf03e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:18.416983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:18.421407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1097/2230] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:18.426189 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3760ca7-f690-42e4-8f69-3ede7c47fe8b admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:18.512221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3760ca7-f690-42e4-8f69-3ede7c47fe8b admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:18.517219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebc3c1-5599-43a9-84d0-6be46ff3ff3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:18.517885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebc3c1-5599-43a9-84d0-6be46ff3ff3d admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:18.518175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebc3c1-5599-43a9-84d0-6be46ff3ff3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:18.518498 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebc3c1-5599-43a9-84d0-6be46ff3ff3d admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:18.519255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebc3c1-5599-43a9-84d0-6be46ff3ff3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:18.521217 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebc3c1-5599-43a9-84d0-6be46ff3ff3d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:18.575102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:18.647006 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1134/2231] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:01:18 2022] POST /identity/v3/projects => generated 383 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:18.647735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5e932-9f58-4abb-b2d1-c79fcbf03e5b None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:18.658987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5e932-9f58-4abb-b2d1-c79fcbf03e5b None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:18.663877 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:18.718868 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db664125-5dbc-4c69-816f-47eeba89a727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:18.719581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db664125-5dbc-4c69-816f-47eeba89a727 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:18.719874 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db664125-5dbc-4c69-816f-47eeba89a727 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:18.720157 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db664125-5dbc-4c69-816f-47eeba89a727 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:18.720852 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db664125-5dbc-4c69-816f-47eeba89a727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:18.723086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db664125-5dbc-4c69-816f-47eeba89a727 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:18.793408 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1098/2232] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:01:18 2022] POST /identity/v3/users => generated 298 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:01:18.799668 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebc3c1-5599-43a9-84d0-6be46ff3ff3d admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:18.811005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebc3c1-5599-43a9-84d0-6be46ff3ff3d admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:18.816312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aa700-76d3-4284-9477-6b0ab0a5cec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:18.816979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aa700-76d3-4284-9477-6b0ab0a5cec1 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:18.817265 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aa700-76d3-4284-9477-6b0ab0a5cec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:18.817544 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aa700-76d3-4284-9477-6b0ab0a5cec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:18.818274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497aa700-76d3-4284-9477-6b0ab0a5cec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:18.820194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497aa700-76d3-4284-9477-6b0ab0a5cec1 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:18.830969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1135/2233] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:18.835316 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db664125-5dbc-4c69-816f-47eeba89a727 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:18.846175 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db664125-5dbc-4c69-816f-47eeba89a727 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:18.851134 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74f71e-9c45-4c2b-b8e8-eb582f775a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:18.852020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74f71e-9c45-4c2b-b8e8-eb582f775a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:18.852307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74f71e-9c45-4c2b-b8e8-eb582f775a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:18.852585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74f71e-9c45-4c2b-b8e8-eb582f775a6b admin admin] PATH_INFO: `/v3/projects/6f863b965dc44af5b5bfa2cf91eaca5d/users/ede8c57f060f4ba290ea6ccc77dc5a72/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:18.868272 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74f71e-9c45-4c2b-b8e8-eb582f775a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f863b965dc44af5b5bfa2cf91eaca5d, user_id=ede8c57f060f4ba290ea6ccc77dc5a72, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:18.871128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74f71e-9c45-4c2b-b8e8-eb582f775a6b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:18.913011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:18.935294 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1099/2234] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:18 2022] PUT /identity/v3/projects/6f863b965dc44af5b5bfa2cf91eaca5d/users/ede8c57f060f4ba290ea6ccc77dc5a72/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:18.939222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aa700-76d3-4284-9477-6b0ab0a5cec1 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:18.949803 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:18.952160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aa700-76d3-4284-9477-6b0ab0a5cec1 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:19.013550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ddfca-f533-4744-9e2e-3c5246f0b163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:19.014270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ddfca-f533-4744-9e2e-3c5246f0b163 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:19.014593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ddfca-f533-4744-9e2e-3c5246f0b163 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:19.014874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ddfca-f533-4744-9e2e-3c5246f0b163 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:19.015608 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ddfca-f533-4744-9e2e-3c5246f0b163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:19.017230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ddfca-f533-4744-9e2e-3c5246f0b163 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:19.029613 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1136/2235] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:19.034284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74f71e-9c45-4c2b-b8e8-eb582f775a6b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:19.048020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74f71e-9c45-4c2b-b8e8-eb582f775a6b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:19.054892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3821c-9d53-4f66-8f7b-7174bd514781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:19.056062 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3821c-9d53-4f66-8f7b-7174bd514781 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:19.056413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3821c-9d53-4f66-8f7b-7174bd514781 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:19.056816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3821c-9d53-4f66-8f7b-7174bd514781 admin admin] PATH_INFO: `/v3/projects/6f863b965dc44af5b5bfa2cf91eaca5d/users/ede8c57f060f4ba290ea6ccc77dc5a72/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:19.059553 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3821c-9d53-4f66-8f7b-7174bd514781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f863b965dc44af5b5bfa2cf91eaca5d, user_id=ede8c57f060f4ba290ea6ccc77dc5a72, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:19.063302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3821c-9d53-4f66-8f7b-7174bd514781 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:19.075554 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1100/2236] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:19 2022] PUT /identity/v3/projects/6f863b965dc44af5b5bfa2cf91eaca5d/users/ede8c57f060f4ba290ea6ccc77dc5a72/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:19.091904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89921eea-3ec5-45bd-87b9-ac4e0105c120 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:19.091904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89921eea-3ec5-45bd-87b9-ac4e0105c120 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:19.091904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89921eea-3ec5-45bd-87b9-ac4e0105c120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:19.114855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-89921eea-3ec5-45bd-87b9-ac4e0105c120 None None] MFA Rules not processed for user `ede8c57f060f4ba290ea6ccc77dc5a72`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:19.116166 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-89921eea-3ec5-45bd-87b9-ac4e0105c120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:19.207228 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1137/2237] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:19.212552 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:19.217687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3821c-9d53-4f66-8f7b-7174bd514781 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:19.219555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4cc3821c-9d53-4f66-8f7b-7174bd514781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:19.299759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3821c-9d53-4f66-8f7b-7174bd514781 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:19.306879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ba62b-8d59-4e10-8c1e-9e53b5839f7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:19.307551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ba62b-8d59-4e10-8c1e-9e53b5839f7d service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:19.308424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ba62b-8d59-4e10-8c1e-9e53b5839f7d service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:19.308677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ba62b-8d59-4e10-8c1e-9e53b5839f7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:19.320976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ba62b-8d59-4e10-8c1e-9e53b5839f7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:19.322471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ba62b-8d59-4e10-8c1e-9e53b5839f7d service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:19.336945 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1101/2238] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:19.391903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:19.455465 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89921eea-3ec5-45bd-87b9-ac4e0105c120 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:19.467593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89921eea-3ec5-45bd-87b9-ac4e0105c120 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:19.477015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e2a2c2-8ba3-47bb-a683-a62bfb12724f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:19.477687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2a2c2-8ba3-47bb-a683-a62bfb12724f service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:19.477973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2a2c2-8ba3-47bb-a683-a62bfb12724f service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:19.478254 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e2a2c2-8ba3-47bb-a683-a62bfb12724f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:19.563934 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:19.570211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2a2c2-8ba3-47bb-a683-a62bfb12724f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:19.571774 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e2a2c2-8ba3-47bb-a683-a62bfb12724f service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:19.584666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1138/2239] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:01:19.603833 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:19.700777 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:19.718978 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:20.196127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:21.059205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:21.455482 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:22.647898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:22.678449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:22.823035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ba62b-8d59-4e10-8c1e-9e53b5839f7d service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:22.848118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:22.908101 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ba62b-8d59-4e10-8c1e-9e53b5839f7d service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:22.913198 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977de8cc-eb15-4440-9b4d-617006395502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:22.914060 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977de8cc-eb15-4440-9b4d-617006395502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:22.914363 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977de8cc-eb15-4440-9b4d-617006395502 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:22.914650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977de8cc-eb15-4440-9b4d-617006395502 admin admin] PATH_INFO: `/v3/users/110bf83e0bb844b0b81c29f2a960e7e1` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:22.915820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977de8cc-eb15-4440-9b4d-617006395502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=110bf83e0bb844b0b81c29f2a960e7e1)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:22.917760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977de8cc-eb15-4440-9b4d-617006395502 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:23.107111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:23.111082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-977de8cc-eb15-4440-9b4d-617006395502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '110bf83e0bb844b0b81c29f2a960e7e1'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:23.112159 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-977de8cc-eb15-4440-9b4d-617006395502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '110bf83e0bb844b0b81c29f2a960e7e1'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:23.215569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-977de8cc-eb15-4440-9b4d-617006395502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '110bf83e0bb844b0b81c29f2a960e7e1'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:23.229834 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-977de8cc-eb15-4440-9b4d-617006395502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '110bf83e0bb844b0b81c29f2a960e7e1'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:23.237331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-977de8cc-eb15-4440-9b4d-617006395502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '110bf83e0bb844b0b81c29f2a960e7e1'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:23.246045 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1102/2240] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:01:22 2022] DELETE /identity/v3/users/110bf83e0bb844b0b81c29f2a960e7e1 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:23.251324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb799b-7cf4-42b6-b894-09831a9d034d None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:23.254294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb799b-7cf4-42b6-b894-09831a9d034d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:23.254294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb799b-7cf4-42b6-b894-09831a9d034d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:23.272322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-2dcb799b-7cf4-42b6-b894-09831a9d034d None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:23.276315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2dcb799b-7cf4-42b6-b894-09831a9d034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:23.350845 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1139/2241] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:23.360593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977de8cc-eb15-4440-9b4d-617006395502 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:23.362009 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-977de8cc-eb15-4440-9b4d-617006395502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:23.391943 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:23.455091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977de8cc-eb15-4440-9b4d-617006395502 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:23.458789 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186433b9-975e-4110-af97-2d727ab734f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:23.459442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186433b9-975e-4110-af97-2d727ab734f2 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:23.459739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186433b9-975e-4110-af97-2d727ab734f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:23.460012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186433b9-975e-4110-af97-2d727ab734f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:23.471359 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186433b9-975e-4110-af97-2d727ab734f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:23.472394 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186433b9-975e-4110-af97-2d727ab734f2 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:23.483636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1103/2242] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:23.781315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:23.827338 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:23.934435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb799b-7cf4-42b6-b894-09831a9d034d None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:23.934546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2dcb799b-7cf4-42b6-b894-09831a9d034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:23.946707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb799b-7cf4-42b6-b894-09831a9d034d None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:23.951397 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123004c2-d9a1-4471-a264-3fd95fd93c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:23.952388 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123004c2-d9a1-4471-a264-3fd95fd93c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:23.952559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123004c2-d9a1-4471-a264-3fd95fd93c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:23.953164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123004c2-d9a1-4471-a264-3fd95fd93c52 admin admin] PATH_INFO: `/v3/projects/3a8c621029994392ae9f4faa28c37bd7` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:23.954396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123004c2-d9a1-4471-a264-3fd95fd93c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8c621029994392ae9f4faa28c37bd7)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:23.956439 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123004c2-d9a1-4471-a264-3fd95fd93c52 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:24.072193 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-123004c2-d9a1-4471-a264-3fd95fd93c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8c621029994392ae9f4faa28c37bd7', 'request_id': 'req-123004c2-d9a1-4471-a264-3fd95fd93c52'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:24.082959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-123004c2-d9a1-4471-a264-3fd95fd93c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8c621029994392ae9f4faa28c37bd7', 'request_id': 'req-123004c2-d9a1-4471-a264-3fd95fd93c52'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:24.090120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-123004c2-d9a1-4471-a264-3fd95fd93c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8c621029994392ae9f4faa28c37bd7', 'request_id': 'req-123004c2-d9a1-4471-a264-3fd95fd93c52'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:24.173333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-123004c2-d9a1-4471-a264-3fd95fd93c52 admin admin] The token cache is being invalidate because project 3a8c621029994392ae9f4faa28c37bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:01:24.173647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-123004c2-d9a1-4471-a264-3fd95fd93c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:24.174239 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-123004c2-d9a1-4471-a264-3fd95fd93c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:24.175972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1140/2243] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:01:23 2022] DELETE /identity/v3/projects/3a8c621029994392ae9f4faa28c37bd7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:24.180161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186433b9-975e-4110-af97-2d727ab734f2 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:24.190376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186433b9-975e-4110-af97-2d727ab734f2 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:24.247330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4943d-da23-4f62-962d-c6f43e2ff75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:24.248137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4943d-da23-4f62-962d-c6f43e2ff75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:24.248422 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4943d-da23-4f62-962d-c6f43e2ff75b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:24.248699 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4943d-da23-4f62-962d-c6f43e2ff75b admin admin] PATH_INFO: `/v3/users/ede8c57f060f4ba290ea6ccc77dc5a72` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:24.250155 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4943d-da23-4f62-962d-c6f43e2ff75b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede8c57f060f4ba290ea6ccc77dc5a72)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:24.252111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4943d-da23-4f62-962d-c6f43e2ff75b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:24.444712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:24.458417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-e7d4943d-da23-4f62-962d-c6f43e2ff75b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede8c57f060f4ba290ea6ccc77dc5a72'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:24.459199 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-e7d4943d-da23-4f62-962d-c6f43e2ff75b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede8c57f060f4ba290ea6ccc77dc5a72'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:24.558885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-e7d4943d-da23-4f62-962d-c6f43e2ff75b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede8c57f060f4ba290ea6ccc77dc5a72'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:24.562649 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:24.573109 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-e7d4943d-da23-4f62-962d-c6f43e2ff75b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede8c57f060f4ba290ea6ccc77dc5a72'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:24.583041 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-e7d4943d-da23-4f62-962d-c6f43e2ff75b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede8c57f060f4ba290ea6ccc77dc5a72'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:24.589402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1104/2244] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:01:24 2022] DELETE /identity/v3/users/ede8c57f060f4ba290ea6ccc77dc5a72 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:25.002499 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:25.084403 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123004c2-d9a1-4471-a264-3fd95fd93c52 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:25.086247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-123004c2-d9a1-4471-a264-3fd95fd93c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:25.105983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123004c2-d9a1-4471-a264-3fd95fd93c52 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:25.156496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:25.165884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea52ed6-e6f8-4bbd-a219-9eae2ef03d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:25.166781 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea52ed6-e6f8-4bbd-a219-9eae2ef03d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:25.167066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea52ed6-e6f8-4bbd-a219-9eae2ef03d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:25.167343 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea52ed6-e6f8-4bbd-a219-9eae2ef03d10 admin admin] PATH_INFO: `/v3/projects/6f863b965dc44af5b5bfa2cf91eaca5d` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:25.168547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea52ed6-e6f8-4bbd-a219-9eae2ef03d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f863b965dc44af5b5bfa2cf91eaca5d)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:25.170488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea52ed6-e6f8-4bbd-a219-9eae2ef03d10 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:25.288978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4ea52ed6-e6f8-4bbd-a219-9eae2ef03d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f863b965dc44af5b5bfa2cf91eaca5d', 'request_id': 'req-4ea52ed6-e6f8-4bbd-a219-9eae2ef03d10'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:25.295682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4ea52ed6-e6f8-4bbd-a219-9eae2ef03d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f863b965dc44af5b5bfa2cf91eaca5d', 'request_id': 'req-4ea52ed6-e6f8-4bbd-a219-9eae2ef03d10'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:25.302097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4ea52ed6-e6f8-4bbd-a219-9eae2ef03d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f863b965dc44af5b5bfa2cf91eaca5d', 'request_id': 'req-4ea52ed6-e6f8-4bbd-a219-9eae2ef03d10'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:25.397969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4ea52ed6-e6f8-4bbd-a219-9eae2ef03d10 admin admin] The token cache is being invalidate because project 6f863b965dc44af5b5bfa2cf91eaca5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:01:25.398258 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4ea52ed6-e6f8-4bbd-a219-9eae2ef03d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:25.399133 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4ea52ed6-e6f8-4bbd-a219-9eae2ef03d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:25.400779 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1141/2245] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:01:25 2022] DELETE /identity/v3/projects/6f863b965dc44af5b5bfa2cf91eaca5d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:25.405674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740257b6-75b2-4618-9f9b-fb9689eb521b None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:25.406016 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740257b6-75b2-4618-9f9b-fb9689eb521b None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:25.406321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740257b6-75b2-4618-9f9b-fb9689eb521b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:25.437733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-740257b6-75b2-4618-9f9b-fb9689eb521b None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:25.440702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-740257b6-75b2-4618-9f9b-fb9689eb521b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:25.508868 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1105/2246] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:25.516712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bc81f-adba-457f-b5e9-93e99c7f212a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:25.517031 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bc81f-adba-457f-b5e9-93e99c7f212a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:25.517327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29bc81f-adba-457f-b5e9-93e99c7f212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:25.536959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a29bc81f-adba-457f-b5e9-93e99c7f212a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:25.538191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a29bc81f-adba-457f-b5e9-93e99c7f212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:25.546044 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1142/2247] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:25.550519 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740257b6-75b2-4618-9f9b-fb9689eb521b None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:25.561104 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740257b6-75b2-4618-9f9b-fb9689eb521b None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:25.571009 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7d7c6-2723-4bca-976a-d4d42afd72f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:25.572644 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7d7c6-2723-4bca-976a-d4d42afd72f2 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:25.572747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7d7c6-2723-4bca-976a-d4d42afd72f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:25.573178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7d7c6-2723-4bca-976a-d4d42afd72f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:25.574279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7d7c6-2723-4bca-976a-d4d42afd72f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:01:25.578830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7d7c6-2723-4bca-976a-d4d42afd72f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:25.583714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7d7c6-2723-4bca-976a-d4d42afd72f2 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:25.613203 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1106/2248] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:01:25.617446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bc81f-adba-457f-b5e9-93e99c7f212a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:25.627155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29bc81f-adba-457f-b5e9-93e99c7f212a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:25.632609 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732fe46-f5bc-4c2a-ad63-38d523c88ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:25.633290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732fe46-f5bc-4c2a-ad63-38d523c88ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:25.633583 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732fe46-f5bc-4c2a-ad63-38d523c88ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:25.633865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732fe46-f5bc-4c2a-ad63-38d523c88ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:25.634710 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732fe46-f5bc-4c2a-ad63-38d523c88ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:25.637453 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732fe46-f5bc-4c2a-ad63-38d523c88ff8 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:25.733938 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1143/2249] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:01:25 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:01:25.737875 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7d7c6-2723-4bca-976a-d4d42afd72f2 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:25.747905 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7d7c6-2723-4bca-976a-d4d42afd72f2 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:25.776772 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:25.809590 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88331e-f59e-42c5-9cfd-f633382ea52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:25.810272 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88331e-f59e-42c5-9cfd-f633382ea52a admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:25.810595 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88331e-f59e-42c5-9cfd-f633382ea52a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:25.810880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88331e-f59e-42c5-9cfd-f633382ea52a admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:25.811579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88331e-f59e-42c5-9cfd-f633382ea52a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:25.813580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88331e-f59e-42c5-9cfd-f633382ea52a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:25.839040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:25.882470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1107/2250] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:01:25 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:01:25.888971 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732fe46-f5bc-4c2a-ad63-38d523c88ff8 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:25.903591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732fe46-f5bc-4c2a-ad63-38d523c88ff8 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:25.908504 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7c7c7-4b31-4a0e-b45a-158be36c0d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:25.909411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7c7c7-4b31-4a0e-b45a-158be36c0d67 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:25.909774 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7c7c7-4b31-4a0e-b45a-158be36c0d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:25.910115 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7c7c7-4b31-4a0e-b45a-158be36c0d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:25.911619 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7c7c7-4b31-4a0e-b45a-158be36c0d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:25.913354 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7c7c7-4b31-4a0e-b45a-158be36c0d67 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:25.924441 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1144/2251] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:25.928536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88331e-f59e-42c5-9cfd-f633382ea52a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:25.938729 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88331e-f59e-42c5-9cfd-f633382ea52a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:25.944326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18f093-dab8-4c11-a186-f7c2fe86ea30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:25.945168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18f093-dab8-4c11-a186-f7c2fe86ea30 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:25.945874 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18f093-dab8-4c11-a186-f7c2fe86ea30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:25.946215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18f093-dab8-4c11-a186-f7c2fe86ea30 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:25.947059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18f093-dab8-4c11-a186-f7c2fe86ea30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:25.948703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18f093-dab8-4c11-a186-f7c2fe86ea30 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:25.959566 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1108/2252] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:01:25.966588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7c7c7-4b31-4a0e-b45a-158be36c0d67 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:25.982392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7c7c7-4b31-4a0e-b45a-158be36c0d67 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:25.985448 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bd921-5486-4266-862f-f732982646b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:25.986501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bd921-5486-4266-862f-f732982646b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:25.986788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bd921-5486-4266-862f-f732982646b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:25.988274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bd921-5486-4266-862f-f732982646b8 admin admin] PATH_INFO: `/v3/projects/89c0fca3bb934c81ac2a900c279b9033/users/f05d9b2be2794eb4988b264ba1368efe/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:26.005768 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bd921-5486-4266-862f-f732982646b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c0fca3bb934c81ac2a900c279b9033, user_id=f05d9b2be2794eb4988b264ba1368efe, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:26.008881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bd921-5486-4266-862f-f732982646b8 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:26.107859 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1145/2253] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:25 2022] PUT /identity/v3/projects/89c0fca3bb934c81ac2a900c279b9033/users/f05d9b2be2794eb4988b264ba1368efe/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:26.119494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a9e22-e41f-41f7-ba17-609a38c8e701 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:26.119796 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a9e22-e41f-41f7-ba17-609a38c8e701 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:26.120087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a9e22-e41f-41f7-ba17-609a38c8e701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:26.130986 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:26.152823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-189a9e22-e41f-41f7-ba17-609a38c8e701 None None] MFA Rules not processed for user `f05d9b2be2794eb4988b264ba1368efe`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:26.154129 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-189a9e22-e41f-41f7-ba17-609a38c8e701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:26.233163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1109/2254] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:26.241311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bd921-5486-4266-862f-f732982646b8 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:26.333527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bd921-5486-4266-862f-f732982646b8 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:26.338934 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832cff4-6127-4eaa-a29b-a25d7e8a191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:26.339623 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832cff4-6127-4eaa-a29b-a25d7e8a191d admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:26.339943 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832cff4-6127-4eaa-a29b-a25d7e8a191d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:26.340279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832cff4-6127-4eaa-a29b-a25d7e8a191d admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:26.341408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832cff4-6127-4eaa-a29b-a25d7e8a191d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:26.343041 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832cff4-6127-4eaa-a29b-a25d7e8a191d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:26.493149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:26.500659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1146/2255] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:01:26 2022] POST /identity/v3/projects => generated 381 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:26.506177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a9e22-e41f-41f7-ba17-609a38c8e701 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:26.518516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a9e22-e41f-41f7-ba17-609a38c8e701 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:26.581580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1ee6b-17ef-42f0-86cc-93b9b072a14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:26.629281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1ee6b-17ef-42f0-86cc-93b9b072a14e admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:26.629281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1ee6b-17ef-42f0-86cc-93b9b072a14e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:26.629281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1ee6b-17ef-42f0-86cc-93b9b072a14e admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:26.629281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1ee6b-17ef-42f0-86cc-93b9b072a14e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:26.629281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1ee6b-17ef-42f0-86cc-93b9b072a14e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:26.719399 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832cff4-6127-4eaa-a29b-a25d7e8a191d admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:26.738495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1110/2256] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:01:26 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:26.744241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832cff4-6127-4eaa-a29b-a25d7e8a191d admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:26.766178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c7db4-0317-4498-bc7d-ea8285c92eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:26.769580 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c7db4-0317-4498-bc7d-ea8285c92eeb admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:26.770747 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c7db4-0317-4498-bc7d-ea8285c92eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:26.773062 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c7db4-0317-4498-bc7d-ea8285c92eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:26.774091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c7db4-0317-4498-bc7d-ea8285c92eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:26.776328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c7db4-0317-4498-bc7d-ea8285c92eeb admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:26.776680 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:26.803241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1147/2257] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:01:26.807658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1ee6b-17ef-42f0-86cc-93b9b072a14e admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:26.818727 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1ee6b-17ef-42f0-86cc-93b9b072a14e admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:26.823386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd275e5-83ba-4e53-9451-02cd4e21c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:26.824305 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd275e5-83ba-4e53-9451-02cd4e21c0c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:26.824581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd275e5-83ba-4e53-9451-02cd4e21c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:26.824865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd275e5-83ba-4e53-9451-02cd4e21c0c8 admin admin] PATH_INFO: `/v3/projects/49c2a429cd1e4a839e9fd5f0670e0c7a/users/a73bc26ec13245419307289d2623b196/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:26.842190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd275e5-83ba-4e53-9451-02cd4e21c0c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c2a429cd1e4a839e9fd5f0670e0c7a, user_id=a73bc26ec13245419307289d2623b196, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:26.844911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd275e5-83ba-4e53-9451-02cd4e21c0c8 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:26.918970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1111/2258] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:26 2022] PUT /identity/v3/projects/49c2a429cd1e4a839e9fd5f0670e0c7a/users/a73bc26ec13245419307289d2623b196/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:01:26.924810 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c7db4-0317-4498-bc7d-ea8285c92eeb admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:26.944457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c7db4-0317-4498-bc7d-ea8285c92eeb admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:27.009483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af197b00-755b-48a3-9431-e64c5ed85561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:27.010157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af197b00-755b-48a3-9431-e64c5ed85561 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:27.010479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af197b00-755b-48a3-9431-e64c5ed85561 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:27.010764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af197b00-755b-48a3-9431-e64c5ed85561 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:27.011503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af197b00-755b-48a3-9431-e64c5ed85561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:27.013101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af197b00-755b-48a3-9431-e64c5ed85561 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:27.026836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1148/2259] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:27.028019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd275e5-83ba-4e53-9451-02cd4e21c0c8 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:27.040267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd275e5-83ba-4e53-9451-02cd4e21c0c8 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:27.045847 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77225b8-1722-4ece-a91c-f1405bc5fb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:27.046837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77225b8-1722-4ece-a91c-f1405bc5fb2c admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:27.047128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77225b8-1722-4ece-a91c-f1405bc5fb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:27.047462 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77225b8-1722-4ece-a91c-f1405bc5fb2c admin admin] PATH_INFO: `/v3/projects/49c2a429cd1e4a839e9fd5f0670e0c7a/users/a73bc26ec13245419307289d2623b196/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:27.049886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77225b8-1722-4ece-a91c-f1405bc5fb2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c2a429cd1e4a839e9fd5f0670e0c7a, user_id=a73bc26ec13245419307289d2623b196, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:27.053222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77225b8-1722-4ece-a91c-f1405bc5fb2c admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:27.064516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1112/2260] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:27 2022] PUT /identity/v3/projects/49c2a429cd1e4a839e9fd5f0670e0c7a/users/a73bc26ec13245419307289d2623b196/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:01:27.076207 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9e97-cbdd-4c29-97d6-20b5fbc7640c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:27.076495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9e97-cbdd-4c29-97d6-20b5fbc7640c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:27.076781 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9e97-cbdd-4c29-97d6-20b5fbc7640c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:27.105110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-8c2f9e97-cbdd-4c29-97d6-20b5fbc7640c None None] MFA Rules not processed for user `a73bc26ec13245419307289d2623b196`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:27.108277 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8c2f9e97-cbdd-4c29-97d6-20b5fbc7640c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:27.175292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1149/2261] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:27.186693 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77225b8-1722-4ece-a91c-f1405bc5fb2c admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:27.188688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b77225b8-1722-4ece-a91c-f1405bc5fb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:27.247829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77225b8-1722-4ece-a91c-f1405bc5fb2c admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:27.252176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603c7e4-03a7-4a25-9db6-03162c5637b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:27.252997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603c7e4-03a7-4a25-9db6-03162c5637b3 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:27.253285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603c7e4-03a7-4a25-9db6-03162c5637b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:27.253567 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603c7e4-03a7-4a25-9db6-03162c5637b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:27.264090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603c7e4-03a7-4a25-9db6-03162c5637b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:27.265593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603c7e4-03a7-4a25-9db6-03162c5637b3 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:27.275522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1113/2262] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:27.771607 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:27.852659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f9e97-cbdd-4c29-97d6-20b5fbc7640c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:27.889945 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:27.932161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f9e97-cbdd-4c29-97d6-20b5fbc7640c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:27.937057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6471ed-8efc-4a23-8c79-fe75b16e4ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:27.937909 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6471ed-8efc-4a23-8c79-fe75b16e4ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:27.938273 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6471ed-8efc-4a23-8c79-fe75b16e4ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:27.938662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6471ed-8efc-4a23-8c79-fe75b16e4ca4 admin admin] PATH_INFO: `/v3/users/f05d9b2be2794eb4988b264ba1368efe` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:27.939984 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6471ed-8efc-4a23-8c79-fe75b16e4ca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f05d9b2be2794eb4988b264ba1368efe)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:27.941930 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6471ed-8efc-4a23-8c79-fe75b16e4ca4 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:28.155919 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6f6471ed-8efc-4a23-8c79-fe75b16e4ca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f05d9b2be2794eb4988b264ba1368efe'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:28.233527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6f6471ed-8efc-4a23-8c79-fe75b16e4ca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f05d9b2be2794eb4988b264ba1368efe'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:28.234321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6f6471ed-8efc-4a23-8c79-fe75b16e4ca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f05d9b2be2794eb4988b264ba1368efe'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:28.245657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6f6471ed-8efc-4a23-8c79-fe75b16e4ca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f05d9b2be2794eb4988b264ba1368efe'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:28.275654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6f6471ed-8efc-4a23-8c79-fe75b16e4ca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f05d9b2be2794eb4988b264ba1368efe'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:28.288774 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1150/2263] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:01:27 2022] DELETE /identity/v3/users/f05d9b2be2794eb4988b264ba1368efe => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:28.293644 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe90b8-9d16-4348-9492-9e0df34b8a24 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:28.293644 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe90b8-9d16-4348-9492-9e0df34b8a24 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:28.294225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe90b8-9d16-4348-9492-9e0df34b8a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:28.316010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-2efe90b8-9d16-4348-9492-9e0df34b8a24 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:28.317421 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2efe90b8-9d16-4348-9492-9e0df34b8a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:28.405507 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1114/2264] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:28.416211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6471ed-8efc-4a23-8c79-fe75b16e4ca4 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:28.417636 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-6f6471ed-8efc-4a23-8c79-fe75b16e4ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:28.510374 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6471ed-8efc-4a23-8c79-fe75b16e4ca4 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:28.515725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f30eae-b753-4cd8-888d-63ffd87bb525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:28.516560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f30eae-b753-4cd8-888d-63ffd87bb525 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:28.516926 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f30eae-b753-4cd8-888d-63ffd87bb525 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:28.517331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f30eae-b753-4cd8-888d-63ffd87bb525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:28.532155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f30eae-b753-4cd8-888d-63ffd87bb525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:28.533619 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f30eae-b753-4cd8-888d-63ffd87bb525 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:28.553790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1151/2265] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:28.803035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:28.974149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:29.010425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe90b8-9d16-4348-9492-9e0df34b8a24 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:29.011946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2efe90b8-9d16-4348-9492-9e0df34b8a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:29.025827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe90b8-9d16-4348-9492-9e0df34b8a24 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:29.031158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413db0d9-cd39-4702-9253-494c868cb1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:29.032341 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413db0d9-cd39-4702-9253-494c868cb1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:29.032637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413db0d9-cd39-4702-9253-494c868cb1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:29.032983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413db0d9-cd39-4702-9253-494c868cb1e9 admin admin] PATH_INFO: `/v3/projects/89c0fca3bb934c81ac2a900c279b9033` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:29.034257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413db0d9-cd39-4702-9253-494c868cb1e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c0fca3bb934c81ac2a900c279b9033)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:29.036602 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413db0d9-cd39-4702-9253-494c868cb1e9 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:29.134495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-413db0d9-cd39-4702-9253-494c868cb1e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c0fca3bb934c81ac2a900c279b9033', 'request_id': 'req-413db0d9-cd39-4702-9253-494c868cb1e9'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:29.202769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-413db0d9-cd39-4702-9253-494c868cb1e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c0fca3bb934c81ac2a900c279b9033', 'request_id': 'req-413db0d9-cd39-4702-9253-494c868cb1e9'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:29.209769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-413db0d9-cd39-4702-9253-494c868cb1e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c0fca3bb934c81ac2a900c279b9033', 'request_id': 'req-413db0d9-cd39-4702-9253-494c868cb1e9'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:29.220631 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-413db0d9-cd39-4702-9253-494c868cb1e9 admin admin] The token cache is being invalidate because project 89c0fca3bb934c81ac2a900c279b9033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:01:29.220927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-413db0d9-cd39-4702-9253-494c868cb1e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:29.221638 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-413db0d9-cd39-4702-9253-494c868cb1e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:29.223232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1115/2266] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:01:29 2022] DELETE /identity/v3/projects/89c0fca3bb934c81ac2a900c279b9033 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:29.227941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f30eae-b753-4cd8-888d-63ffd87bb525 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:29.237895 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f30eae-b753-4cd8-888d-63ffd87bb525 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:29.296817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015e069-7734-4fc8-abb2-f1ac3f202a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:29.310279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015e069-7734-4fc8-abb2-f1ac3f202a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:29.310279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015e069-7734-4fc8-abb2-f1ac3f202a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:29.310279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015e069-7734-4fc8-abb2-f1ac3f202a39 admin admin] PATH_INFO: `/v3/users/a73bc26ec13245419307289d2623b196` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:29.310279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015e069-7734-4fc8-abb2-f1ac3f202a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73bc26ec13245419307289d2623b196)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:29.310279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015e069-7734-4fc8-abb2-f1ac3f202a39 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:29.476767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3015e069-7734-4fc8-abb2-f1ac3f202a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73bc26ec13245419307289d2623b196'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:29.548374 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3015e069-7734-4fc8-abb2-f1ac3f202a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73bc26ec13245419307289d2623b196'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:29.549057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3015e069-7734-4fc8-abb2-f1ac3f202a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73bc26ec13245419307289d2623b196'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:29.562053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3015e069-7734-4fc8-abb2-f1ac3f202a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73bc26ec13245419307289d2623b196'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:29.575281 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3015e069-7734-4fc8-abb2-f1ac3f202a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73bc26ec13245419307289d2623b196'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:29.581906 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1152/2267] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:01:29 2022] DELETE /identity/v3/users/a73bc26ec13245419307289d2623b196 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:29.683981 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:29.748471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:29.992188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:30.094583 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:30.102994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413db0d9-cd39-4702-9253-494c868cb1e9 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:30.103108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-413db0d9-cd39-4702-9253-494c868cb1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:30.116111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413db0d9-cd39-4702-9253-494c868cb1e9 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:30.186420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047263b-34ed-4b1c-820f-b3f773a9b398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:30.187374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047263b-34ed-4b1c-820f-b3f773a9b398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:30.187668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047263b-34ed-4b1c-820f-b3f773a9b398 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:30.187955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047263b-34ed-4b1c-820f-b3f773a9b398 admin admin] PATH_INFO: `/v3/projects/49c2a429cd1e4a839e9fd5f0670e0c7a` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:30.189885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047263b-34ed-4b1c-820f-b3f773a9b398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c2a429cd1e4a839e9fd5f0670e0c7a)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:30.191861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047263b-34ed-4b1c-820f-b3f773a9b398 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:30.312550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:30.316934 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2047263b-34ed-4b1c-820f-b3f773a9b398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c2a429cd1e4a839e9fd5f0670e0c7a', 'request_id': 'req-2047263b-34ed-4b1c-820f-b3f773a9b398'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:30.502536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2047263b-34ed-4b1c-820f-b3f773a9b398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c2a429cd1e4a839e9fd5f0670e0c7a', 'request_id': 'req-2047263b-34ed-4b1c-820f-b3f773a9b398'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:30.522378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2047263b-34ed-4b1c-820f-b3f773a9b398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c2a429cd1e4a839e9fd5f0670e0c7a', 'request_id': 'req-2047263b-34ed-4b1c-820f-b3f773a9b398'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:30.522378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2047263b-34ed-4b1c-820f-b3f773a9b398 admin admin] The token cache is being invalidate because project 49c2a429cd1e4a839e9fd5f0670e0c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:01:30.522378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2047263b-34ed-4b1c-820f-b3f773a9b398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:30.524076 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2047263b-34ed-4b1c-820f-b3f773a9b398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:30.525826 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1116/2268] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:01:30 2022] DELETE /identity/v3/projects/49c2a429cd1e4a839e9fd5f0670e0c7a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:30.531243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1ea2a-fbaa-4211-b23f-dad8c4b79132 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:30.531530 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1ea2a-fbaa-4211-b23f-dad8c4b79132 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:30.531807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1ea2a-fbaa-4211-b23f-dad8c4b79132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:30.550470 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-b4d1ea2a-fbaa-4211-b23f-dad8c4b79132 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:30.551673 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b4d1ea2a-fbaa-4211-b23f-dad8c4b79132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:30.613192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1153/2269] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:30.621122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453984d-2761-4f51-b2fb-e323218fa0fa None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:30.621425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453984d-2761-4f51-b2fb-e323218fa0fa None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:30.621739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453984d-2761-4f51-b2fb-e323218fa0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:30.643127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-8453984d-2761-4f51-b2fb-e323218fa0fa None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:30.644363 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-8453984d-2761-4f51-b2fb-e323218fa0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:30.648056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:30.653560 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1117/2270] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:30.657637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1ea2a-fbaa-4211-b23f-dad8c4b79132 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:30.672798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1ea2a-fbaa-4211-b23f-dad8c4b79132 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:30.686531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba918b56-79f7-4a2b-a24e-91a1b0969b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:30.687988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba918b56-79f7-4a2b-a24e-91a1b0969b84 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:30.692156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba918b56-79f7-4a2b-a24e-91a1b0969b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:30.693403 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba918b56-79f7-4a2b-a24e-91a1b0969b84 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:30.694468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba918b56-79f7-4a2b-a24e-91a1b0969b84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:01:30.695000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba918b56-79f7-4a2b-a24e-91a1b0969b84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:30.697454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba918b56-79f7-4a2b-a24e-91a1b0969b84 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:30.710790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1154/2271] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:01:30.716751 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453984d-2761-4f51-b2fb-e323218fa0fa None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:30.728733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453984d-2761-4f51-b2fb-e323218fa0fa None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:30.734763 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d08330-628a-4fc4-8cee-50cbd0f40ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:30.742733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d08330-628a-4fc4-8cee-50cbd0f40ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:30.743081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d08330-628a-4fc4-8cee-50cbd0f40ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:30.748056 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d08330-628a-4fc4-8cee-50cbd0f40ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:30.748809 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d08330-628a-4fc4-8cee-50cbd0f40ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:30.751857 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d08330-628a-4fc4-8cee-50cbd0f40ad7 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:30.837860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1118/2272] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:01:30 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:30.842186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba918b56-79f7-4a2b-a24e-91a1b0969b84 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:30.854234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba918b56-79f7-4a2b-a24e-91a1b0969b84 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:30.918868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8a82b-d77b-425d-9f20-c440d8a0d33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:30.919497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8a82b-d77b-425d-9f20-c440d8a0d33c admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:30.919788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8a82b-d77b-425d-9f20-c440d8a0d33c admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:30.920131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8a82b-d77b-425d-9f20-c440d8a0d33c admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:30.920867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8a82b-d77b-425d-9f20-c440d8a0d33c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:30.921616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:30.923089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8a82b-d77b-425d-9f20-c440d8a0d33c admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:31.031816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1155/2273] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:01:30 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:31.037354 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d08330-628a-4fc4-8cee-50cbd0f40ad7 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:31.047793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d08330-628a-4fc4-8cee-50cbd0f40ad7 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:31.053461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddfd9b-222d-40e0-959c-1becb43227a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:31.054274 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddfd9b-222d-40e0-959c-1becb43227a6 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:31.055285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddfd9b-222d-40e0-959c-1becb43227a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:31.055285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddfd9b-222d-40e0-959c-1becb43227a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:31.060643 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddfd9b-222d-40e0-959c-1becb43227a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:31.060643 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddfd9b-222d-40e0-959c-1becb43227a6 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:31.073423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1119/2274] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:31.074444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8a82b-d77b-425d-9f20-c440d8a0d33c admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:31.089202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8a82b-d77b-425d-9f20-c440d8a0d33c admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:31.102123 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a0b33-d887-4bd4-bf21-2c6fd4f776d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:31.102955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a0b33-d887-4bd4-bf21-2c6fd4f776d1 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:31.103317 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a0b33-d887-4bd4-bf21-2c6fd4f776d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:31.104108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a0b33-d887-4bd4-bf21-2c6fd4f776d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:31.104502 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a0b33-d887-4bd4-bf21-2c6fd4f776d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:31.106429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a0b33-d887-4bd4-bf21-2c6fd4f776d1 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:31.122392 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1156/2275] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:31.125781 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddfd9b-222d-40e0-959c-1becb43227a6 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:31.153249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddfd9b-222d-40e0-959c-1becb43227a6 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:31.169074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b5a59-aeb5-4640-bf47-ed9623e33407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:31.169900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b5a59-aeb5-4640-bf47-ed9623e33407 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:31.170182 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b5a59-aeb5-4640-bf47-ed9623e33407 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:31.170502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b5a59-aeb5-4640-bf47-ed9623e33407 admin admin] PATH_INFO: `/v3/projects/c8154379f1ad40368caf43edb9836f25/users/6c28da037b1e4dcea838cb5a16b1b3b9/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:31.186952 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b5a59-aeb5-4640-bf47-ed9623e33407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8154379f1ad40368caf43edb9836f25, user_id=6c28da037b1e4dcea838cb5a16b1b3b9, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:31.189610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b5a59-aeb5-4640-bf47-ed9623e33407 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:31.272762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1120/2276] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:31 2022] PUT /identity/v3/projects/c8154379f1ad40368caf43edb9836f25/users/6c28da037b1e4dcea838cb5a16b1b3b9/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:31.284633 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb760337-8759-4b71-a68a-b34d912f2217 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:31.284936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb760337-8759-4b71-a68a-b34d912f2217 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:31.285278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb760337-8759-4b71-a68a-b34d912f2217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:31.327394 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-eb760337-8759-4b71-a68a-b34d912f2217 None None] MFA Rules not processed for user `6c28da037b1e4dcea838cb5a16b1b3b9`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:31.328612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-eb760337-8759-4b71-a68a-b34d912f2217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:31.401190 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1157/2277] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:31.413160 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b5a59-aeb5-4640-bf47-ed9623e33407 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:31.415183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4d3b5a59-aeb5-4640-bf47-ed9623e33407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:31.474190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b5a59-aeb5-4640-bf47-ed9623e33407 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:31.484246 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035efc5-c62d-4939-97a1-4f8592a7c681 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2b57ae83164912a4e23dda9dc239f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:31.485777 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035efc5-c62d-4939-97a1-4f8592a7c681 service glance] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:31.487645 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035efc5-c62d-4939-97a1-4f8592a7c681 service glance] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:31.491164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035efc5-c62d-4939-97a1-4f8592a7c681 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:31.500986 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035efc5-c62d-4939-97a1-4f8592a7c681 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:31.503033 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035efc5-c62d-4939-97a1-4f8592a7c681 service glance] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:31.525301 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1121/2278] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:31.892332 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:32.234399 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:32.310689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55f5d0-c27d-48c7-bd89-21a0811c9204 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:32.311011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55f5d0-c27d-48c7-bd89-21a0811c9204 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:32.311337 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55f5d0-c27d-48c7-bd89-21a0811c9204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:32.328775 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-4f55f5d0-c27d-48c7-bd89-21a0811c9204 None None] MFA Rules not processed for user `e3667bac6fe34a0bb29cdf7c9fc556f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:32.330046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4f55f5d0-c27d-48c7-bd89-21a0811c9204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:32.391754 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1158/2279] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:33.046547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:33.246137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:34.043525 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:34.291939 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:34.621301 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:34.672401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:34.976147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:35.004174 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:35.124223 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:35.155059 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:35.526684 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:35.598649 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:35.703540 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:35.817572 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:35.983511 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:36.414027 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:36.627476 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:37.092989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:37.184903 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:37.389984 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:37.601323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:37.992673 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:38.531100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:39.139689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e5950-ab4a-4a02-b12d-e20e5babbca7 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:39.140192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e5950-ab4a-4a02-b12d-e20e5babbca7 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:39.140305 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e5950-ab4a-4a02-b12d-e20e5babbca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:39.158259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-c17e5950-ab4a-4a02-b12d-e20e5babbca7 None None] MFA Rules not processed for user `ac766f08f7fb4cdbbb90b5e7c8e52226`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:39.159501 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c17e5950-ab4a-4a02-b12d-e20e5babbca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:39.210874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:39.230727 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1122/2280] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:41.654696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55f5d0-c27d-48c7-bd89-21a0811c9204 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:41.656187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4f55f5d0-c27d-48c7-bd89-21a0811c9204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:41.704039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:41.741010 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55f5d0-c27d-48c7-bd89-21a0811c9204 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:41.745743 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41a05d-8229-4db9-b417-26dc687ea8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:41.746674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41a05d-8229-4db9-b417-26dc687ea8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:41.746967 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41a05d-8229-4db9-b417-26dc687ea8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:41.747250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41a05d-8229-4db9-b417-26dc687ea8bf admin admin] PATH_INFO: `/v3/users/b42afc447b4a4c819c242ba22d9d97a2` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:41.748553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41a05d-8229-4db9-b417-26dc687ea8bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42afc447b4a4c819c242ba22d9d97a2)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:41.750658 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41a05d-8229-4db9-b417-26dc687ea8bf admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:41.971998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8f41a05d-8229-4db9-b417-26dc687ea8bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42afc447b4a4c819c242ba22d9d97a2'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:42.052577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8f41a05d-8229-4db9-b417-26dc687ea8bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42afc447b4a4c819c242ba22d9d97a2'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:42.053166 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8f41a05d-8229-4db9-b417-26dc687ea8bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42afc447b4a4c819c242ba22d9d97a2'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:42.061708 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8f41a05d-8229-4db9-b417-26dc687ea8bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42afc447b4a4c819c242ba22d9d97a2'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:42.075349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-8f41a05d-8229-4db9-b417-26dc687ea8bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42afc447b4a4c819c242ba22d9d97a2'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:42.082023 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1159/2281] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:01:41 2022] DELETE /identity/v3/users/b42afc447b4a4c819c242ba22d9d97a2 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:42.086601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e99c7-82b6-478f-a8ad-85b5399e5658 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:42.087089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e99c7-82b6-478f-a8ad-85b5399e5658 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:42.096005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e99c7-82b6-478f-a8ad-85b5399e5658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:42.105334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-d46e99c7-82b6-478f-a8ad-85b5399e5658 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:42.106581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d46e99c7-82b6-478f-a8ad-85b5399e5658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:42.182383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1123/2282] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:42.190845 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41a05d-8229-4db9-b417-26dc687ea8bf admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:42.192367 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8f41a05d-8229-4db9-b417-26dc687ea8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:42.261191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41a05d-8229-4db9-b417-26dc687ea8bf admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:42.265488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e823ac9-c3b4-4c7d-9c89-8577ce6fa0dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:42.266146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e823ac9-c3b4-4c7d-9c89-8577ce6fa0dc service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:42.266476 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e823ac9-c3b4-4c7d-9c89-8577ce6fa0dc service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:42.266758 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e823ac9-c3b4-4c7d-9c89-8577ce6fa0dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:42.276126 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e823ac9-c3b4-4c7d-9c89-8577ce6fa0dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:42.277674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e823ac9-c3b4-4c7d-9c89-8577ce6fa0dc service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:42.287167 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1160/2283] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:42.823491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e99c7-82b6-478f-a8ad-85b5399e5658 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:42.825574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d46e99c7-82b6-478f-a8ad-85b5399e5658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:42.840015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e99c7-82b6-478f-a8ad-85b5399e5658 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:42.845118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a6270-032d-451f-a52b-729b0662e979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:42.846064 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a6270-032d-451f-a52b-729b0662e979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:42.846450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a6270-032d-451f-a52b-729b0662e979 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:42.846885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a6270-032d-451f-a52b-729b0662e979 admin admin] PATH_INFO: `/v3/projects/1eb3ad1b4a3e4578bf3565ec80d776e1` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:42.853901 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a6270-032d-451f-a52b-729b0662e979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb3ad1b4a3e4578bf3565ec80d776e1)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:42.853901 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a6270-032d-451f-a52b-729b0662e979 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:42.971554 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:42.986927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-168a6270-032d-451f-a52b-729b0662e979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb3ad1b4a3e4578bf3565ec80d776e1', 'request_id': 'req-168a6270-032d-451f-a52b-729b0662e979'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:43.064707 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-168a6270-032d-451f-a52b-729b0662e979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb3ad1b4a3e4578bf3565ec80d776e1', 'request_id': 'req-168a6270-032d-451f-a52b-729b0662e979'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:43.073440 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-168a6270-032d-451f-a52b-729b0662e979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb3ad1b4a3e4578bf3565ec80d776e1', 'request_id': 'req-168a6270-032d-451f-a52b-729b0662e979'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:43.084182 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-168a6270-032d-451f-a52b-729b0662e979 admin admin] The token cache is being invalidate because project 1eb3ad1b4a3e4578bf3565ec80d776e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:01:43.084482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-168a6270-032d-451f-a52b-729b0662e979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:43.085148 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-168a6270-032d-451f-a52b-729b0662e979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:43.087672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1124/2284] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:01:42 2022] DELETE /identity/v3/projects/1eb3ad1b4a3e4578bf3565ec80d776e1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:43.093884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6223b2b-4cb6-499e-9b13-947db43ba022 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:43.094321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6223b2b-4cb6-499e-9b13-947db43ba022 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:43.094465 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6223b2b-4cb6-499e-9b13-947db43ba022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:43.123718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e6223b2b-4cb6-499e-9b13-947db43ba022 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:43.126119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e6223b2b-4cb6-499e-9b13-947db43ba022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:43.171989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:43.188413 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1161/2285] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:43.201663 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac20a99-04e4-40d2-8fff-6136d32ff111 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:43.202053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac20a99-04e4-40d2-8fff-6136d32ff111 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:43.202465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac20a99-04e4-40d2-8fff-6136d32ff111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:43.221703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-dac20a99-04e4-40d2-8fff-6136d32ff111 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:43.223092 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-dac20a99-04e4-40d2-8fff-6136d32ff111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:43.248626 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1125/2286] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:43.249264 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6223b2b-4cb6-499e-9b13-947db43ba022 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:43.261601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6223b2b-4cb6-499e-9b13-947db43ba022 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:43.273574 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec1e44-6856-4290-9367-0185a6ef1c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:43.274329 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec1e44-6856-4290-9367-0185a6ef1c00 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:43.274645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec1e44-6856-4290-9367-0185a6ef1c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:43.274929 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec1e44-6856-4290-9367-0185a6ef1c00 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:43.275677 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec1e44-6856-4290-9367-0185a6ef1c00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:01:43.276179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec1e44-6856-4290-9367-0185a6ef1c00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:43.277992 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec1e44-6856-4290-9367-0185a6ef1c00 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:43.290631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1162/2287] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:01:43.295360 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac20a99-04e4-40d2-8fff-6136d32ff111 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:43.305977 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac20a99-04e4-40d2-8fff-6136d32ff111 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:43.310825 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983dd31-4738-4c10-a7de-ba74c2f1473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:43.312505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983dd31-4738-4c10-a7de-ba74c2f1473c admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:43.312795 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983dd31-4738-4c10-a7de-ba74c2f1473c admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:43.313882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983dd31-4738-4c10-a7de-ba74c2f1473c admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:43.313882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983dd31-4738-4c10-a7de-ba74c2f1473c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:43.315853 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d983dd31-4738-4c10-a7de-ba74c2f1473c admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:43.474831 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1126/2288] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:01:43 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:43.483718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec1e44-6856-4290-9367-0185a6ef1c00 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:43.495509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec1e44-6856-4290-9367-0185a6ef1c00 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:43.552167 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08312749-98ef-469c-88d0-9949fcbe60af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:43.552846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312749-98ef-469c-88d0-9949fcbe60af admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:43.553138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312749-98ef-469c-88d0-9949fcbe60af admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:43.557387 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312749-98ef-469c-88d0-9949fcbe60af admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:43.557387 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08312749-98ef-469c-88d0-9949fcbe60af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:43.557387 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08312749-98ef-469c-88d0-9949fcbe60af admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:43.694148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1163/2289] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:01:43 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:43.701548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983dd31-4738-4c10-a7de-ba74c2f1473c admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:43.713198 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983dd31-4738-4c10-a7de-ba74c2f1473c admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:43.722301 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24056431-c714-43d2-a9b2-a237352b1a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:43.723021 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24056431-c714-43d2-a9b2-a237352b1a47 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:43.723500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24056431-c714-43d2-a9b2-a237352b1a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:43.723804 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24056431-c714-43d2-a9b2-a237352b1a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:43.724692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24056431-c714-43d2-a9b2-a237352b1a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:43.727011 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24056431-c714-43d2-a9b2-a237352b1a47 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:43.749020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1127/2290] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:43.753208 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08312749-98ef-469c-88d0-9949fcbe60af admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:43.771081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08312749-98ef-469c-88d0-9949fcbe60af admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:43.776605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f3197-db71-4e06-8982-bf8fc742494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:43.777280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f3197-db71-4e06-8982-bf8fc742494d admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:43.777569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f3197-db71-4e06-8982-bf8fc742494d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:43.777848 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f3197-db71-4e06-8982-bf8fc742494d admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:43.778763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f3197-db71-4e06-8982-bf8fc742494d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:43.780459 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f3197-db71-4e06-8982-bf8fc742494d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:43.794750 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1164/2291] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:43.796148 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24056431-c714-43d2-a9b2-a237352b1a47 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:43.807402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24056431-c714-43d2-a9b2-a237352b1a47 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:43.812231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cebb8e-d3f6-48fb-8ad1-5b19f847b50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:43.813220 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cebb8e-d3f6-48fb-8ad1-5b19f847b50a admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:43.813572 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cebb8e-d3f6-48fb-8ad1-5b19f847b50a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:43.813915 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cebb8e-d3f6-48fb-8ad1-5b19f847b50a admin admin] PATH_INFO: `/v3/projects/9611045284d14184b810eb3a44b0340b/users/982027c459274d95abb7f08c21529740/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:43.829989 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cebb8e-d3f6-48fb-8ad1-5b19f847b50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9611045284d14184b810eb3a44b0340b, user_id=982027c459274d95abb7f08c21529740, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:43.832900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cebb8e-d3f6-48fb-8ad1-5b19f847b50a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:43.916933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1128/2292] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:43 2022] PUT /identity/v3/projects/9611045284d14184b810eb3a44b0340b/users/982027c459274d95abb7f08c21529740/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:43.920943 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccae90-4e1c-4038-a488-d1d6212dfe4c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:43.921240 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccae90-4e1c-4038-a488-d1d6212dfe4c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:43.921523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccae90-4e1c-4038-a488-d1d6212dfe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:43.950332 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-9eccae90-4e1c-4038-a488-d1d6212dfe4c None None] MFA Rules not processed for user `982027c459274d95abb7f08c21529740`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:43.951574 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9eccae90-4e1c-4038-a488-d1d6212dfe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:44.027966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1165/2293] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:44.039714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cebb8e-d3f6-48fb-8ad1-5b19f847b50a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:44.041513 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e2cebb8e-d3f6-48fb-8ad1-5b19f847b50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:44.104718 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cebb8e-d3f6-48fb-8ad1-5b19f847b50a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:44.109991 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929660d-d89b-4ca7-b160-a9abad7f812e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:44.110703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929660d-d89b-4ca7-b160-a9abad7f812e service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:44.111034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929660d-d89b-4ca7-b160-a9abad7f812e service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:44.111314 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929660d-d89b-4ca7-b160-a9abad7f812e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:44.121038 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929660d-d89b-4ca7-b160-a9abad7f812e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:44.122510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929660d-d89b-4ca7-b160-a9abad7f812e service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:44.132072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1129/2294] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:44.160646 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccae90-4e1c-4038-a488-d1d6212dfe4c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:44.213780 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:44.234005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccae90-4e1c-4038-a488-d1d6212dfe4c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:44.240893 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538e70c-3167-4e71-8c1e-76c1bb12d665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:44.243076 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538e70c-3167-4e71-8c1e-76c1bb12d665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:44.243076 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538e70c-3167-4e71-8c1e-76c1bb12d665 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:44.243319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538e70c-3167-4e71-8c1e-76c1bb12d665 admin admin] PATH_INFO: `/v3/users/982027c459274d95abb7f08c21529740` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:44.244767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538e70c-3167-4e71-8c1e-76c1bb12d665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=982027c459274d95abb7f08c21529740)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:44.248036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538e70c-3167-4e71-8c1e-76c1bb12d665 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:44.458569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4538e70c-3167-4e71-8c1e-76c1bb12d665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982027c459274d95abb7f08c21529740'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:44.613471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4538e70c-3167-4e71-8c1e-76c1bb12d665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982027c459274d95abb7f08c21529740'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:44.614599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4538e70c-3167-4e71-8c1e-76c1bb12d665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982027c459274d95abb7f08c21529740'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:44.623646 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4538e70c-3167-4e71-8c1e-76c1bb12d665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982027c459274d95abb7f08c21529740'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:44.656888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-4538e70c-3167-4e71-8c1e-76c1bb12d665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982027c459274d95abb7f08c21529740'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:44.663304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1166/2295] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:01:44 2022] DELETE /identity/v3/users/982027c459274d95abb7f08c21529740 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:44.668528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba117d-6a49-4c68-9afa-bc64f251585c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:44.668871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba117d-6a49-4c68-9afa-bc64f251585c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:44.669231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba117d-6a49-4c68-9afa-bc64f251585c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:44.689619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-58ba117d-6a49-4c68-9afa-bc64f251585c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:44.690503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-58ba117d-6a49-4c68-9afa-bc64f251585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:44.742580 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:44.758493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1130/2296] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:44.768639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538e70c-3167-4e71-8c1e-76c1bb12d665 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:44.769932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4538e70c-3167-4e71-8c1e-76c1bb12d665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:44.848559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538e70c-3167-4e71-8c1e-76c1bb12d665 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:44.860084 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71658961-ff94-41c0-9c49-2cbf02af2910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:44.863562 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71658961-ff94-41c0-9c49-2cbf02af2910 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:44.863864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71658961-ff94-41c0-9c49-2cbf02af2910 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:44.864261 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71658961-ff94-41c0-9c49-2cbf02af2910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:44.880141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71658961-ff94-41c0-9c49-2cbf02af2910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:44.882051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71658961-ff94-41c0-9c49-2cbf02af2910 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:44.895625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1167/2297] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:01:45.421822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba117d-6a49-4c68-9afa-bc64f251585c None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:45.423873 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-58ba117d-6a49-4c68-9afa-bc64f251585c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:45.437370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba117d-6a49-4c68-9afa-bc64f251585c None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:45.446233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21bfa8-2d31-4a1f-9852-0ce94e17f34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:45.446233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21bfa8-2d31-4a1f-9852-0ce94e17f34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:45.446233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21bfa8-2d31-4a1f-9852-0ce94e17f34b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:45.446233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21bfa8-2d31-4a1f-9852-0ce94e17f34b admin admin] PATH_INFO: `/v3/projects/9611045284d14184b810eb3a44b0340b` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:45.447024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21bfa8-2d31-4a1f-9852-0ce94e17f34b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9611045284d14184b810eb3a44b0340b)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:45.448356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21bfa8-2d31-4a1f-9852-0ce94e17f34b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:45.587195 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-de21bfa8-2d31-4a1f-9852-0ce94e17f34b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9611045284d14184b810eb3a44b0340b', 'request_id': 'req-de21bfa8-2d31-4a1f-9852-0ce94e17f34b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:45.661511 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-de21bfa8-2d31-4a1f-9852-0ce94e17f34b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9611045284d14184b810eb3a44b0340b', 'request_id': 'req-de21bfa8-2d31-4a1f-9852-0ce94e17f34b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:45.670599 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-de21bfa8-2d31-4a1f-9852-0ce94e17f34b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9611045284d14184b810eb3a44b0340b', 'request_id': 'req-de21bfa8-2d31-4a1f-9852-0ce94e17f34b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:45.684564 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-de21bfa8-2d31-4a1f-9852-0ce94e17f34b admin admin] The token cache is being invalidate because project 9611045284d14184b810eb3a44b0340b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:01:45.684917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-de21bfa8-2d31-4a1f-9852-0ce94e17f34b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:45.686495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-de21bfa8-2d31-4a1f-9852-0ce94e17f34b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:01:45.689470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1131/2298] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:01:45 2022] DELETE /identity/v3/projects/9611045284d14184b810eb3a44b0340b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:45.694383 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630a9b3-2165-4ddd-96e1-dcee58ad1f02 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:45.695905 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630a9b3-2165-4ddd-96e1-dcee58ad1f02 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:45.696831 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630a9b3-2165-4ddd-96e1-dcee58ad1f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:45.730219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-4630a9b3-2165-4ddd-96e1-dcee58ad1f02 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:45.732355 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4630a9b3-2165-4ddd-96e1-dcee58ad1f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:45.810682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1168/2299] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:45.818214 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bef46b-de93-4a71-884b-2b09ef085e11 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:45.818559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bef46b-de93-4a71-884b-2b09ef085e11 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:45.818849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bef46b-de93-4a71-884b-2b09ef085e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:45.846422 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-81bef46b-de93-4a71-884b-2b09ef085e11 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:45.847692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-81bef46b-de93-4a71-884b-2b09ef085e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:45.871909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1132/2300] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:45.873454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630a9b3-2165-4ddd-96e1-dcee58ad1f02 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:45.887168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630a9b3-2165-4ddd-96e1-dcee58ad1f02 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:45.893907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba37b5-eff4-4bd4-8ea3-5462b5f63de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:45.894647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba37b5-eff4-4bd4-8ea3-5462b5f63de5 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:45.895279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba37b5-eff4-4bd4-8ea3-5462b5f63de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:45.895279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba37b5-eff4-4bd4-8ea3-5462b5f63de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:45.895951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba37b5-eff4-4bd4-8ea3-5462b5f63de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:01:45.896274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba37b5-eff4-4bd4-8ea3-5462b5f63de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:45.898435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba37b5-eff4-4bd4-8ea3-5462b5f63de5 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:45.900838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:45.921543 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1169/2301] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:01:45.921648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bef46b-de93-4a71-884b-2b09ef085e11 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:45.932053 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bef46b-de93-4a71-884b-2b09ef085e11 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:45.937828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f0391-1d6f-446b-8efc-db039f5b0847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:45.938947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f0391-1d6f-446b-8efc-db039f5b0847 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:45.940989 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f0391-1d6f-446b-8efc-db039f5b0847 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:45.943366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f0391-1d6f-446b-8efc-db039f5b0847 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:45.943366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f0391-1d6f-446b-8efc-db039f5b0847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:45.944665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f0391-1d6f-446b-8efc-db039f5b0847 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:46.070234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1133/2302] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:01:45 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:01:46.074458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba37b5-eff4-4bd4-8ea3-5462b5f63de5 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:46.086826 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba37b5-eff4-4bd4-8ea3-5462b5f63de5 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:46.181143 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbc306-8acf-402b-bfaa-27388ac426d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:46.185778 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc306-8acf-402b-bfaa-27388ac426d9 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:46.185778 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc306-8acf-402b-bfaa-27388ac426d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:46.185778 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc306-8acf-402b-bfaa-27388ac426d9 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:46.185778 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbc306-8acf-402b-bfaa-27388ac426d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:46.195677 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbc306-8acf-402b-bfaa-27388ac426d9 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:46.332687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1170/2303] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:01:46 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:01:46.343643 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f0391-1d6f-446b-8efc-db039f5b0847 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:46.356080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f0391-1d6f-446b-8efc-db039f5b0847 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:46.362721 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833d6cc-e0c7-4347-a786-ed2bc8e0c3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:46.363418 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833d6cc-e0c7-4347-a786-ed2bc8e0c3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:46.363710 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833d6cc-e0c7-4347-a786-ed2bc8e0c3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:46.363993 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833d6cc-e0c7-4347-a786-ed2bc8e0c3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:46.364732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833d6cc-e0c7-4347-a786-ed2bc8e0c3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:46.367129 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833d6cc-e0c7-4347-a786-ed2bc8e0c3a3 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:46.383292 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1134/2304] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:01:46.387006 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbc306-8acf-402b-bfaa-27388ac426d9 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:46.400589 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbc306-8acf-402b-bfaa-27388ac426d9 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:46.406487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d90836-78d3-4f9a-8312-c18c5868e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:46.407291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d90836-78d3-4f9a-8312-c18c5868e86b admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:46.407709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d90836-78d3-4f9a-8312-c18c5868e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:46.408091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d90836-78d3-4f9a-8312-c18c5868e86b admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:46.408939 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d90836-78d3-4f9a-8312-c18c5868e86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:46.410820 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d90836-78d3-4f9a-8312-c18c5868e86b admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:46.426557 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1171/2305] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:01:46.427967 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833d6cc-e0c7-4347-a786-ed2bc8e0c3a3 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:46.444950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833d6cc-e0c7-4347-a786-ed2bc8e0c3a3 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:46.451636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860776e-9640-47b8-aabf-83baff0bfe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:46.452535 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860776e-9640-47b8-aabf-83baff0bfe99 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:46.452849 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860776e-9640-47b8-aabf-83baff0bfe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:46.453162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860776e-9640-47b8-aabf-83baff0bfe99 admin admin] PATH_INFO: `/v3/projects/901aa44006cb40e69508a510c7889c41/users/28a56228177f4d0a8fbbe1e6bd8ab31a/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:46.471716 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2860776e-9640-47b8-aabf-83baff0bfe99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=901aa44006cb40e69508a510c7889c41, user_id=28a56228177f4d0a8fbbe1e6bd8ab31a, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:46.474949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2860776e-9640-47b8-aabf-83baff0bfe99 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:46.686657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1135/2306] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:01:46 2022] PUT /identity/v3/projects/901aa44006cb40e69508a510c7889c41/users/28a56228177f4d0a8fbbe1e6bd8ab31a/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:01:46.699673 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878230b9-5e95-4a2c-8a83-f70917b323dd None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:46.700146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878230b9-5e95-4a2c-8a83-f70917b323dd None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:46.700867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878230b9-5e95-4a2c-8a83-f70917b323dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:46.782900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-878230b9-5e95-4a2c-8a83-f70917b323dd None None] MFA Rules not processed for user `28a56228177f4d0a8fbbe1e6bd8ab31a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:46.790192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-878230b9-5e95-4a2c-8a83-f70917b323dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:46.965091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1172/2307] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:46.978024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860776e-9640-47b8-aabf-83baff0bfe99 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:46.980032 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2860776e-9640-47b8-aabf-83baff0bfe99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:47.101828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860776e-9640-47b8-aabf-83baff0bfe99 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:47.106515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca086f-ebd4-41b8-be2b-4641c3fae984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:47.107731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca086f-ebd4-41b8-be2b-4641c3fae984 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:47.108249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca086f-ebd4-41b8-be2b-4641c3fae984 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:47.108713 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca086f-ebd4-41b8-be2b-4641c3fae984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:47.120433 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca086f-ebd4-41b8-be2b-4641c3fae984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:47.122316 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca086f-ebd4-41b8-be2b-4641c3fae984 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:47.135884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1136/2308] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:47.868165 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1e0ea-4984-4ff2-a966-271a885b4598 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:47.868750 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1e0ea-4984-4ff2-a966-271a885b4598 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:47.868886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1e0ea-4984-4ff2-a966-271a885b4598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:47.888074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-dfe1e0ea-4984-4ff2-a966-271a885b4598 None None] MFA Rules not processed for user `9cbadf27b0054737bc798f8500dd661f`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:47.889280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-dfe1e0ea-4984-4ff2-a966-271a885b4598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:47.944456 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1173/2309] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:01:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:53.224955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bfc38-36fb-4312-b7eb-bf8572d7c8a1 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:53.229692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bfc38-36fb-4312-b7eb-bf8572d7c8a1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:53.229692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bfc38-36fb-4312-b7eb-bf8572d7c8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:53.244637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b98bfc38-36fb-4312-b7eb-bf8572d7c8a1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:53.245844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b98bfc38-36fb-4312-b7eb-bf8572d7c8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:53.261753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:53.318230 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1137/2310] 10.222.0.24 () {58 vars in 1016 bytes} [Fri May 27 20:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:53.442828 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1e0ea-4984-4ff2-a966-271a885b4598 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:53.444275 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-dfe1e0ea-4984-4ff2-a966-271a885b4598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:53.458474 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:01:53.573046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1e0ea-4984-4ff2-a966-271a885b4598 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:53.580419 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295d76c-5082-458c-8442-81a8dd26933b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:53.584407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295d76c-5082-458c-8442-81a8dd26933b service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:53.584407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295d76c-5082-458c-8442-81a8dd26933b service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:53.584407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295d76c-5082-458c-8442-81a8dd26933b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:53.593703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295d76c-5082-458c-8442-81a8dd26933b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:53.595447 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4295d76c-5082-458c-8442-81a8dd26933b service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:53.606397 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1174/2311] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:01:58.436748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc67806-46a4-47c4-a3e7-9849a06a6934 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:58.437317 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc67806-46a4-47c4-a3e7-9849a06a6934 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:58.437500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc67806-46a4-47c4-a3e7-9849a06a6934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:58.457012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-3cc67806-46a4-47c4-a3e7-9849a06a6934 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:01:58.458233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-3cc67806-46a4-47c4-a3e7-9849a06a6934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:58.466375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1138/2312] 10.222.0.24 () {58 vars in 1016 bytes} [Fri May 27 20:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:01:58.486071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295d76c-5082-458c-8442-81a8dd26933b service nova] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:01:58.486071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4295d76c-5082-458c-8442-81a8dd26933b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:01:58.500926 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295d76c-5082-458c-8442-81a8dd26933b service nova] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:01:58.506876 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b2bcfd-1832-4d6e-a4ea-cf1a73fe4260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:01:58.507523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2bcfd-1832-4d6e-a4ea-cf1a73fe4260 service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:01:58.507812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2bcfd-1832-4d6e-a4ea-cf1a73fe4260 service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:01:58.508096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b2bcfd-1832-4d6e-a4ea-cf1a73fe4260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:01:58.519249 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2bcfd-1832-4d6e-a4ea-cf1a73fe4260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:01:58.520917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b2bcfd-1832-4d6e-a4ea-cf1a73fe4260 service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:01:58.532287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1175/2313] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:02:00.909101 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc67806-46a4-47c4-a3e7-9849a06a6934 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:00.919146 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc67806-46a4-47c4-a3e7-9849a06a6934 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:00.924930 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26b85b-707b-405d-b8dc-8c24933153ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:00.927534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26b85b-707b-405d-b8dc-8c24933153ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:00.927534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26b85b-707b-405d-b8dc-8c24933153ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:00.927534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26b85b-707b-405d-b8dc-8c24933153ef admin admin] PATH_INFO: `/v3/users/28a56228177f4d0a8fbbe1e6bd8ab31a` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:00.927805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26b85b-707b-405d-b8dc-8c24933153ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=28a56228177f4d0a8fbbe1e6bd8ab31a)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:00.929560 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26b85b-707b-405d-b8dc-8c24933153ef admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:01.126565 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5d26b85b-707b-405d-b8dc-8c24933153ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a56228177f4d0a8fbbe1e6bd8ab31a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:01.127225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5d26b85b-707b-405d-b8dc-8c24933153ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a56228177f4d0a8fbbe1e6bd8ab31a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:01.198027 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5d26b85b-707b-405d-b8dc-8c24933153ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a56228177f4d0a8fbbe1e6bd8ab31a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:01.210307 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5d26b85b-707b-405d-b8dc-8c24933153ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a56228177f4d0a8fbbe1e6bd8ab31a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:01.217232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-5d26b85b-707b-405d-b8dc-8c24933153ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a56228177f4d0a8fbbe1e6bd8ab31a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:01.223231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1139/2314] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:02:00 2022] DELETE /identity/v3/users/28a56228177f4d0a8fbbe1e6bd8ab31a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:02:01.227835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5dfcf-e104-4317-9caf-f5e45ea57fe9 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:01.228323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5dfcf-e104-4317-9caf-f5e45ea57fe9 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:01.228420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5dfcf-e104-4317-9caf-f5e45ea57fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:01.247597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e3f5dfcf-e104-4317-9caf-f5e45ea57fe9 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:01.248796 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e3f5dfcf-e104-4317-9caf-f5e45ea57fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:01.307275 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1176/2315] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:02:01.316847 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26b85b-707b-405d-b8dc-8c24933153ef admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:01.318306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-5d26b85b-707b-405d-b8dc-8c24933153ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:01.375922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26b85b-707b-405d-b8dc-8c24933153ef admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:01.379571 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc3aeb-b29d-4023-87db-36ac645da06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:01.380251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc3aeb-b29d-4023-87db-36ac645da06a service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:01.380807 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc3aeb-b29d-4023-87db-36ac645da06a service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:01.381096 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc3aeb-b29d-4023-87db-36ac645da06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:01.392227 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc3aeb-b29d-4023-87db-36ac645da06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:01.393756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc3aeb-b29d-4023-87db-36ac645da06a service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:01.404037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1140/2316] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:02:01.849106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5dfcf-e104-4317-9caf-f5e45ea57fe9 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:01.850784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e3f5dfcf-e104-4317-9caf-f5e45ea57fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:01.864554 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5dfcf-e104-4317-9caf-f5e45ea57fe9 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:01.872417 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b87f9-5b9c-462d-9e33-06cdb05ebc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:01.873493 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b87f9-5b9c-462d-9e33-06cdb05ebc51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:01.874051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b87f9-5b9c-462d-9e33-06cdb05ebc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:01.874508 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b87f9-5b9c-462d-9e33-06cdb05ebc51 admin admin] PATH_INFO: `/v3/projects/901aa44006cb40e69508a510c7889c41` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:01.875969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b87f9-5b9c-462d-9e33-06cdb05ebc51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=901aa44006cb40e69508a510c7889c41)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:01.878544 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b87f9-5b9c-462d-9e33-06cdb05ebc51 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:01.995950 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-db6b87f9-5b9c-462d-9e33-06cdb05ebc51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '901aa44006cb40e69508a510c7889c41', 'request_id': 'req-db6b87f9-5b9c-462d-9e33-06cdb05ebc51'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:01.997397 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:02.003385 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-db6b87f9-5b9c-462d-9e33-06cdb05ebc51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '901aa44006cb40e69508a510c7889c41', 'request_id': 'req-db6b87f9-5b9c-462d-9e33-06cdb05ebc51'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:02.009666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-db6b87f9-5b9c-462d-9e33-06cdb05ebc51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '901aa44006cb40e69508a510c7889c41', 'request_id': 'req-db6b87f9-5b9c-462d-9e33-06cdb05ebc51'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:02.108187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-db6b87f9-5b9c-462d-9e33-06cdb05ebc51 admin admin] The token cache is being invalidate because project 901aa44006cb40e69508a510c7889c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:02:02.108563 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-db6b87f9-5b9c-462d-9e33-06cdb05ebc51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:02.109247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-db6b87f9-5b9c-462d-9e33-06cdb05ebc51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:02.114672 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1177/2317] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:02:01 2022] DELETE /identity/v3/projects/901aa44006cb40e69508a510c7889c41 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:02:04.535858 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc3aeb-b29d-4023-87db-36ac645da06a service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:04.535858 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-36cc3aeb-b29d-4023-87db-36ac645da06a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:04.547753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc3aeb-b29d-4023-87db-36ac645da06a service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:04.572230 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:04.609666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd208029-1cc0-4798-aad2-8a6f89ece97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:04.610939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd208029-1cc0-4798-aad2-8a6f89ece97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:04.611507 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd208029-1cc0-4798-aad2-8a6f89ece97b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:04.611792 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd208029-1cc0-4798-aad2-8a6f89ece97b admin admin] PATH_INFO: `/v3/users/6c28da037b1e4dcea838cb5a16b1b3b9` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:04.613022 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd208029-1cc0-4798-aad2-8a6f89ece97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c28da037b1e4dcea838cb5a16b1b3b9)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:04.615007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd208029-1cc0-4798-aad2-8a6f89ece97b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:04.813402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-fd208029-1cc0-4798-aad2-8a6f89ece97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c28da037b1e4dcea838cb5a16b1b3b9'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:04.814066 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-fd208029-1cc0-4798-aad2-8a6f89ece97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c28da037b1e4dcea838cb5a16b1b3b9'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:04.896242 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-fd208029-1cc0-4798-aad2-8a6f89ece97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c28da037b1e4dcea838cb5a16b1b3b9'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:04.911016 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-fd208029-1cc0-4798-aad2-8a6f89ece97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c28da037b1e4dcea838cb5a16b1b3b9'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:04.919786 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-fd208029-1cc0-4798-aad2-8a6f89ece97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c28da037b1e4dcea838cb5a16b1b3b9'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:04.926790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1141/2318] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:02:04 2022] DELETE /identity/v3/users/6c28da037b1e4dcea838cb5a16b1b3b9 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:02:04.934454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74b0d6-ba63-4620-81df-2d3f8611c601 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:04.935111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74b0d6-ba63-4620-81df-2d3f8611c601 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:04.935111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74b0d6-ba63-4620-81df-2d3f8611c601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:04.956277 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-4e74b0d6-ba63-4620-81df-2d3f8611c601 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:04.957539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4e74b0d6-ba63-4620-81df-2d3f8611c601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:05.034790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1178/2319] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:02:05.045973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd208029-1cc0-4798-aad2-8a6f89ece97b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:05.047428 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-fd208029-1cc0-4798-aad2-8a6f89ece97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:05.109938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd208029-1cc0-4798-aad2-8a6f89ece97b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:05.114036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4522fcc-bf0f-48a7-82fb-1dc9fe3c2917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:05.114664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4522fcc-bf0f-48a7-82fb-1dc9fe3c2917 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:05.115156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4522fcc-bf0f-48a7-82fb-1dc9fe3c2917 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:05.115445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4522fcc-bf0f-48a7-82fb-1dc9fe3c2917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:05.127005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4522fcc-bf0f-48a7-82fb-1dc9fe3c2917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:05.129724 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4522fcc-bf0f-48a7-82fb-1dc9fe3c2917 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:05.136745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3f5fb-3da4-4ee3-b584-eb38c4ce18db None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:05.137365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3f5fb-3da4-4ee3-b584-eb38c4ce18db None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:05.137802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3f5fb-3da4-4ee3-b584-eb38c4ce18db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:05.142783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1142/2320] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:02:05.176638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-98e3f5fb-3da4-4ee3-b584-eb38c4ce18db None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:05.178297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-98e3f5fb-3da4-4ee3-b584-eb38c4ce18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:05.187098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1179/2321] 10.222.0.24 () {58 vars in 1016 bytes} [Fri May 27 20:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:02:05.203456 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4522fcc-bf0f-48a7-82fb-1dc9fe3c2917 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:05.204920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c4522fcc-bf0f-48a7-82fb-1dc9fe3c2917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:05.258402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:05.282432 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4522fcc-bf0f-48a7-82fb-1dc9fe3c2917 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:05.288458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d713780-c1fb-4e92-8eb8-9a74e7d70994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:05.289545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d713780-c1fb-4e92-8eb8-9a74e7d70994 service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:05.289844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d713780-c1fb-4e92-8eb8-9a74e7d70994 service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:05.290123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d713780-c1fb-4e92-8eb8-9a74e7d70994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:05.299106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d713780-c1fb-4e92-8eb8-9a74e7d70994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:05.300729 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d713780-c1fb-4e92-8eb8-9a74e7d70994 service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:05.311619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1143/2322] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:02:05.590969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3f5fb-3da4-4ee3-b584-eb38c4ce18db None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:05.592433 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-98e3f5fb-3da4-4ee3-b584-eb38c4ce18db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:05.611594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3f5fb-3da4-4ee3-b584-eb38c4ce18db None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:05.611594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e0d3b-070f-4d22-a8f7-726318a83139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:05.612455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e0d3b-070f-4d22-a8f7-726318a83139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:05.612455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e0d3b-070f-4d22-a8f7-726318a83139 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:05.612455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e0d3b-070f-4d22-a8f7-726318a83139 admin admin] PATH_INFO: `/v3/projects/c8154379f1ad40368caf43edb9836f25` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:05.614601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e0d3b-070f-4d22-a8f7-726318a83139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8154379f1ad40368caf43edb9836f25)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:05.616565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e0d3b-070f-4d22-a8f7-726318a83139 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:05.758676 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a43e0d3b-070f-4d22-a8f7-726318a83139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8154379f1ad40368caf43edb9836f25', 'request_id': 'req-a43e0d3b-070f-4d22-a8f7-726318a83139'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:05.766300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a43e0d3b-070f-4d22-a8f7-726318a83139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8154379f1ad40368caf43edb9836f25', 'request_id': 'req-a43e0d3b-070f-4d22-a8f7-726318a83139'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:05.772494 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a43e0d3b-070f-4d22-a8f7-726318a83139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8154379f1ad40368caf43edb9836f25', 'request_id': 'req-a43e0d3b-070f-4d22-a8f7-726318a83139'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:05.844451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a43e0d3b-070f-4d22-a8f7-726318a83139 admin admin] The token cache is being invalidate because project c8154379f1ad40368caf43edb9836f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:02:05.844812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a43e0d3b-070f-4d22-a8f7-726318a83139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:05.855131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a43e0d3b-070f-4d22-a8f7-726318a83139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:05.855131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1180/2323] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:02:05 2022] DELETE /identity/v3/projects/c8154379f1ad40368caf43edb9836f25 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:02:07.374026 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff4ad8-88c4-4bc8-9992-8011f1eadf6c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:07.374508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff4ad8-88c4-4bc8-9992-8011f1eadf6c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:07.374620 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff4ad8-88c4-4bc8-9992-8011f1eadf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:07.403370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-1cff4ad8-88c4-4bc8-9992-8011f1eadf6c None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:07.404574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-1cff4ad8-88c4-4bc8-9992-8011f1eadf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:07.462604 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1144/2324] 10.222.0.15 () {58 vars in 1009 bytes} [Fri May 27 20:02:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:02:07.504888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e0d3b-070f-4d22-a8f7-726318a83139 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:07.506594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a43e0d3b-070f-4d22-a8f7-726318a83139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:07.560979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:07.576101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e0d3b-070f-4d22-a8f7-726318a83139 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:07.581125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a3a85-918e-44eb-bb2d-4d9fe68cfc99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:07.581775 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a3a85-918e-44eb-bb2d-4d9fe68cfc99 service swift] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:07.582064 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a3a85-918e-44eb-bb2d-4d9fe68cfc99 service swift] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:07.582360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a3a85-918e-44eb-bb2d-4d9fe68cfc99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:07.590359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a3a85-918e-44eb-bb2d-4d9fe68cfc99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:07.591979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a3a85-918e-44eb-bb2d-4d9fe68cfc99 service swift] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:07.600566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1181/2325] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:02:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 20:02:09.066208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1810f-35b8-4971-912f-beed07deeabf None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:09.066750 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1810f-35b8-4971-912f-beed07deeabf None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:09.066859 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1810f-35b8-4971-912f-beed07deeabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:09.089872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-c0d1810f-35b8-4971-912f-beed07deeabf None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:09.091290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c0d1810f-35b8-4971-912f-beed07deeabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:09.195218 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1145/2326] 10.222.0.24 () {58 vars in 1016 bytes} [Fri May 27 20:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:02:09.213757 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a3a85-918e-44eb-bb2d-4d9fe68cfc99 service swift] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:09.216610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9a4a3a85-918e-44eb-bb2d-4d9fe68cfc99 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:09.379945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a3a85-918e-44eb-bb2d-4d9fe68cfc99 service swift] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:09.389816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcdb8a-d9a1-4b9b-ac68-c10e32e28f09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:09.391185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcdb8a-d9a1-4b9b-ac68-c10e32e28f09 service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:09.391484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcdb8a-d9a1-4b9b-ac68-c10e32e28f09 service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:09.391785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dcdb8a-d9a1-4b9b-ac68-c10e32e28f09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:09.403604 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcdb8a-d9a1-4b9b-ac68-c10e32e28f09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:09.408278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dcdb8a-d9a1-4b9b-ac68-c10e32e28f09 service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:09.428442 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1182/2327] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:02:14.384487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a316f-f192-4a60-8892-56f656ae7d0c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:14.385544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a316f-f192-4a60-8892-56f656ae7d0c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:14.385544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a316f-f192-4a60-8892-56f656ae7d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:14.409938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-299a316f-f192-4a60-8892-56f656ae7d0c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:14.411674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-299a316f-f192-4a60-8892-56f656ae7d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:14.423967 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1146/2328] 10.222.0.24 () {58 vars in 1016 bytes} [Fri May 27 20:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:02:14.442246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcdb8a-d9a1-4b9b-ac68-c10e32e28f09 service nova] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:14.444227 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b9dcdb8a-d9a1-4b9b-ac68-c10e32e28f09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:14.463614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dcdb8a-d9a1-4b9b-ac68-c10e32e28f09 service nova] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:14.485389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff46b5-802d-470d-b06f-4bdd3ef2d01f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:14.486108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff46b5-802d-470d-b06f-4bdd3ef2d01f service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:14.486441 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff46b5-802d-470d-b06f-4bdd3ef2d01f service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:14.486975 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff46b5-802d-470d-b06f-4bdd3ef2d01f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:14.498835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff46b5-802d-470d-b06f-4bdd3ef2d01f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:14.500625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff46b5-802d-470d-b06f-4bdd3ef2d01f service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:14.514651 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1183/2329] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:02:18.665118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188d4e6-6752-4371-9303-c01536356c15 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:18.666094 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188d4e6-6752-4371-9303-c01536356c15 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:18.666657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188d4e6-6752-4371-9303-c01536356c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:18.685703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-3188d4e6-6752-4371-9303-c01536356c15 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:18.686991 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-3188d4e6-6752-4371-9303-c01536356c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:18.695565 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1147/2330] 10.222.0.24 () {58 vars in 1016 bytes} [Fri May 27 20:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:02:18.719672 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff46b5-802d-470d-b06f-4bdd3ef2d01f service nova] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:18.732252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff46b5-802d-470d-b06f-4bdd3ef2d01f service nova] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:18.738507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93feebb-2deb-4e97-ba5d-43ae0ab8840f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:18.739316 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93feebb-2deb-4e97-ba5d-43ae0ab8840f service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:18.739688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93feebb-2deb-4e97-ba5d-43ae0ab8840f service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:18.740048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93feebb-2deb-4e97-ba5d-43ae0ab8840f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:18.752267 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93feebb-2deb-4e97-ba5d-43ae0ab8840f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:18.754178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93feebb-2deb-4e97-ba5d-43ae0ab8840f service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:18.765918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1184/2331] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:02:24.933466 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2b27f-d635-4dda-a8ff-187d4e527224 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:24.933989 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2b27f-d635-4dda-a8ff-187d4e527224 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:24.934150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2b27f-d635-4dda-a8ff-187d4e527224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:24.981253 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-f7c2b27f-d635-4dda-a8ff-187d4e527224 None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:24.982480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f7c2b27f-d635-4dda-a8ff-187d4e527224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:24.998845 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1148/2332] 10.222.0.15 () {58 vars in 967 bytes} [Fri May 27 20:02:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:02:25.012235 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93feebb-2deb-4e97-ba5d-43ae0ab8840f service nova] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:25.033324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93feebb-2deb-4e97-ba5d-43ae0ab8840f service nova] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:25.038201 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f5edd-4d77-4f5e-bd8f-12e6ca10d7b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:25.038872 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f5edd-4d77-4f5e-bd8f-12e6ca10d7b2 service swift] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:25.039162 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f5edd-4d77-4f5e-bd8f-12e6ca10d7b2 service swift] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:25.039443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f5edd-4d77-4f5e-bd8f-12e6ca10d7b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:25.047394 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f5edd-4d77-4f5e-bd8f-12e6ca10d7b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:25.048976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f5edd-4d77-4f5e-bd8f-12e6ca10d7b2 service swift] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:25.056945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1185/2333] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:02:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 20:02:27.864641 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2b27f-d635-4dda-a8ff-187d4e527224 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:27.866183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f7c2b27f-d635-4dda-a8ff-187d4e527224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:27.881315 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2b27f-d635-4dda-a8ff-187d4e527224 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:27.886079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a66bb-d8b6-4325-bf84-8b78435cc9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:27.886982 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a66bb-d8b6-4325-bf84-8b78435cc9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:27.887271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a66bb-d8b6-4325-bf84-8b78435cc9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:27.887550 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a66bb-d8b6-4325-bf84-8b78435cc9e1 admin admin] PATH_INFO: `/v3/users/ac766f08f7fb4cdbbb90b5e7c8e52226` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:27.889397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a66bb-d8b6-4325-bf84-8b78435cc9e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac766f08f7fb4cdbbb90b5e7c8e52226)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:27.891360 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a66bb-d8b6-4325-bf84-8b78435cc9e1 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:27.904102 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:28.083951 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-281a66bb-d8b6-4325-bf84-8b78435cc9e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac766f08f7fb4cdbbb90b5e7c8e52226'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:28.084604 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-281a66bb-d8b6-4325-bf84-8b78435cc9e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac766f08f7fb4cdbbb90b5e7c8e52226'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:28.167318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-281a66bb-d8b6-4325-bf84-8b78435cc9e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac766f08f7fb4cdbbb90b5e7c8e52226'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:28.179992 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-281a66bb-d8b6-4325-bf84-8b78435cc9e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac766f08f7fb4cdbbb90b5e7c8e52226'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:28.187557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-281a66bb-d8b6-4325-bf84-8b78435cc9e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac766f08f7fb4cdbbb90b5e7c8e52226'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:28.193545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1149/2334] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:02:27 2022] DELETE /identity/v3/users/ac766f08f7fb4cdbbb90b5e7c8e52226 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:02:28.595647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f5edd-4d77-4f5e-bd8f-12e6ca10d7b2 service swift] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:28.609635 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f5edd-4d77-4f5e-bd8f-12e6ca10d7b2 service swift] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:28.669546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55817c8-bcb3-4a5b-8812-61a3e741e9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:28.671005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55817c8-bcb3-4a5b-8812-61a3e741e9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:28.671298 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55817c8-bcb3-4a5b-8812-61a3e741e9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:28.671582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55817c8-bcb3-4a5b-8812-61a3e741e9d6 admin admin] PATH_INFO: `/v3/projects/fcce3d108bda41ba8b517df89364efe9` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:28.672840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55817c8-bcb3-4a5b-8812-61a3e741e9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcce3d108bda41ba8b517df89364efe9)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:28.674818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55817c8-bcb3-4a5b-8812-61a3e741e9d6 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:28.699789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:28.796709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b55817c8-bcb3-4a5b-8812-61a3e741e9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcce3d108bda41ba8b517df89364efe9', 'request_id': 'req-b55817c8-bcb3-4a5b-8812-61a3e741e9d6'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:28.802831 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b55817c8-bcb3-4a5b-8812-61a3e741e9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcce3d108bda41ba8b517df89364efe9', 'request_id': 'req-b55817c8-bcb3-4a5b-8812-61a3e741e9d6'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:28.808449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b55817c8-bcb3-4a5b-8812-61a3e741e9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcce3d108bda41ba8b517df89364efe9', 'request_id': 'req-b55817c8-bcb3-4a5b-8812-61a3e741e9d6'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:28.900605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b55817c8-bcb3-4a5b-8812-61a3e741e9d6 admin admin] The token cache is being invalidate because project fcce3d108bda41ba8b517df89364efe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:02:28.900905 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b55817c8-bcb3-4a5b-8812-61a3e741e9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:28.901553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b55817c8-bcb3-4a5b-8812-61a3e741e9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:28.903151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1186/2335] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:02:28 2022] DELETE /identity/v3/projects/fcce3d108bda41ba8b517df89364efe9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:02:28.908531 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb69567-bb82-44d2-953b-daf38c80a37c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:28.908968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb69567-bb82-44d2-953b-daf38c80a37c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:28.909093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb69567-bb82-44d2-953b-daf38c80a37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:28.927791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-bcb69567-bb82-44d2-953b-daf38c80a37c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:28.929017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-bcb69567-bb82-44d2-953b-daf38c80a37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:28.989555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1150/2336] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:02:28.996902 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218bcc3-13a7-4343-b073-2ec1d43b2332 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:28.997201 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218bcc3-13a7-4343-b073-2ec1d43b2332 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:28.997490 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218bcc3-13a7-4343-b073-2ec1d43b2332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:29.016208 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-3218bcc3-13a7-4343-b073-2ec1d43b2332 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:29.017410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-3218bcc3-13a7-4343-b073-2ec1d43b2332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:29.025272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1187/2337] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:02:29.029944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb69567-bb82-44d2-953b-daf38c80a37c None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:29.039532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb69567-bb82-44d2-953b-daf38c80a37c None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:29.044117 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55f26d-e074-4890-aef9-0a80959fa5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:29.044806 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55f26d-e074-4890-aef9-0a80959fa5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:29.045100 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55f26d-e074-4890-aef9-0a80959fa5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:29.045385 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55f26d-e074-4890-aef9-0a80959fa5f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:29.046115 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55f26d-e074-4890-aef9-0a80959fa5f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:02:29.046461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55f26d-e074-4890-aef9-0a80959fa5f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:29.048058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55f26d-e074-4890-aef9-0a80959fa5f2 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:29.059443 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1151/2338] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:02:29.063711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218bcc3-13a7-4343-b073-2ec1d43b2332 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:29.072694 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218bcc3-13a7-4343-b073-2ec1d43b2332 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:29.077865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ce02e-d557-4462-b5a4-37b29a7a8b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:29.078544 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ce02e-d557-4462-b5a4-37b29a7a8b5c admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:29.078836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ce02e-d557-4462-b5a4-37b29a7a8b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:29.079120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ce02e-d557-4462-b5a4-37b29a7a8b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:29.079823 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ce02e-d557-4462-b5a4-37b29a7a8b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:29.081726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ce02e-d557-4462-b5a4-37b29a7a8b5c admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:29.174528 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1188/2339] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:02:29 2022] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:02:29.178470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55f26d-e074-4890-aef9-0a80959fa5f2 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:29.188427 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55f26d-e074-4890-aef9-0a80959fa5f2 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:29.244476 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb16abc-8667-425e-94bf-f8caa1fa8835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:29.245081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb16abc-8667-425e-94bf-f8caa1fa8835 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:29.245375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb16abc-8667-425e-94bf-f8caa1fa8835 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:29.245657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb16abc-8667-425e-94bf-f8caa1fa8835 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:29.246381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb16abc-8667-425e-94bf-f8caa1fa8835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:29.248340 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb16abc-8667-425e-94bf-f8caa1fa8835 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:29.332067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1152/2340] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:02:29 2022] POST /identity/v3/users => generated 284 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:02:29.336104 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ce02e-d557-4462-b5a4-37b29a7a8b5c admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:29.346443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ce02e-d557-4462-b5a4-37b29a7a8b5c admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:29.351221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded2cbd-2c96-42ea-a920-8b86b2609448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:29.351882 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded2cbd-2c96-42ea-a920-8b86b2609448 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:29.352191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded2cbd-2c96-42ea-a920-8b86b2609448 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:29.352464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded2cbd-2c96-42ea-a920-8b86b2609448 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:29.353196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded2cbd-2c96-42ea-a920-8b86b2609448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:29.354853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded2cbd-2c96-42ea-a920-8b86b2609448 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:29.366181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1189/2341] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:02:29.369983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb16abc-8667-425e-94bf-f8caa1fa8835 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:29.380526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb16abc-8667-425e-94bf-f8caa1fa8835 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:29.385458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc3c13-3e76-489f-b033-a5d372e09c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:29.386122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc3c13-3e76-489f-b033-a5d372e09c09 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:29.386453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc3c13-3e76-489f-b033-a5d372e09c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:29.386742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc3c13-3e76-489f-b033-a5d372e09c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:29.387473 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc3c13-3e76-489f-b033-a5d372e09c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:29.389785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc3c13-3e76-489f-b033-a5d372e09c09 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:29.391178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:29.400975 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1153/2342] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:02:29.406185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded2cbd-2c96-42ea-a920-8b86b2609448 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:29.416616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded2cbd-2c96-42ea-a920-8b86b2609448 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:29.421270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8470f1c-a0a7-4e23-b24d-4ff89d4fe926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:29.422149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8470f1c-a0a7-4e23-b24d-4ff89d4fe926 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:29.422469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8470f1c-a0a7-4e23-b24d-4ff89d4fe926 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:29.422755 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8470f1c-a0a7-4e23-b24d-4ff89d4fe926 admin admin] PATH_INFO: `/v3/projects/c3def26e489e40bfb42c3aed7706bfaf/users/7db46a9c4a99421295cd79d87446bf7b/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:29.437514 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8470f1c-a0a7-4e23-b24d-4ff89d4fe926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3def26e489e40bfb42c3aed7706bfaf, user_id=7db46a9c4a99421295cd79d87446bf7b, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:29.440545 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8470f1c-a0a7-4e23-b24d-4ff89d4fe926 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:29.526798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1190/2343] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:02:29 2022] PUT /identity/v3/projects/c3def26e489e40bfb42c3aed7706bfaf/users/7db46a9c4a99421295cd79d87446bf7b/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:02:29.536574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0b386-9d9f-439c-bc31-bb3f74316d51 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:29.536864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0b386-9d9f-439c-bc31-bb3f74316d51 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:29.537141 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0b386-9d9f-439c-bc31-bb3f74316d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:29.564662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-19a0b386-9d9f-439c-bc31-bb3f74316d51 None None] MFA Rules not processed for user `7db46a9c4a99421295cd79d87446bf7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:29.565865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-19a0b386-9d9f-439c-bc31-bb3f74316d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:29.634218 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1154/2344] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:02:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:02:29.646635 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8470f1c-a0a7-4e23-b24d-4ff89d4fe926 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:29.648298 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e8470f1c-a0a7-4e23-b24d-4ff89d4fe926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:29.726787 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8470f1c-a0a7-4e23-b24d-4ff89d4fe926 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:29.730623 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0023fc0-6347-40c8-beb0-55fdda90342a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2b57ae83164912a4e23dda9dc239f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:29.731278 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0023fc0-6347-40c8-beb0-55fdda90342a service glance] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:29.731566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0023fc0-6347-40c8-beb0-55fdda90342a service glance] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:29.731847 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0023fc0-6347-40c8-beb0-55fdda90342a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:29.740785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0023fc0-6347-40c8-beb0-55fdda90342a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:29.742222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0023fc0-6347-40c8-beb0-55fdda90342a service glance] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:29.751563 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1191/2345] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:02:29 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:02:37.103473 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d275629-e982-4039-b0f9-cba8f59c0b57 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:37.104007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d275629-e982-4039-b0f9-cba8f59c0b57 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:37.104134 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d275629-e982-4039-b0f9-cba8f59c0b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:37.121906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-8d275629-e982-4039-b0f9-cba8f59c0b57 None None] MFA Rules not processed for user `8521bf0e9bf3451a936586c387a79344`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:37.123167 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-8d275629-e982-4039-b0f9-cba8f59c0b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:37.182055 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1155/2346] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:02:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:02:39.747084 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=77,keystone:DELETE=6,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:46.592963 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0023fc0-6347-40c8-beb0-55fdda90342a service glance] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:46.594528 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f0023fc0-6347-40c8-beb0-55fdda90342a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:46.686655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0023fc0-6347-40c8-beb0-55fdda90342a service glance] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:46.691593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18582a5-f2c9-4580-8ff1-62690246755c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394b43cef91f4990b4707cb7a6798068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:46.692198 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18582a5-f2c9-4580-8ff1-62690246755c service placement] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:46.692488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18582a5-f2c9-4580-8ff1-62690246755c service placement] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:46.692767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18582a5-f2c9-4580-8ff1-62690246755c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:46.694606 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f18582a5-f2c9-4580-8ff1-62690246755c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:46.705872 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18582a5-f2c9-4580-8ff1-62690246755c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:46.707514 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18582a5-f2c9-4580-8ff1-62690246755c service placement] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:46.717653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1192/2347] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:02:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:02:47.175231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=59 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:56.208383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5bbc6-1709-47a9-b73a-1f8f7913e194 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:56.209691 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5bbc6-1709-47a9-b73a-1f8f7913e194 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:56.210134 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5bbc6-1709-47a9-b73a-1f8f7913e194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:56.235973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-aff5bbc6-1709-47a9-b73a-1f8f7913e194 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:56.237934 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-aff5bbc6-1709-47a9-b73a-1f8f7913e194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:56.322494 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18582a5-f2c9-4580-8ff1-62690246755c service placement] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:56.330687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1156/2348] 10.222.0.24 () {58 vars in 1016 bytes} [Fri May 27 20:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:02:56.335771 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18582a5-f2c9-4580-8ff1-62690246755c service placement] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:56.345870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5bbc6-1709-47a9-b73a-1f8f7913e194 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:56.348588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258c882-1d31-4e90-b1a3-8199e287524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:56.350256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-aff5bbc6-1709-47a9-b73a-1f8f7913e194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:56.351046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258c882-1d31-4e90-b1a3-8199e287524e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:56.351811 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258c882-1d31-4e90-b1a3-8199e287524e admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:56.353043 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258c882-1d31-4e90-b1a3-8199e287524e admin admin] PATH_INFO: `/v3/users/7db46a9c4a99421295cd79d87446bf7b` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:56.358077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258c882-1d31-4e90-b1a3-8199e287524e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7db46a9c4a99421295cd79d87446bf7b)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:56.358077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258c882-1d31-4e90-b1a3-8199e287524e admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:56.453456 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5bbc6-1709-47a9-b73a-1f8f7913e194 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:56.460072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073634c6-578c-4e8c-b574-1e293c35e6df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:56.460739 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073634c6-578c-4e8c-b574-1e293c35e6df service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:56.461029 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073634c6-578c-4e8c-b574-1e293c35e6df service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:56.461312 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073634c6-578c-4e8c-b574-1e293c35e6df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:56.470211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073634c6-578c-4e8c-b574-1e293c35e6df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:56.471905 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073634c6-578c-4e8c-b574-1e293c35e6df service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:56.495796 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1157/2349] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:02:56.598438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2258c882-1d31-4e90-b1a3-8199e287524e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7db46a9c4a99421295cd79d87446bf7b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:56.714202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2258c882-1d31-4e90-b1a3-8199e287524e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7db46a9c4a99421295cd79d87446bf7b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:56.714889 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2258c882-1d31-4e90-b1a3-8199e287524e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7db46a9c4a99421295cd79d87446bf7b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:56.724808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2258c882-1d31-4e90-b1a3-8199e287524e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7db46a9c4a99421295cd79d87446bf7b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:56.742580 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2258c882-1d31-4e90-b1a3-8199e287524e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7db46a9c4a99421295cd79d87446bf7b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:56.754839 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1193/2350] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:02:56 2022] DELETE /identity/v3/users/7db46a9c4a99421295cd79d87446bf7b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:02:56.759547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c2b58-f083-421e-95e4-f3da9146e793 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:56.760036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c2b58-f083-421e-95e4-f3da9146e793 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:56.760493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c2b58-f083-421e-95e4-f3da9146e793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:56.778880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-c67c2b58-f083-421e-95e4-f3da9146e793 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:56.780094 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c67c2b58-f083-421e-95e4-f3da9146e793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:56.849035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1158/2351] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:02:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:02:56.859828 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258c882-1d31-4e90-b1a3-8199e287524e admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:56.861989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2258c882-1d31-4e90-b1a3-8199e287524e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:56.920371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:56.934504 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258c882-1d31-4e90-b1a3-8199e287524e admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:56.938905 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543d169-086e-4f1e-b6b5-182b3f20440d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:56.939734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543d169-086e-4f1e-b6b5-182b3f20440d service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:56.940020 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543d169-086e-4f1e-b6b5-182b3f20440d service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:56.940441 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543d169-086e-4f1e-b6b5-182b3f20440d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:56.951245 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543d169-086e-4f1e-b6b5-182b3f20440d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:56.953812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543d169-086e-4f1e-b6b5-182b3f20440d service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:56.965099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1194/2352] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:02:57.458722 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c2b58-f083-421e-95e4-f3da9146e793 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:57.460188 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c67c2b58-f083-421e-95e4-f3da9146e793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:57.473165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c2b58-f083-421e-95e4-f3da9146e793 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:57.478551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90fc6e-9787-4dcb-afb5-28adc3c2cda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:57.479626 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90fc6e-9787-4dcb-afb5-28adc3c2cda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:57.479912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90fc6e-9787-4dcb-afb5-28adc3c2cda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:57.480233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90fc6e-9787-4dcb-afb5-28adc3c2cda9 admin admin] PATH_INFO: `/v3/projects/c3def26e489e40bfb42c3aed7706bfaf` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:57.481466 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90fc6e-9787-4dcb-afb5-28adc3c2cda9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3def26e489e40bfb42c3aed7706bfaf)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:57.483608 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90fc6e-9787-4dcb-afb5-28adc3c2cda9 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:57.507332 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:57.622822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ab90fc6e-9787-4dcb-afb5-28adc3c2cda9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3def26e489e40bfb42c3aed7706bfaf', 'request_id': 'req-ab90fc6e-9787-4dcb-afb5-28adc3c2cda9'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:57.717901 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ab90fc6e-9787-4dcb-afb5-28adc3c2cda9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3def26e489e40bfb42c3aed7706bfaf', 'request_id': 'req-ab90fc6e-9787-4dcb-afb5-28adc3c2cda9'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:57.724874 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ab90fc6e-9787-4dcb-afb5-28adc3c2cda9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3def26e489e40bfb42c3aed7706bfaf', 'request_id': 'req-ab90fc6e-9787-4dcb-afb5-28adc3c2cda9'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:57.736037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ab90fc6e-9787-4dcb-afb5-28adc3c2cda9 admin admin] The token cache is being invalidate because project c3def26e489e40bfb42c3aed7706bfaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:02:57.736270 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ab90fc6e-9787-4dcb-afb5-28adc3c2cda9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:57.736907 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ab90fc6e-9787-4dcb-afb5-28adc3c2cda9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:02:57.738509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1159/2353] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:02:57 2022] DELETE /identity/v3/projects/c3def26e489e40bfb42c3aed7706bfaf => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:02:57.743726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d55015-3138-4a0c-b2a9-3c88d78bde31 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:57.744231 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d55015-3138-4a0c-b2a9-3c88d78bde31 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:57.744327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d55015-3138-4a0c-b2a9-3c88d78bde31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:57.763272 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-89d55015-3138-4a0c-b2a9-3c88d78bde31 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:57.764484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-89d55015-3138-4a0c-b2a9-3c88d78bde31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:57.825533 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1195/2354] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:02:57.834159 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335345e-8448-424e-933d-38e037e50ab7 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:57.834519 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335345e-8448-424e-933d-38e037e50ab7 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:57.834812 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1335345e-8448-424e-933d-38e037e50ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:57.853773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-1335345e-8448-424e-933d-38e037e50ab7 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:57.855024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-1335345e-8448-424e-933d-38e037e50ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:57.863034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1160/2355] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:02:57.867142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d55015-3138-4a0c-b2a9-3c88d78bde31 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:57.876732 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d55015-3138-4a0c-b2a9-3c88d78bde31 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:57.881285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f79e85-6f9e-48f3-94fe-231ee8ab56ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:57.881934 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f79e85-6f9e-48f3-94fe-231ee8ab56ec admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:57.882247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f79e85-6f9e-48f3-94fe-231ee8ab56ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:57.882566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f79e85-6f9e-48f3-94fe-231ee8ab56ec admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:57.883295 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f79e85-6f9e-48f3-94fe-231ee8ab56ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:02:57.884119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f79e85-6f9e-48f3-94fe-231ee8ab56ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:57.885730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f79e85-6f9e-48f3-94fe-231ee8ab56ec admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:57.897225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1196/2356] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:02:57.901968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335345e-8448-424e-933d-38e037e50ab7 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:57.911419 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1335345e-8448-424e-933d-38e037e50ab7 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:57.916280 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7caee-c02f-46e8-b7b5-c763182823b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:57.916946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7caee-c02f-46e8-b7b5-c763182823b3 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:57.917234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7caee-c02f-46e8-b7b5-c763182823b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:57.917519 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7caee-c02f-46e8-b7b5-c763182823b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:57.918227 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7caee-c02f-46e8-b7b5-c763182823b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:57.920285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7caee-c02f-46e8-b7b5-c763182823b3 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:58.066081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1161/2357] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:02:57 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:02:58.067132 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f79e85-6f9e-48f3-94fe-231ee8ab56ec admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:58.080041 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f79e85-6f9e-48f3-94fe-231ee8ab56ec admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:58.139590 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c802f4b-b49c-479e-91d4-9de4e002d6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:58.140266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c802f4b-b49c-479e-91d4-9de4e002d6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:58.140683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c802f4b-b49c-479e-91d4-9de4e002d6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:58.140973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c802f4b-b49c-479e-91d4-9de4e002d6a3 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:58.141670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c802f4b-b49c-479e-91d4-9de4e002d6a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:58.143633 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c802f4b-b49c-479e-91d4-9de4e002d6a3 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:58.228649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1197/2358] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:02:58 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:02:58.232666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7caee-c02f-46e8-b7b5-c763182823b3 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:58.243554 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7caee-c02f-46e8-b7b5-c763182823b3 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:58.249453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7a806-7130-4375-be49-c977c7bfb339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:58.249453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a806-7130-4375-be49-c977c7bfb339 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:58.249453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a806-7130-4375-be49-c977c7bfb339 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:58.249453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a806-7130-4375-be49-c977c7bfb339 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:58.250175 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7a806-7130-4375-be49-c977c7bfb339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:58.251855 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7a806-7130-4375-be49-c977c7bfb339 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:58.263263 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1162/2359] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:02:58.267156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c802f4b-b49c-479e-91d4-9de4e002d6a3 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:58.277071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c802f4b-b49c-479e-91d4-9de4e002d6a3 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:58.281674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6880a9d-1826-41d9-8d1a-f47a472cd9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:58.282393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6880a9d-1826-41d9-8d1a-f47a472cd9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:58.282689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6880a9d-1826-41d9-8d1a-f47a472cd9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:58.282976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6880a9d-1826-41d9-8d1a-f47a472cd9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:58.283712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6880a9d-1826-41d9-8d1a-f47a472cd9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:58.285318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6880a9d-1826-41d9-8d1a-f47a472cd9e3 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:58.295079 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1198/2360] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:02:58.299086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7a806-7130-4375-be49-c977c7bfb339 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:58.309731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7a806-7130-4375-be49-c977c7bfb339 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:58.314391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfb116-99b0-4f0c-a244-2f944b287f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:58.315301 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfb116-99b0-4f0c-a244-2f944b287f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:58.315593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfb116-99b0-4f0c-a244-2f944b287f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:58.315876 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfb116-99b0-4f0c-a244-2f944b287f76 admin admin] PATH_INFO: `/v3/projects/e2d887c5c6634401839bf885bfe8750c/users/3e60f044e3f04370b8a4b8c00d6a2278/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:58.331600 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfb116-99b0-4f0c-a244-2f944b287f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d887c5c6634401839bf885bfe8750c, user_id=3e60f044e3f04370b8a4b8c00d6a2278, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:58.334264 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfb116-99b0-4f0c-a244-2f944b287f76 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:58.428941 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1163/2361] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:02:58 2022] PUT /identity/v3/projects/e2d887c5c6634401839bf885bfe8750c/users/3e60f044e3f04370b8a4b8c00d6a2278/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:02:58.439601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882da6a2-d81c-4522-86e8-77bf4bc3067a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:58.439925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882da6a2-d81c-4522-86e8-77bf4bc3067a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:58.440304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882da6a2-d81c-4522-86e8-77bf4bc3067a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:58.466196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-882da6a2-d81c-4522-86e8-77bf4bc3067a None None] MFA Rules not processed for user `3e60f044e3f04370b8a4b8c00d6a2278`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:02:58.467439 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-882da6a2-d81c-4522-86e8-77bf4bc3067a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:58.509836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:02:58.533588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1199/2362] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:02:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:02:58.544783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfb116-99b0-4f0c-a244-2f944b287f76 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:02:58.547231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f8cfb116-99b0-4f0c-a244-2f944b287f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:02:58.624786 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfb116-99b0-4f0c-a244-2f944b287f76 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:02:58.628431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150ec80-63dc-4507-ac87-8c8b23af63fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:02:58.629076 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150ec80-63dc-4507-ac87-8c8b23af63fb service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:02:58.629365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150ec80-63dc-4507-ac87-8c8b23af63fb service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:02:58.629646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150ec80-63dc-4507-ac87-8c8b23af63fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:02:58.639035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150ec80-63dc-4507-ac87-8c8b23af63fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:02:58.640617 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150ec80-63dc-4507-ac87-8c8b23af63fb service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:02:58.650724 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1164/2363] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:02:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:03:00.487490 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bed5e6-566f-4503-af39-40db3c49be47 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:00.487976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bed5e6-566f-4503-af39-40db3c49be47 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:00.488071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bed5e6-566f-4503-af39-40db3c49be47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:00.507951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c8bed5e6-566f-4503-af39-40db3c49be47 None None] MFA Rules not processed for user `3e60f044e3f04370b8a4b8c00d6a2278`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:00.509858 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c8bed5e6-566f-4503-af39-40db3c49be47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:00.518723 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1200/2364] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:03:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:01.042403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5a15d-6092-4f14-a047-5c89f49db37c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:01.042928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5a15d-6092-4f14-a047-5c89f49db37c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:01.043070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5a15d-6092-4f14-a047-5c89f49db37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:01.063047 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-f1e5a15d-6092-4f14-a047-5c89f49db37c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:01.064293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f1e5a15d-6092-4f14-a047-5c89f49db37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:01.104818 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:01.173947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1165/2365] 10.222.0.24 () {58 vars in 1016 bytes} [Fri May 27 20:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:01.384370 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bed5e6-566f-4503-af39-40db3c49be47 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:01.385869 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c8bed5e6-566f-4503-af39-40db3c49be47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:01.466238 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bed5e6-566f-4503-af39-40db3c49be47 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:01.478182 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd02ed-28d5-4b26-84dc-af243e7eb7b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:01.478837 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd02ed-28d5-4b26-84dc-af243e7eb7b1 service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:01.479127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd02ed-28d5-4b26-84dc-af243e7eb7b1 service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:01.482866 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd02ed-28d5-4b26-84dc-af243e7eb7b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:01.492170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd02ed-28d5-4b26-84dc-af243e7eb7b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:01.494497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd02ed-28d5-4b26-84dc-af243e7eb7b1 service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:01.504393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1201/2366] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:03:05.005500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2f09f-b662-40f1-b549-3f29d98aa933 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:05.006055 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2f09f-b662-40f1-b549-3f29d98aa933 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:05.007206 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2f09f-b662-40f1-b549-3f29d98aa933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:05.028831 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-2bc2f09f-b662-40f1-b549-3f29d98aa933 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:05.030171 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2bc2f09f-b662-40f1-b549-3f29d98aa933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:05.038915 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1166/2367] 10.222.0.24 () {58 vars in 1016 bytes} [Fri May 27 20:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:05.054011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd02ed-28d5-4b26-84dc-af243e7eb7b1 service nova] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:05.065228 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd02ed-28d5-4b26-84dc-af243e7eb7b1 service nova] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:05.071204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9453386-8fa1-458c-8b59-61f4e719015d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:05.072203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9453386-8fa1-458c-8b59-61f4e719015d service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:05.072714 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9453386-8fa1-458c-8b59-61f4e719015d service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:05.073198 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9453386-8fa1-458c-8b59-61f4e719015d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:05.084117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9453386-8fa1-458c-8b59-61f4e719015d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:05.086031 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9453386-8fa1-458c-8b59-61f4e719015d service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:05.100585 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1202/2368] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:03:08.284484 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bb061-a982-4604-9249-a07dc96a03fb None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:08.284977 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bb061-a982-4604-9249-a07dc96a03fb None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:08.285105 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bb061-a982-4604-9249-a07dc96a03fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:08.303310 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-d39bb061-a982-4604-9249-a07dc96a03fb None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:08.304526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d39bb061-a982-4604-9249-a07dc96a03fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:08.313373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1167/2369] 10.222.0.24 () {58 vars in 1016 bytes} [Fri May 27 20:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:08.333559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9453386-8fa1-458c-8b59-61f4e719015d service nova] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:08.345553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9453386-8fa1-458c-8b59-61f4e719015d service nova] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:08.351621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca44f82-fce5-464a-ba16-88a332f7ec32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:08.352292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca44f82-fce5-464a-ba16-88a332f7ec32 service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:08.352588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca44f82-fce5-464a-ba16-88a332f7ec32 service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:08.352878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca44f82-fce5-464a-ba16-88a332f7ec32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:08.361723 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca44f82-fce5-464a-ba16-88a332f7ec32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:08.363356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca44f82-fce5-464a-ba16-88a332f7ec32 service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:08.373666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1203/2370] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:03:11.843489 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e9fb0-05d2-4187-8a91-7d1135c012c1 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:11.844020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e9fb0-05d2-4187-8a91-7d1135c012c1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:11.844127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e9fb0-05d2-4187-8a91-7d1135c012c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:11.866827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-df9e9fb0-05d2-4187-8a91-7d1135c012c1 None None] MFA Rules not processed for user `e3667bac6fe34a0bb29cdf7c9fc556f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:11.866827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-df9e9fb0-05d2-4187-8a91-7d1135c012c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:11.922826 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1168/2371] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:03:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:12.528563 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519355ed-5678-4d96-8949-3e8489b2041a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:12.529072 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519355ed-5678-4d96-8949-3e8489b2041a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:12.529268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519355ed-5678-4d96-8949-3e8489b2041a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:12.547662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-519355ed-5678-4d96-8949-3e8489b2041a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:12.549006 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-519355ed-5678-4d96-8949-3e8489b2041a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:12.557584 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1204/2372] 10.222.0.24 () {58 vars in 1016 bytes} [Fri May 27 20:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:12.572330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e9fb0-05d2-4187-8a91-7d1135c012c1 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:12.573948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-df9e9fb0-05d2-4187-8a91-7d1135c012c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:12.591622 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e9fb0-05d2-4187-8a91-7d1135c012c1 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:12.597341 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69153e1d-8247-4926-89ec-fc0dc07d88bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:12.597997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69153e1d-8247-4926-89ec-fc0dc07d88bd service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:12.598495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69153e1d-8247-4926-89ec-fc0dc07d88bd service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:12.598949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69153e1d-8247-4926-89ec-fc0dc07d88bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:12.614518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69153e1d-8247-4926-89ec-fc0dc07d88bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:12.614518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69153e1d-8247-4926-89ec-fc0dc07d88bd service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:12.621838 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1169/2373] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:03:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:03:22.541792 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=61 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:22.617216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=51 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:25.805887 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29a2be-c7d0-4f04-b45e-98d688aa798f None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:25.806431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29a2be-c7d0-4f04-b45e-98d688aa798f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:25.806539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29a2be-c7d0-4f04-b45e-98d688aa798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:25.826315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-dd29a2be-c7d0-4f04-b45e-98d688aa798f None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:25.827599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-dd29a2be-c7d0-4f04-b45e-98d688aa798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:25.883220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1205/2374] 10.222.0.15 () {58 vars in 1009 bytes} [Fri May 27 20:03:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:26.030145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69153e1d-8247-4926-89ec-fc0dc07d88bd service nova] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:26.031695 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-69153e1d-8247-4926-89ec-fc0dc07d88bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:26.113881 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69153e1d-8247-4926-89ec-fc0dc07d88bd service nova] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:26.119039 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683eb9de-21a0-47ea-9d30-0ba790cb57d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:26.119688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eb9de-21a0-47ea-9d30-0ba790cb57d3 service swift] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:26.119979 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eb9de-21a0-47ea-9d30-0ba790cb57d3 service swift] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:26.120264 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683eb9de-21a0-47ea-9d30-0ba790cb57d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:26.128801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683eb9de-21a0-47ea-9d30-0ba790cb57d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:26.130480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683eb9de-21a0-47ea-9d30-0ba790cb57d3 service swift] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:26.139090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1170/2375] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:03:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 20:03:26.770075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85d9c8-15c8-4d18-a940-7e22e135e2ce None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:26.770487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85d9c8-15c8-4d18-a940-7e22e135e2ce None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:26.770847 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85d9c8-15c8-4d18-a940-7e22e135e2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:26.788759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-1e85d9c8-15c8-4d18-a940-7e22e135e2ce None None] MFA Rules not processed for user `9cbadf27b0054737bc798f8500dd661f`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:26.790318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-1e85d9c8-15c8-4d18-a940-7e22e135e2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:26.848431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1206/2376] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:03:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:27.061044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28eff2f-1564-4603-a922-1e36fb59676d None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:27.061566 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28eff2f-1564-4603-a922-1e36fb59676d None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:27.061729 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28eff2f-1564-4603-a922-1e36fb59676d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:27.080194 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-a28eff2f-1564-4603-a922-1e36fb59676d None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:27.081406 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-a28eff2f-1564-4603-a922-1e36fb59676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:27.091695 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1171/2377] 10.222.0.15 () {58 vars in 967 bytes} [Fri May 27 20:03:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:27.105597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85d9c8-15c8-4d18-a940-7e22e135e2ce None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:27.117874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85d9c8-15c8-4d18-a940-7e22e135e2ce None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:27.123005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50031c2e-63db-4286-b009-72fcbc6f0939 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:27.123653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50031c2e-63db-4286-b009-72fcbc6f0939 service swift] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:27.123942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50031c2e-63db-4286-b009-72fcbc6f0939 service swift] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:27.124221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50031c2e-63db-4286-b009-72fcbc6f0939 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:27.132300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50031c2e-63db-4286-b009-72fcbc6f0939 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:27.135192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50031c2e-63db-4286-b009-72fcbc6f0939 service swift] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:27.143148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1207/2378] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:03:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 20:03:27.836233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c02b1-3399-490f-99b6-54a28dcd63b8 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:27.836521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c02b1-3399-490f-99b6-54a28dcd63b8 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:27.836794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c02b1-3399-490f-99b6-54a28dcd63b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:27.855085 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-859c02b1-3399-490f-99b6-54a28dcd63b8 None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:27.856803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-859c02b1-3399-490f-99b6-54a28dcd63b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:27.864456 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1172/2379] 10.222.0.15 () {58 vars in 1009 bytes} [Fri May 27 20:03:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:27.878742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50031c2e-63db-4286-b009-72fcbc6f0939 service swift] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:27.890639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50031c2e-63db-4286-b009-72fcbc6f0939 service swift] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:27.896901 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b322b99-7e7d-4e73-91c3-f91d642fb36c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:27.897552 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b322b99-7e7d-4e73-91c3-f91d642fb36c service swift] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:27.898036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b322b99-7e7d-4e73-91c3-f91d642fb36c service swift] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:27.898739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b322b99-7e7d-4e73-91c3-f91d642fb36c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:27.908930 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b322b99-7e7d-4e73-91c3-f91d642fb36c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:27.910849 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b322b99-7e7d-4e73-91c3-f91d642fb36c service swift] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:27.920215 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1208/2380] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:03:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 20:03:28.564880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbafa6-2876-45a3-929d-b60aa92c587e None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:28.565355 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbafa6-2876-45a3-929d-b60aa92c587e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:28.565473 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbafa6-2876-45a3-929d-b60aa92c587e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:28.583941 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-bbbbafa6-2876-45a3-929d-b60aa92c587e None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:28.585196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-bbbbafa6-2876-45a3-929d-b60aa92c587e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:28.592774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1173/2381] 10.222.0.15 () {58 vars in 967 bytes} [Fri May 27 20:03:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:28.608472 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b322b99-7e7d-4e73-91c3-f91d642fb36c service swift] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:28.622571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b322b99-7e7d-4e73-91c3-f91d642fb36c service swift] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:28.634853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e1072-2843-46cd-b791-1104fa43cafb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:28.635749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e1072-2843-46cd-b791-1104fa43cafb service swift] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:28.636219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e1072-2843-46cd-b791-1104fa43cafb service swift] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:28.636499 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e1072-2843-46cd-b791-1104fa43cafb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:28.645924 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e1072-2843-46cd-b791-1104fa43cafb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:28.647556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e1072-2843-46cd-b791-1104fa43cafb service swift] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:28.659938 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1209/2382] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:03:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 20:03:31.398262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbafa6-2876-45a3-929d-b60aa92c587e None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:31.410615 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbafa6-2876-45a3-929d-b60aa92c587e None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:31.415389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fdb6a-ab58-44a1-b9eb-c111da573cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:31.416284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fdb6a-ab58-44a1-b9eb-c111da573cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:31.416573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fdb6a-ab58-44a1-b9eb-c111da573cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:31.416858 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fdb6a-ab58-44a1-b9eb-c111da573cd2 admin admin] PATH_INFO: `/v3/users/3e60f044e3f04370b8a4b8c00d6a2278` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:31.418067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fdb6a-ab58-44a1-b9eb-c111da573cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e60f044e3f04370b8a4b8c00d6a2278)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:31.420153 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fdb6a-ab58-44a1-b9eb-c111da573cd2 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:31.652197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-667fdb6a-ab58-44a1-b9eb-c111da573cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e60f044e3f04370b8a4b8c00d6a2278'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:31.653767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-667fdb6a-ab58-44a1-b9eb-c111da573cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e60f044e3f04370b8a4b8c00d6a2278'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:31.743722 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-667fdb6a-ab58-44a1-b9eb-c111da573cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e60f044e3f04370b8a4b8c00d6a2278'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:31.758885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-667fdb6a-ab58-44a1-b9eb-c111da573cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e60f044e3f04370b8a4b8c00d6a2278'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:31.768479 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-667fdb6a-ab58-44a1-b9eb-c111da573cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e60f044e3f04370b8a4b8c00d6a2278'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:31.776362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1174/2383] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:03:31 2022] DELETE /identity/v3/users/3e60f044e3f04370b8a4b8c00d6a2278 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:03:31.782983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76879561-b802-4f09-ba05-d144be614eb0 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:31.783874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76879561-b802-4f09-ba05-d144be614eb0 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:31.784535 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76879561-b802-4f09-ba05-d144be614eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:31.808588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-76879561-b802-4f09-ba05-d144be614eb0 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:31.810376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-76879561-b802-4f09-ba05-d144be614eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:31.870485 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1210/2384] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:31.881588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fdb6a-ab58-44a1-b9eb-c111da573cd2 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:31.883297 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-667fdb6a-ab58-44a1-b9eb-c111da573cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:31.923811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:31.947331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fdb6a-ab58-44a1-b9eb-c111da573cd2 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:31.951092 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8d54a-3396-494a-a6e0-d80fb92be90c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:31.951777 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8d54a-3396-494a-a6e0-d80fb92be90c service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:31.952063 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8d54a-3396-494a-a6e0-d80fb92be90c service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:31.952345 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8d54a-3396-494a-a6e0-d80fb92be90c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:31.961472 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8d54a-3396-494a-a6e0-d80fb92be90c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:31.962966 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8d54a-3396-494a-a6e0-d80fb92be90c service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:31.973890 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1175/2385] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:03:32.216949 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76879561-b802-4f09-ba05-d144be614eb0 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:32.218539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-76879561-b802-4f09-ba05-d144be614eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:32.230883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76879561-b802-4f09-ba05-d144be614eb0 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:32.235815 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8191a9-7938-4b71-aae4-dfb890cdeccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:32.236924 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8191a9-7938-4b71-aae4-dfb890cdeccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:32.237393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8191a9-7938-4b71-aae4-dfb890cdeccb admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:32.237990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8191a9-7938-4b71-aae4-dfb890cdeccb admin admin] PATH_INFO: `/v3/projects/e2d887c5c6634401839bf885bfe8750c` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:32.239532 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8191a9-7938-4b71-aae4-dfb890cdeccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d887c5c6634401839bf885bfe8750c)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:32.241959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8191a9-7938-4b71-aae4-dfb890cdeccb admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:32.257155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:32.362757 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-da8191a9-7938-4b71-aae4-dfb890cdeccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d887c5c6634401839bf885bfe8750c', 'request_id': 'req-da8191a9-7938-4b71-aae4-dfb890cdeccb'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:32.369765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-da8191a9-7938-4b71-aae4-dfb890cdeccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d887c5c6634401839bf885bfe8750c', 'request_id': 'req-da8191a9-7938-4b71-aae4-dfb890cdeccb'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:32.377690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-da8191a9-7938-4b71-aae4-dfb890cdeccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d887c5c6634401839bf885bfe8750c', 'request_id': 'req-da8191a9-7938-4b71-aae4-dfb890cdeccb'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:32.497414 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-da8191a9-7938-4b71-aae4-dfb890cdeccb admin admin] The token cache is being invalidate because project e2d887c5c6634401839bf885bfe8750c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:03:32.497414 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-da8191a9-7938-4b71-aae4-dfb890cdeccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:32.497414 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-da8191a9-7938-4b71-aae4-dfb890cdeccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:32.502988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1211/2386] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:03:32 2022] DELETE /identity/v3/projects/e2d887c5c6634401839bf885bfe8750c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:03:32.505007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1b277-35ba-4507-818b-3d8a9c4b2c02 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:32.505489 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1b277-35ba-4507-818b-3d8a9c4b2c02 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:32.505585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1b277-35ba-4507-818b-3d8a9c4b2c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:32.527369 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-65c1b277-35ba-4507-818b-3d8a9c4b2c02 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:32.528682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-65c1b277-35ba-4507-818b-3d8a9c4b2c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:32.625050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1176/2387] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:03:32.631122 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e56f6-4ac5-4a6e-bf31-3a4b4907c17a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:32.631569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e56f6-4ac5-4a6e-bf31-3a4b4907c17a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:32.631956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e56f6-4ac5-4a6e-bf31-3a4b4907c17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:32.654472 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-2a0e56f6-4ac5-4a6e-bf31-3a4b4907c17a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:32.655832 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2a0e56f6-4ac5-4a6e-bf31-3a4b4907c17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:32.670250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1212/2388] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:32.672116 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1b277-35ba-4507-818b-3d8a9c4b2c02 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:32.682761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1b277-35ba-4507-818b-3d8a9c4b2c02 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:32.688936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf821e-5357-441d-95e8-23f9e3529c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:32.689667 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf821e-5357-441d-95e8-23f9e3529c27 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:32.690060 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf821e-5357-441d-95e8-23f9e3529c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:32.690480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf821e-5357-441d-95e8-23f9e3529c27 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:32.691394 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf821e-5357-441d-95e8-23f9e3529c27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:03:32.691851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf821e-5357-441d-95e8-23f9e3529c27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:32.693557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf821e-5357-441d-95e8-23f9e3529c27 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:32.708391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1177/2389] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:03:32.715207 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e56f6-4ac5-4a6e-bf31-3a4b4907c17a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:32.725431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e56f6-4ac5-4a6e-bf31-3a4b4907c17a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:32.730404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77e515-7f32-4c53-8611-da83a0fe6d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:32.731215 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77e515-7f32-4c53-8611-da83a0fe6d58 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:32.731602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77e515-7f32-4c53-8611-da83a0fe6d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:32.732104 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77e515-7f32-4c53-8611-da83a0fe6d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:32.732932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77e515-7f32-4c53-8611-da83a0fe6d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:32.735115 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77e515-7f32-4c53-8611-da83a0fe6d58 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:32.819737 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1213/2390] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:03:32 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:03:32.823913 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf821e-5357-441d-95e8-23f9e3529c27 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:32.834539 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf821e-5357-441d-95e8-23f9e3529c27 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:32.894904 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d2787-4fa7-44e4-950f-52ac49980374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:32.895879 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d2787-4fa7-44e4-950f-52ac49980374 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:32.896346 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d2787-4fa7-44e4-950f-52ac49980374 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:32.896637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d2787-4fa7-44e4-950f-52ac49980374 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:32.897415 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d2787-4fa7-44e4-950f-52ac49980374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:32.899395 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d2787-4fa7-44e4-950f-52ac49980374 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:32.975753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1178/2391] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:03:32 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:03:32.983152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77e515-7f32-4c53-8611-da83a0fe6d58 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:32.994808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77e515-7f32-4c53-8611-da83a0fe6d58 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:33.007800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ba98b-21aa-46db-8d8c-12c619e1de9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:33.008496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ba98b-21aa-46db-8d8c-12c619e1de9b admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:33.008788 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ba98b-21aa-46db-8d8c-12c619e1de9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:33.009074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ba98b-21aa-46db-8d8c-12c619e1de9b admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:33.009816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ba98b-21aa-46db-8d8c-12c619e1de9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:33.011488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ba98b-21aa-46db-8d8c-12c619e1de9b admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:33.023547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1214/2392] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:03:33.028465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d2787-4fa7-44e4-950f-52ac49980374 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:33.041060 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d2787-4fa7-44e4-950f-52ac49980374 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:33.046983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c075576-377f-4569-a732-29b767aa61a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:33.047633 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c075576-377f-4569-a732-29b767aa61a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:33.047938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c075576-377f-4569-a732-29b767aa61a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:33.049677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c075576-377f-4569-a732-29b767aa61a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:33.049677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c075576-377f-4569-a732-29b767aa61a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:33.051018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c075576-377f-4569-a732-29b767aa61a3 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:33.063732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1179/2393] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:03:33.067232 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ba98b-21aa-46db-8d8c-12c619e1de9b admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:33.078724 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ba98b-21aa-46db-8d8c-12c619e1de9b admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:33.084247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a810d-9ba8-4512-af65-4502fa5abfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:33.085146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a810d-9ba8-4512-af65-4502fa5abfb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:33.085604 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a810d-9ba8-4512-af65-4502fa5abfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:33.086074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a810d-9ba8-4512-af65-4502fa5abfb9 admin admin] PATH_INFO: `/v3/projects/7ca6f770f8194777b2998aa6f74a5d05/users/7ee06ebacbc04c49add09fa5fd709555/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:33.104495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a810d-9ba8-4512-af65-4502fa5abfb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca6f770f8194777b2998aa6f74a5d05, user_id=7ee06ebacbc04c49add09fa5fd709555, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:33.108684 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a810d-9ba8-4512-af65-4502fa5abfb9 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:33.215163 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1215/2394] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:03:33 2022] PUT /identity/v3/projects/7ca6f770f8194777b2998aa6f74a5d05/users/7ee06ebacbc04c49add09fa5fd709555/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:03:33.220149 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c930e9-4a89-4489-839d-ed4ae3ac7855 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:33.220444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c930e9-4a89-4489-839d-ed4ae3ac7855 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:33.220726 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c930e9-4a89-4489-839d-ed4ae3ac7855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:33.239539 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-40c930e9-4a89-4489-839d-ed4ae3ac7855 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:33.240980 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-40c930e9-4a89-4489-839d-ed4ae3ac7855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:33.276197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:33.303493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1180/2395] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:33.312800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a810d-9ba8-4512-af65-4502fa5abfb9 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:33.315254 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-904a810d-9ba8-4512-af65-4502fa5abfb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:33.378630 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a810d-9ba8-4512-af65-4502fa5abfb9 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:33.382437 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2b451-466d-4361-9bdb-e5fd48e208d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:33.383078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2b451-466d-4361-9bdb-e5fd48e208d4 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:33.383367 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2b451-466d-4361-9bdb-e5fd48e208d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:33.383644 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2b451-466d-4361-9bdb-e5fd48e208d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:33.392883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2b451-466d-4361-9bdb-e5fd48e208d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:33.394487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2b451-466d-4361-9bdb-e5fd48e208d4 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:33.404616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1216/2396] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:03:40.401626 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce800a-1b77-4092-a18a-4875b32d2084 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:40.402162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce800a-1b77-4092-a18a-4875b32d2084 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:40.402162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce800a-1b77-4092-a18a-4875b32d2084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:40.436336 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-75ce800a-1b77-4092-a18a-4875b32d2084 None None] MFA Rules not processed for user `7ee06ebacbc04c49add09fa5fd709555`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:40.437946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-75ce800a-1b77-4092-a18a-4875b32d2084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:40.542330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1181/2397] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:03:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:40.548020 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2b451-466d-4361-9bdb-e5fd48e208d4 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:40.559190 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2b451-466d-4361-9bdb-e5fd48e208d4 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:40.564254 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564530df-e53b-4bf2-b762-f1003df555d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:40.564936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564530df-e53b-4bf2-b762-f1003df555d7 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:40.565274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564530df-e53b-4bf2-b762-f1003df555d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:40.565565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564530df-e53b-4bf2-b762-f1003df555d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:40.566279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564530df-e53b-4bf2-b762-f1003df555d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:40.568260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564530df-e53b-4bf2-b762-f1003df555d7 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:40.718884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1217/2398] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:03:40 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:03:40.720814 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce800a-1b77-4092-a18a-4875b32d2084 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:40.740764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce800a-1b77-4092-a18a-4875b32d2084 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:40.893698 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24dc37-0e0d-49f1-be30-7b3a235cf957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:40.894684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24dc37-0e0d-49f1-be30-7b3a235cf957 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:40.895114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24dc37-0e0d-49f1-be30-7b3a235cf957 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:40.895412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24dc37-0e0d-49f1-be30-7b3a235cf957 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:40.896125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24dc37-0e0d-49f1-be30-7b3a235cf957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:40.898106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24dc37-0e0d-49f1-be30-7b3a235cf957 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:41.029313 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1182/2399] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:03:40 2022] POST /identity/v3/users => generated 298 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:03:41.033443 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564530df-e53b-4bf2-b762-f1003df555d7 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:41.047743 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564530df-e53b-4bf2-b762-f1003df555d7 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:41.053861 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2397e9-ceee-4890-be25-c62e0b187792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:41.055395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2397e9-ceee-4890-be25-c62e0b187792 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:41.055687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2397e9-ceee-4890-be25-c62e0b187792 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:41.055972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2397e9-ceee-4890-be25-c62e0b187792 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:41.057479 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2397e9-ceee-4890-be25-c62e0b187792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:41.059618 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2397e9-ceee-4890-be25-c62e0b187792 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:41.075210 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:41.085286 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1218/2400] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:03:41.086577 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24dc37-0e0d-49f1-be30-7b3a235cf957 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:41.097423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24dc37-0e0d-49f1-be30-7b3a235cf957 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:41.102766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab874117-063b-4e46-9d89-ea3bc6ed404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:41.103825 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab874117-063b-4e46-9d89-ea3bc6ed404b admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:41.104115 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab874117-063b-4e46-9d89-ea3bc6ed404b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:41.104510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab874117-063b-4e46-9d89-ea3bc6ed404b admin admin] PATH_INFO: `/v3/projects/5f577e5e9371400c8234960b82505bd1/users/7a56c98955d145c3b721f25dcfcd8546/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:41.121677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab874117-063b-4e46-9d89-ea3bc6ed404b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f577e5e9371400c8234960b82505bd1, user_id=7a56c98955d145c3b721f25dcfcd8546, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:41.124442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab874117-063b-4e46-9d89-ea3bc6ed404b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:41.215754 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1183/2401] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:03:41 2022] PUT /identity/v3/projects/5f577e5e9371400c8234960b82505bd1/users/7a56c98955d145c3b721f25dcfcd8546/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:03:41.219965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2397e9-ceee-4890-be25-c62e0b187792 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:41.231032 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2397e9-ceee-4890-be25-c62e0b187792 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:41.297757 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a3cae-bdd4-4bf0-99d4-cd18d6227ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:41.298486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a3cae-bdd4-4bf0-99d4-cd18d6227ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:41.298781 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a3cae-bdd4-4bf0-99d4-cd18d6227ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:41.299147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a3cae-bdd4-4bf0-99d4-cd18d6227ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:41.299804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a3cae-bdd4-4bf0-99d4-cd18d6227ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:41.301432 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a3cae-bdd4-4bf0-99d4-cd18d6227ec8 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:41.313237 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1219/2402] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:03:41.317405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab874117-063b-4e46-9d89-ea3bc6ed404b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:41.328097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab874117-063b-4e46-9d89-ea3bc6ed404b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:41.333093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c45a3-3845-4cae-a6b7-a6d59148d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:41.334004 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c45a3-3845-4cae-a6b7-a6d59148d3bf admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:41.334295 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c45a3-3845-4cae-a6b7-a6d59148d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:41.335133 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c45a3-3845-4cae-a6b7-a6d59148d3bf admin admin] PATH_INFO: `/v3/projects/5f577e5e9371400c8234960b82505bd1/users/7a56c98955d145c3b721f25dcfcd8546/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:41.336657 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c45a3-3845-4cae-a6b7-a6d59148d3bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f577e5e9371400c8234960b82505bd1, user_id=7a56c98955d145c3b721f25dcfcd8546, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:41.339761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c45a3-3845-4cae-a6b7-a6d59148d3bf admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:41.357084 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1184/2403] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:03:41 2022] PUT /identity/v3/projects/5f577e5e9371400c8234960b82505bd1/users/7a56c98955d145c3b721f25dcfcd8546/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:03:46.130613 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8faa90-0b54-4aab-9595-80006a8aeb9c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:46.131116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8faa90-0b54-4aab-9595-80006a8aeb9c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:46.131216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8faa90-0b54-4aab-9595-80006a8aeb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:46.168812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-7e8faa90-0b54-4aab-9595-80006a8aeb9c None None] MFA Rules not processed for user `4445523345704277ba223e61b27c557c`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:46.170181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-7e8faa90-0b54-4aab-9595-80006a8aeb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:46.247125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1220/2404] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:03:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:48.262178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa164ec-ce92-4a4f-ab86-01be0189f902 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:48.264080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa164ec-ce92-4a4f-ab86-01be0189f902 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:48.264080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa164ec-ce92-4a4f-ab86-01be0189f902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:48.312019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-9fa164ec-ce92-4a4f-ab86-01be0189f902 None None] MFA Rules not processed for user `7a56c98955d145c3b721f25dcfcd8546`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:48.314805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9fa164ec-ce92-4a4f-ab86-01be0189f902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:48.351004 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:48.448077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1185/2405] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:03:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:48.464206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8faa90-0b54-4aab-9595-80006a8aeb9c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:48.464844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-7e8faa90-0b54-4aab-9595-80006a8aeb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:48.543022 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8faa90-0b54-4aab-9595-80006a8aeb9c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:48.547873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37dfbd-3c4d-481c-8fe0-4ae407deb0c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2b57ae83164912a4e23dda9dc239f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:48.550024 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37dfbd-3c4d-481c-8fe0-4ae407deb0c8 service glance] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:48.550335 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37dfbd-3c4d-481c-8fe0-4ae407deb0c8 service glance] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:48.550646 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37dfbd-3c4d-481c-8fe0-4ae407deb0c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:48.624772 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:48.627620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37dfbd-3c4d-481c-8fe0-4ae407deb0c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:48.629507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37dfbd-3c4d-481c-8fe0-4ae407deb0c8 service glance] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:48.658567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1221/2406] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:03:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:03:48.951289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2020afd-003c-408f-b04f-763e172b9a3c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:48.951603 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2020afd-003c-408f-b04f-763e172b9a3c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:48.951893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2020afd-003c-408f-b04f-763e172b9a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:48.973163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b2020afd-003c-408f-b04f-763e172b9a3c None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:03:48.974684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b2020afd-003c-408f-b04f-763e172b9a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:49.043526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1186/2407] 10.222.0.15 () {58 vars in 1009 bytes} [Fri May 27 20:03:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:03:49.055542 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37dfbd-3c4d-481c-8fe0-4ae407deb0c8 service glance] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:49.057162 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-6a37dfbd-3c4d-481c-8fe0-4ae407deb0c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:49.139721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37dfbd-3c4d-481c-8fe0-4ae407deb0c8 service glance] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:49.139902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2020afd-003c-408f-b04f-763e172b9a3c None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:49.141911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b2020afd-003c-408f-b04f-763e172b9a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:03:49.146064 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a27c83-e782-4079-8b3a-e472e924b524 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:49.146769 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a27c83-e782-4079-8b3a-e472e924b524 service swift] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:49.147063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a27c83-e782-4079-8b3a-e472e924b524 service swift] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:49.151740 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a27c83-e782-4079-8b3a-e472e924b524 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:49.158682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a27c83-e782-4079-8b3a-e472e924b524 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:49.160310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a27c83-e782-4079-8b3a-e472e924b524 service swift] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:49.169205 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1222/2408] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:03:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 20:03:49.211941 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2020afd-003c-408f-b04f-763e172b9a3c None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:49.216533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a7b20-df04-4aca-bc92-ae564c4a5396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:49.222263 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a7b20-df04-4aca-bc92-ae564c4a5396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:49.222263 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a7b20-df04-4aca-bc92-ae564c4a5396 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:49.222263 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a7b20-df04-4aca-bc92-ae564c4a5396 admin admin] PATH_INFO: `/v3/users/8521bf0e9bf3451a936586c387a79344` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:49.222263 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a7b20-df04-4aca-bc92-ae564c4a5396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8521bf0e9bf3451a936586c387a79344)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:49.222263 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a7b20-df04-4aca-bc92-ae564c4a5396 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:49.719081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-e18a7b20-df04-4aca-bc92-ae564c4a5396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8521bf0e9bf3451a936586c387a79344'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:49.720215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-e18a7b20-df04-4aca-bc92-ae564c4a5396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8521bf0e9bf3451a936586c387a79344'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:49.853556 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-e18a7b20-df04-4aca-bc92-ae564c4a5396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8521bf0e9bf3451a936586c387a79344'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:49.855491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:03:49.870787 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-e18a7b20-df04-4aca-bc92-ae564c4a5396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8521bf0e9bf3451a936586c387a79344'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:49.878701 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-e18a7b20-df04-4aca-bc92-ae564c4a5396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8521bf0e9bf3451a936586c387a79344'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:49.885416 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1187/2409] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:03:49 2022] DELETE /identity/v3/users/8521bf0e9bf3451a936586c387a79344 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:03:50.301982 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a27c83-e782-4079-8b3a-e472e924b524 service swift] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:03:50.317977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a27c83-e782-4079-8b3a-e472e924b524 service swift] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:03:50.429069 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf21f57-81da-4f5c-ae93-25624ae61221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:03:50.430471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf21f57-81da-4f5c-ae93-25624ae61221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:03:50.430873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf21f57-81da-4f5c-ae93-25624ae61221 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:03:50.431250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf21f57-81da-4f5c-ae93-25624ae61221 admin admin] PATH_INFO: `/v3/projects/df23b127bbeb416c85affe94247eb286` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:03:50.444916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf21f57-81da-4f5c-ae93-25624ae61221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df23b127bbeb416c85affe94247eb286)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:03:50.447611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf21f57-81da-4f5c-ae93-25624ae61221 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:03:50.622615 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-baf21f57-81da-4f5c-ae93-25624ae61221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df23b127bbeb416c85affe94247eb286', 'request_id': 'req-baf21f57-81da-4f5c-ae93-25624ae61221'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:50.631138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-baf21f57-81da-4f5c-ae93-25624ae61221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df23b127bbeb416c85affe94247eb286', 'request_id': 'req-baf21f57-81da-4f5c-ae93-25624ae61221'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:50.659875 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-baf21f57-81da-4f5c-ae93-25624ae61221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df23b127bbeb416c85affe94247eb286', 'request_id': 'req-baf21f57-81da-4f5c-ae93-25624ae61221'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:50.765241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-baf21f57-81da-4f5c-ae93-25624ae61221 admin admin] The token cache is being invalidate because project df23b127bbeb416c85affe94247eb286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:03:50.765241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-baf21f57-81da-4f5c-ae93-25624ae61221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:50.765241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-baf21f57-81da-4f5c-ae93-25624ae61221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:03:50.766490 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1223/2410] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:03:50 2022] DELETE /identity/v3/projects/df23b127bbeb416c85affe94247eb286 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:04:00.141407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=11,keystone:DELETE=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:04:00.759075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:04:00.966038 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571545b2-d099-40ff-9211-8e233ab40227 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:00.969154 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571545b2-d099-40ff-9211-8e233ab40227 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:00.969154 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571545b2-d099-40ff-9211-8e233ab40227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:00.984699 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-571545b2-d099-40ff-9211-8e233ab40227 None None] MFA Rules not processed for user `7ee06ebacbc04c49add09fa5fd709555`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:04:00.985893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-571545b2-d099-40ff-9211-8e233ab40227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:01.041712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1188/2411] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:04:04.526986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c2089-68b5-4154-8a9d-09f1d804c7de None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:04.527476 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c2089-68b5-4154-8a9d-09f1d804c7de None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:04.527702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c2089-68b5-4154-8a9d-09f1d804c7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:04.546668 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-1d3c2089-68b5-4154-8a9d-09f1d804c7de None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:04:04.547860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-1d3c2089-68b5-4154-8a9d-09f1d804c7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:04.618704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1224/2412] 10.222.0.15 () {58 vars in 1009 bytes} [Fri May 27 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:04:04.631616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571545b2-d099-40ff-9211-8e233ab40227 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:04.633144 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-571545b2-d099-40ff-9211-8e233ab40227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:04.712091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571545b2-d099-40ff-9211-8e233ab40227 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:04.718862 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf647e-c688-4a06-9b08-c494bbde4dd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:04.719728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf647e-c688-4a06-9b08-c494bbde4dd2 service swift] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:04.719831 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf647e-c688-4a06-9b08-c494bbde4dd2 service swift] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:04.720078 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf647e-c688-4a06-9b08-c494bbde4dd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:04.729770 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf647e-c688-4a06-9b08-c494bbde4dd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:04.734915 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf647e-c688-4a06-9b08-c494bbde4dd2 service swift] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:04.750481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1189/2413] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:04:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 20:04:14.611268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=25 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:04:14.740880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=57 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:04:33.566179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51064f58-f152-4780-8ffc-4c86edc1f1bd None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:33.566670 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51064f58-f152-4780-8ffc-4c86edc1f1bd None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:33.566765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51064f58-f152-4780-8ffc-4c86edc1f1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:33.584315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-51064f58-f152-4780-8ffc-4c86edc1f1bd None None] MFA Rules not processed for user `e3667bac6fe34a0bb29cdf7c9fc556f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:04:33.585515 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-51064f58-f152-4780-8ffc-4c86edc1f1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:33.642789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1225/2414] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:04:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:04:37.138548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf647e-c688-4a06-9b08-c494bbde4dd2 service swift] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:37.141766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b5bf647e-c688-4a06-9b08-c494bbde4dd2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:37.211602 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf647e-c688-4a06-9b08-c494bbde4dd2 service swift] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:37.215621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb480cd8-69fb-4106-bfd3-018361dab365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:37.216303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb480cd8-69fb-4106-bfd3-018361dab365 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:37.216600 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb480cd8-69fb-4106-bfd3-018361dab365 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:37.216889 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb480cd8-69fb-4106-bfd3-018361dab365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:37.221898 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cb480cd8-69fb-4106-bfd3-018361dab365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:37.302071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb480cd8-69fb-4106-bfd3-018361dab365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:37.303680 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb480cd8-69fb-4106-bfd3-018361dab365 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:37.318568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1190/2415] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:04:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:04:42.087151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51064f58-f152-4780-8ffc-4c86edc1f1bd None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:42.089070 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-51064f58-f152-4780-8ffc-4c86edc1f1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:42.208194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51064f58-f152-4780-8ffc-4c86edc1f1bd None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:42.212880 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df92cc-ea19-4ecb-8f3e-080d81acfc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:42.213743 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df92cc-ea19-4ecb-8f3e-080d81acfc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:42.215025 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df92cc-ea19-4ecb-8f3e-080d81acfc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:42.215025 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df92cc-ea19-4ecb-8f3e-080d81acfc74 admin admin] PATH_INFO: `/v3/users/9cbadf27b0054737bc798f8500dd661f` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:42.215639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df92cc-ea19-4ecb-8f3e-080d81acfc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cbadf27b0054737bc798f8500dd661f)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:42.217803 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df92cc-ea19-4ecb-8f3e-080d81acfc74 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:42.487460 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-80df92cc-ea19-4ecb-8f3e-080d81acfc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cbadf27b0054737bc798f8500dd661f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:04:42.574062 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-80df92cc-ea19-4ecb-8f3e-080d81acfc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cbadf27b0054737bc798f8500dd661f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:04:42.575128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-80df92cc-ea19-4ecb-8f3e-080d81acfc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cbadf27b0054737bc798f8500dd661f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:04:42.584193 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-80df92cc-ea19-4ecb-8f3e-080d81acfc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cbadf27b0054737bc798f8500dd661f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:04:42.596268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-80df92cc-ea19-4ecb-8f3e-080d81acfc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cbadf27b0054737bc798f8500dd661f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:04:42.602553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1226/2416] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:04:42 2022] DELETE /identity/v3/users/9cbadf27b0054737bc798f8500dd661f => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:04:42.875817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb480cd8-69fb-4106-bfd3-018361dab365 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:42.891369 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb480cd8-69fb-4106-bfd3-018361dab365 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:42.981857 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1edb02-a8f2-4e6d-9ca5-a204e58f3f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:42.982785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1edb02-a8f2-4e6d-9ca5-a204e58f3f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:42.983140 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1edb02-a8f2-4e6d-9ca5-a204e58f3f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:42.983416 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1edb02-a8f2-4e6d-9ca5-a204e58f3f65 admin admin] PATH_INFO: `/v3/projects/32b01d760d4746108521a14e2a4ab4d0` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:42.984618 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1edb02-a8f2-4e6d-9ca5-a204e58f3f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b01d760d4746108521a14e2a4ab4d0)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:42.987202 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1edb02-a8f2-4e6d-9ca5-a204e58f3f65 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:43.167945 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7b1edb02-a8f2-4e6d-9ca5-a204e58f3f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b01d760d4746108521a14e2a4ab4d0', 'request_id': 'req-7b1edb02-a8f2-4e6d-9ca5-a204e58f3f65'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:04:43.170933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:04:43.236989 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7b1edb02-a8f2-4e6d-9ca5-a204e58f3f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b01d760d4746108521a14e2a4ab4d0', 'request_id': 'req-7b1edb02-a8f2-4e6d-9ca5-a204e58f3f65'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:04:43.244334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7b1edb02-a8f2-4e6d-9ca5-a204e58f3f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b01d760d4746108521a14e2a4ab4d0', 'request_id': 'req-7b1edb02-a8f2-4e6d-9ca5-a204e58f3f65'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:04:43.255884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7b1edb02-a8f2-4e6d-9ca5-a204e58f3f65 admin admin] The token cache is being invalidate because project 32b01d760d4746108521a14e2a4ab4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:04:43.256389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7b1edb02-a8f2-4e6d-9ca5-a204e58f3f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:04:43.257385 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7b1edb02-a8f2-4e6d-9ca5-a204e58f3f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:04:43.259007 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1191/2417] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:04:42 2022] DELETE /identity/v3/projects/32b01d760d4746108521a14e2a4ab4d0 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:04:43.264983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46849d-1910-413c-a5c3-492a909401fa None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:43.265518 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46849d-1910-413c-a5c3-492a909401fa None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:43.265763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46849d-1910-413c-a5c3-492a909401fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:43.285409 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-9d46849d-1910-413c-a5c3-492a909401fa None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:04:43.286662 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9d46849d-1910-413c-a5c3-492a909401fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:43.306152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:04:43.347541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1227/2418] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:04:43.355686 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aa0aa-9004-43de-a92e-fab9a5d69570 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:43.355986 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aa0aa-9004-43de-a92e-fab9a5d69570 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:43.356271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710aa0aa-9004-43de-a92e-fab9a5d69570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:43.380406 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-710aa0aa-9004-43de-a92e-fab9a5d69570 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:04:43.381637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-710aa0aa-9004-43de-a92e-fab9a5d69570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:43.396088 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1192/2419] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:04:43.400737 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46849d-1910-413c-a5c3-492a909401fa None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:43.412164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46849d-1910-413c-a5c3-492a909401fa None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:43.417228 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bd6ea-6496-45f7-885e-6c7f97f41909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:43.418321 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bd6ea-6496-45f7-885e-6c7f97f41909 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:43.418583 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bd6ea-6496-45f7-885e-6c7f97f41909 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:43.418874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bd6ea-6496-45f7-885e-6c7f97f41909 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:43.419765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bd6ea-6496-45f7-885e-6c7f97f41909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:04:43.420097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bd6ea-6496-45f7-885e-6c7f97f41909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:43.421802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bd6ea-6496-45f7-885e-6c7f97f41909 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:43.434455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1228/2420] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 20:04:43.443676 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710aa0aa-9004-43de-a92e-fab9a5d69570 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:43.453110 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710aa0aa-9004-43de-a92e-fab9a5d69570 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:43.458539 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1d97d-984b-4438-b579-e32ae64d1ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:43.459197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1d97d-984b-4438-b579-e32ae64d1ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:43.459493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1d97d-984b-4438-b579-e32ae64d1ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:43.459782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1d97d-984b-4438-b579-e32ae64d1ce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:43.460495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1d97d-984b-4438-b579-e32ae64d1ce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:43.462490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1d97d-984b-4438-b579-e32ae64d1ce4 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:43.608378 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1193/2421] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:04:43 2022] POST /identity/v3/projects => generated 389 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:04:43.612405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bd6ea-6496-45f7-885e-6c7f97f41909 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:43.622280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bd6ea-6496-45f7-885e-6c7f97f41909 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:43.677917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683211ae-0b15-4b7d-92cf-056f4a13a323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:43.678638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683211ae-0b15-4b7d-92cf-056f4a13a323 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:43.678925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683211ae-0b15-4b7d-92cf-056f4a13a323 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:43.679202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683211ae-0b15-4b7d-92cf-056f4a13a323 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:43.679915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683211ae-0b15-4b7d-92cf-056f4a13a323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:43.681918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683211ae-0b15-4b7d-92cf-056f4a13a323 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:43.825451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1229/2422] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:04:43 2022] POST /identity/v3/users => generated 295 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:04:43.830595 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1d97d-984b-4438-b579-e32ae64d1ce4 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:43.841330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1d97d-984b-4438-b579-e32ae64d1ce4 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:43.845977 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c05d3-2a36-4fac-98e2-24cdb275cd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:43.846829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c05d3-2a36-4fac-98e2-24cdb275cd13 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:43.847122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c05d3-2a36-4fac-98e2-24cdb275cd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:43.847570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c05d3-2a36-4fac-98e2-24cdb275cd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:43.848314 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c05d3-2a36-4fac-98e2-24cdb275cd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:43.850020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c05d3-2a36-4fac-98e2-24cdb275cd13 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:43.865280 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1194/2423] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:04:43.866262 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683211ae-0b15-4b7d-92cf-056f4a13a323 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:43.877455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683211ae-0b15-4b7d-92cf-056f4a13a323 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:43.883440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2725062-a998-4cdb-8839-0f01b510bafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:43.884784 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2725062-a998-4cdb-8839-0f01b510bafd admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:43.886136 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2725062-a998-4cdb-8839-0f01b510bafd admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:43.886136 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2725062-a998-4cdb-8839-0f01b510bafd admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:43.886444 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2725062-a998-4cdb-8839-0f01b510bafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:43.888095 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2725062-a998-4cdb-8839-0f01b510bafd admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:43.900797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1230/2424] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:04:43.905056 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c05d3-2a36-4fac-98e2-24cdb275cd13 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:43.915166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c05d3-2a36-4fac-98e2-24cdb275cd13 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:43.920488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b9366-a86e-4f52-b246-eee2bc3b1a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:43.921377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b9366-a86e-4f52-b246-eee2bc3b1a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:43.921865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b9366-a86e-4f52-b246-eee2bc3b1a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:43.922012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b9366-a86e-4f52-b246-eee2bc3b1a82 admin admin] PATH_INFO: `/v3/projects/8f431374c2944da3a0fd5b8bda45f9a2/users/f120b0139dfe4f36a8ae97060a1c26e3/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:43.940182 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b9366-a86e-4f52-b246-eee2bc3b1a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f431374c2944da3a0fd5b8bda45f9a2, user_id=f120b0139dfe4f36a8ae97060a1c26e3, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:43.942933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b9366-a86e-4f52-b246-eee2bc3b1a82 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:44.043367 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1195/2425] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:04:43 2022] PUT /identity/v3/projects/8f431374c2944da3a0fd5b8bda45f9a2/users/f120b0139dfe4f36a8ae97060a1c26e3/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:04:44.048268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78523557-53d0-4bf0-9672-62635ef91de1 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:44.048567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78523557-53d0-4bf0-9672-62635ef91de1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:44.048855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78523557-53d0-4bf0-9672-62635ef91de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:44.066986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-78523557-53d0-4bf0-9672-62635ef91de1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:04:44.068196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-78523557-53d0-4bf0-9672-62635ef91de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:44.128683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1231/2426] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:04:44.138437 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b9366-a86e-4f52-b246-eee2bc3b1a82 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:44.140712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-eb7b9366-a86e-4f52-b246-eee2bc3b1a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:44.206013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b9366-a86e-4f52-b246-eee2bc3b1a82 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:44.209835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6f62f-fd2f-433a-b323-83fc00e5ab33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:44.210640 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f62f-fd2f-433a-b323-83fc00e5ab33 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:44.211023 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f62f-fd2f-433a-b323-83fc00e5ab33 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:44.211329 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6f62f-fd2f-433a-b323-83fc00e5ab33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:44.220842 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f62f-fd2f-433a-b323-83fc00e5ab33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:44.222367 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c6f62f-fd2f-433a-b323-83fc00e5ab33 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:44.232268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1196/2427] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:04:47.731365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78523557-53d0-4bf0-9672-62635ef91de1 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:47.756649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78523557-53d0-4bf0-9672-62635ef91de1 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:47.762712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6927d71-36d9-4130-904e-ba675e789629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:47.763386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6927d71-36d9-4130-904e-ba675e789629 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:47.763672 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6927d71-36d9-4130-904e-ba675e789629 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:47.763949 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6927d71-36d9-4130-904e-ba675e789629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:47.766507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f6927d71-36d9-4130-904e-ba675e789629 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:47.808915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:04:47.852447 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6927d71-36d9-4130-904e-ba675e789629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:47.853890 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6927d71-36d9-4130-904e-ba675e789629 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:47.866688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1232/2428] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:04:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:04:47.990820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6f62f-fd2f-433a-b323-83fc00e5ab33 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:47.992374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-16c6f62f-fd2f-433a-b323-83fc00e5ab33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:48.057779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6f62f-fd2f-433a-b323-83fc00e5ab33 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:48.065197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cc250-20c0-4956-9fab-64a2fe5bb51b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:48.065481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cc250-20c0-4956-9fab-64a2fe5bb51b service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:48.065948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cc250-20c0-4956-9fab-64a2fe5bb51b service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:48.066398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cc250-20c0-4956-9fab-64a2fe5bb51b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:48.071225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d60cc250-20c0-4956-9fab-64a2fe5bb51b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:48.088044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cc250-20c0-4956-9fab-64a2fe5bb51b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:48.089618 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cc250-20c0-4956-9fab-64a2fe5bb51b service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:48.112245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1197/2429] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:04:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:04:50.785951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d1cb3-a4cc-4980-9d7e-d440e73de02d None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:50.786873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d1cb3-a4cc-4980-9d7e-d440e73de02d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:50.787363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d1cb3-a4cc-4980-9d7e-d440e73de02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:50.833978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-df8d1cb3-a4cc-4980-9d7e-d440e73de02d None None] MFA Rules not processed for user `f120b0139dfe4f36a8ae97060a1c26e3`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:04:50.835537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-df8d1cb3-a4cc-4980-9d7e-d440e73de02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:50.915672 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1233/2430] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:04:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:04:50.930194 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cc250-20c0-4956-9fab-64a2fe5bb51b service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:50.931920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d60cc250-20c0-4956-9fab-64a2fe5bb51b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:50.947625 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cc250-20c0-4956-9fab-64a2fe5bb51b service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:50.953869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de21af-b07c-486d-b29e-e9d165817a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:50.955368 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de21af-b07c-486d-b29e-e9d165817a40 service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:50.955368 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de21af-b07c-486d-b29e-e9d165817a40 service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:50.955686 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de21af-b07c-486d-b29e-e9d165817a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:50.966861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de21af-b07c-486d-b29e-e9d165817a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:50.969496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de21af-b07c-486d-b29e-e9d165817a40 service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:50.987210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1198/2431] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:04:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:04:53.849118 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd957981-9a50-4dd1-94a5-0233deb3dc7c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:53.849664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd957981-9a50-4dd1-94a5-0233deb3dc7c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:53.849790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd957981-9a50-4dd1-94a5-0233deb3dc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:53.869180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-dd957981-9a50-4dd1-94a5-0233deb3dc7c None None] MFA Rules not processed for user `f120b0139dfe4f36a8ae97060a1c26e3`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:04:53.870480 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-dd957981-9a50-4dd1-94a5-0233deb3dc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:53.877770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1234/2432] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:04:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:04:54.342069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de21af-b07c-486d-b29e-e9d165817a40 service nova] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:54.353742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de21af-b07c-486d-b29e-e9d165817a40 service nova] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:54.364115 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fece8-1cf7-4385-9acc-760d52ec866b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:54.365046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fece8-1cf7-4385-9acc-760d52ec866b service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:54.365628 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fece8-1cf7-4385-9acc-760d52ec866b service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:54.366098 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fece8-1cf7-4385-9acc-760d52ec866b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:54.368572 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-061fece8-1cf7-4385-9acc-760d52ec866b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:54.388147 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:04:54.392223 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fece8-1cf7-4385-9acc-760d52ec866b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:54.392223 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fece8-1cf7-4385-9acc-760d52ec866b service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:54.405421 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1199/2433] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:04:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:04:54.884521 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd957981-9a50-4dd1-94a5-0233deb3dc7c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:54.889802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-dd957981-9a50-4dd1-94a5-0233deb3dc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:54.976866 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd957981-9a50-4dd1-94a5-0233deb3dc7c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:54.985044 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92a18d-816b-4193-821c-679808fafb07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394b43cef91f4990b4707cb7a6798068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:54.985952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92a18d-816b-4193-821c-679808fafb07 service placement] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:54.986243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92a18d-816b-4193-821c-679808fafb07 service placement] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:54.986557 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa92a18d-816b-4193-821c-679808fafb07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:54.988519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-fa92a18d-816b-4193-821c-679808fafb07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:55.001602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92a18d-816b-4193-821c-679808fafb07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:55.003989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa92a18d-816b-4193-821c-679808fafb07 service placement] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:55.017393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1235/2434] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:04:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:04:58.739434 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fece8-1cf7-4385-9acc-760d52ec866b service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:04:58.740878 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-061fece8-1cf7-4385-9acc-760d52ec866b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:58.751466 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fece8-1cf7-4385-9acc-760d52ec866b service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:04:58.755654 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dafb55-a292-4099-b2a6-432821ffd8fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:04:58.756348 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dafb55-a292-4099-b2a6-432821ffd8fc service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:04:58.764993 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dafb55-a292-4099-b2a6-432821ffd8fc service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:04:58.764993 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dafb55-a292-4099-b2a6-432821ffd8fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:04:58.764993 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e0dafb55-a292-4099-b2a6-432821ffd8fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:04:58.818204 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dafb55-a292-4099-b2a6-432821ffd8fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:04:58.819681 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dafb55-a292-4099-b2a6-432821ffd8fc service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:04:58.828723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1200/2435] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:04:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:04.242908 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92a18d-816b-4193-821c-679808fafb07 service placement] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:04.252408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa92a18d-816b-4193-821c-679808fafb07 service placement] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:04.256616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a6203-5c8b-46ab-b8ae-04942c345c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:04.257333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a6203-5c8b-46ab-b8ae-04942c345c93 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:04.257624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a6203-5c8b-46ab-b8ae-04942c345c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:04.257904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a6203-5c8b-46ab-b8ae-04942c345c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:04.259772 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-951a6203-5c8b-46ab-b8ae-04942c345c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:04.269763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a6203-5c8b-46ab-b8ae-04942c345c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:04.273101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951a6203-5c8b-46ab-b8ae-04942c345c93 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:04.282112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1236/2436] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:06.716907 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dafb55-a292-4099-b2a6-432821ffd8fc service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:06.725435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dafb55-a292-4099-b2a6-432821ffd8fc service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:06.730107 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffaeb0-ff87-45e2-8c29-6f2470df5f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:06.730796 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffaeb0-ff87-45e2-8c29-6f2470df5f30 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:06.731090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffaeb0-ff87-45e2-8c29-6f2470df5f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:06.731377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffaeb0-ff87-45e2-8c29-6f2470df5f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:06.733150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-ddffaeb0-ff87-45e2-8c29-6f2470df5f30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:06.744914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffaeb0-ff87-45e2-8c29-6f2470df5f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:06.746362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddffaeb0-ff87-45e2-8c29-6f2470df5f30 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:06.755864 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1201/2437] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:10.936161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a6203-5c8b-46ab-b8ae-04942c345c93 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:10.937739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-951a6203-5c8b-46ab-b8ae-04942c345c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:10.953313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a6203-5c8b-46ab-b8ae-04942c345c93 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:10.958160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6fdf9-5fa0-49b1-9d38-6bf68ed9b71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:10.959087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6fdf9-5fa0-49b1-9d38-6bf68ed9b71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:10.959609 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6fdf9-5fa0-49b1-9d38-6bf68ed9b71a admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:10.959891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6fdf9-5fa0-49b1-9d38-6bf68ed9b71a admin admin] PATH_INFO: `/v3/users/4445523345704277ba223e61b27c557c` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:10.961131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6fdf9-5fa0-49b1-9d38-6bf68ed9b71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4445523345704277ba223e61b27c557c)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:10.963702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6fdf9-5fa0-49b1-9d38-6bf68ed9b71a admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:10.974483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:11.188961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a0b6fdf9-5fa0-49b1-9d38-6bf68ed9b71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4445523345704277ba223e61b27c557c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:11.289182 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a0b6fdf9-5fa0-49b1-9d38-6bf68ed9b71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4445523345704277ba223e61b27c557c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:11.289814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a0b6fdf9-5fa0-49b1-9d38-6bf68ed9b71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4445523345704277ba223e61b27c557c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:11.298108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a0b6fdf9-5fa0-49b1-9d38-6bf68ed9b71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4445523345704277ba223e61b27c557c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:11.311524 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a0b6fdf9-5fa0-49b1-9d38-6bf68ed9b71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4445523345704277ba223e61b27c557c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:11.318258 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1237/2438] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:05:10 2022] DELETE /identity/v3/users/4445523345704277ba223e61b27c557c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:11.614253 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffaeb0-ff87-45e2-8c29-6f2470df5f30 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:11.625199 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddffaeb0-ff87-45e2-8c29-6f2470df5f30 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:11.693013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c189b-bad8-496a-b589-bc66333f4e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:11.694164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c189b-bad8-496a-b589-bc66333f4e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:11.694498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c189b-bad8-496a-b589-bc66333f4e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:11.694851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c189b-bad8-496a-b589-bc66333f4e99 admin admin] PATH_INFO: `/v3/projects/24afd32cbb424e1d88101bfcf9e6df7f` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:11.696137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c189b-bad8-496a-b589-bc66333f4e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24afd32cbb424e1d88101bfcf9e6df7f)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:11.698126 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c189b-bad8-496a-b589-bc66333f4e99 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:11.858165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ba5c189b-bad8-496a-b589-bc66333f4e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24afd32cbb424e1d88101bfcf9e6df7f', 'request_id': 'req-ba5c189b-bad8-496a-b589-bc66333f4e99'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:11.938419 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ba5c189b-bad8-496a-b589-bc66333f4e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24afd32cbb424e1d88101bfcf9e6df7f', 'request_id': 'req-ba5c189b-bad8-496a-b589-bc66333f4e99'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:11.950115 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ba5c189b-bad8-496a-b589-bc66333f4e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24afd32cbb424e1d88101bfcf9e6df7f', 'request_id': 'req-ba5c189b-bad8-496a-b589-bc66333f4e99'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:11.956124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ba5c189b-bad8-496a-b589-bc66333f4e99 admin admin] The token cache is being invalidate because project 24afd32cbb424e1d88101bfcf9e6df7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:05:11.956420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ba5c189b-bad8-496a-b589-bc66333f4e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:11.957090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-ba5c189b-bad8-496a-b589-bc66333f4e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:11.958687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1202/2439] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:05:11 2022] DELETE /identity/v3/projects/24afd32cbb424e1d88101bfcf9e6df7f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:11.964299 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7ebdb-77f3-499d-9b22-b4708c59c73f None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:11.964792 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7ebdb-77f3-499d-9b22-b4708c59c73f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:11.964925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7ebdb-77f3-499d-9b22-b4708c59c73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:11.983653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-dbe7ebdb-77f3-499d-9b22-b4708c59c73f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:11.984868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-dbe7ebdb-77f3-499d-9b22-b4708c59c73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:12.080989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1238/2440] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:12.091000 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010295b-71df-4229-9edf-f193d3180f7f None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:12.091228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010295b-71df-4229-9edf-f193d3180f7f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:12.091515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010295b-71df-4229-9edf-f193d3180f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:12.112800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-0010295b-71df-4229-9edf-f193d3180f7f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:12.114044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-0010295b-71df-4229-9edf-f193d3180f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:12.123458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1203/2441] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:12.127759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7ebdb-77f3-499d-9b22-b4708c59c73f None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:12.138591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7ebdb-77f3-499d-9b22-b4708c59c73f None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:12.143302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161070d-63dc-4967-a40f-1f69357e984d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:12.144062 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161070d-63dc-4967-a40f-1f69357e984d admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:12.144353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161070d-63dc-4967-a40f-1f69357e984d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:12.144638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161070d-63dc-4967-a40f-1f69357e984d admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:12.145514 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161070d-63dc-4967-a40f-1f69357e984d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:05:12.145846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161070d-63dc-4967-a40f-1f69357e984d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:12.147508 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161070d-63dc-4967-a40f-1f69357e984d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:12.161524 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1239/2442] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:05:12.166276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010295b-71df-4229-9edf-f193d3180f7f None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:12.172847 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:12.178081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010295b-71df-4229-9edf-f193d3180f7f None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:12.185344 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bcb9c-b044-424f-9d09-7599b367c87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:12.188321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bcb9c-b044-424f-9d09-7599b367c87c admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:12.188321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bcb9c-b044-424f-9d09-7599b367c87c admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:12.188321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bcb9c-b044-424f-9d09-7599b367c87c admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:12.188321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2bcb9c-b044-424f-9d09-7599b367c87c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:12.189825 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2bcb9c-b044-424f-9d09-7599b367c87c admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:12.294805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1204/2443] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:05:12 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:12.298591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161070d-63dc-4967-a40f-1f69357e984d admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:12.309141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161070d-63dc-4967-a40f-1f69357e984d admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:12.373461 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e83fee-eb0f-4be5-8af8-27b13faa754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:12.374389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e83fee-eb0f-4be5-8af8-27b13faa754e admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:12.374792 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e83fee-eb0f-4be5-8af8-27b13faa754e admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:12.375172 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e83fee-eb0f-4be5-8af8-27b13faa754e admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:12.376010 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e83fee-eb0f-4be5-8af8-27b13faa754e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:12.378208 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e83fee-eb0f-4be5-8af8-27b13faa754e admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:12.526554 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1240/2444] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:05:12 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:12.530498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bcb9c-b044-424f-9d09-7599b367c87c admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:12.541255 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bcb9c-b044-424f-9d09-7599b367c87c admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:12.546581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a53e3-3f3e-41a7-b643-53be934857f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:12.547358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a53e3-3f3e-41a7-b643-53be934857f6 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:12.547648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a53e3-3f3e-41a7-b643-53be934857f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:12.548017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a53e3-3f3e-41a7-b643-53be934857f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:12.548821 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a53e3-3f3e-41a7-b643-53be934857f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:12.550558 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a53e3-3f3e-41a7-b643-53be934857f6 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:12.561801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1205/2445] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:05:12.565691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e83fee-eb0f-4be5-8af8-27b13faa754e admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:12.575407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:12.580648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e83fee-eb0f-4be5-8af8-27b13faa754e admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:12.586688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661a69b-01b0-432c-8ac7-cf9fb86014b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:12.587910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661a69b-01b0-432c-8ac7-cf9fb86014b0 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:12.588203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661a69b-01b0-432c-8ac7-cf9fb86014b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:12.588541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661a69b-01b0-432c-8ac7-cf9fb86014b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:12.589709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661a69b-01b0-432c-8ac7-cf9fb86014b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:12.592064 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661a69b-01b0-432c-8ac7-cf9fb86014b0 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:12.608469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1241/2446] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:12.612513 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a53e3-3f3e-41a7-b643-53be934857f6 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:12.623602 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a53e3-3f3e-41a7-b643-53be934857f6 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:12.628767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb833fd-83e7-4267-b562-b3da58296fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:12.629654 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb833fd-83e7-4267-b562-b3da58296fff admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:12.629937 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb833fd-83e7-4267-b562-b3da58296fff admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:12.630218 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb833fd-83e7-4267-b562-b3da58296fff admin admin] PATH_INFO: `/v3/projects/c02c5d76c9a545258f1d28ad20fedceb/users/05214484a892486b923d77ba46e8b72d/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:12.645856 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb833fd-83e7-4267-b562-b3da58296fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c02c5d76c9a545258f1d28ad20fedceb, user_id=05214484a892486b923d77ba46e8b72d, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:12.648991 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb833fd-83e7-4267-b562-b3da58296fff admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:12.741217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1206/2447] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:05:12 2022] PUT /identity/v3/projects/c02c5d76c9a545258f1d28ad20fedceb/users/05214484a892486b923d77ba46e8b72d/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:12.752064 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3715b-45bc-4865-8152-1c8e7e73616a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:12.752292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3715b-45bc-4865-8152-1c8e7e73616a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:12.752575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3715b-45bc-4865-8152-1c8e7e73616a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:12.779692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-97d3715b-45bc-4865-8152-1c8e7e73616a None None] MFA Rules not processed for user `05214484a892486b923d77ba46e8b72d`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:12.780920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-97d3715b-45bc-4865-8152-1c8e7e73616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:12.845786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1242/2448] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:12.850381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb833fd-83e7-4267-b562-b3da58296fff admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:12.920233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb833fd-83e7-4267-b562-b3da58296fff admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:12.925247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b24d0-8066-4258-a1cf-d20d46da8410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:12.926019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b24d0-8066-4258-a1cf-d20d46da8410 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:12.926213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b24d0-8066-4258-a1cf-d20d46da8410 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:12.926655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b24d0-8066-4258-a1cf-d20d46da8410 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:12.927374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b24d0-8066-4258-a1cf-d20d46da8410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:12.929338 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b24d0-8066-4258-a1cf-d20d46da8410 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:13.024457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1207/2449] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:05:12 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:13.026480 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3715b-45bc-4865-8152-1c8e7e73616a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:13.037818 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3715b-45bc-4865-8152-1c8e7e73616a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:13.105831 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecc0ee-c60a-4b91-bf85-3df74a836036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:13.106559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecc0ee-c60a-4b91-bf85-3df74a836036 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:13.106851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecc0ee-c60a-4b91-bf85-3df74a836036 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:13.107132 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecc0ee-c60a-4b91-bf85-3df74a836036 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:13.107877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecc0ee-c60a-4b91-bf85-3df74a836036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:13.110260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecc0ee-c60a-4b91-bf85-3df74a836036 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:13.192678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1243/2450] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:05:13 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:13.196784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b24d0-8066-4258-a1cf-d20d46da8410 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:13.207035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b24d0-8066-4258-a1cf-d20d46da8410 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:13.211680 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2290e8b-d015-4cd7-9189-b0ae78af54be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:13.212992 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2290e8b-d015-4cd7-9189-b0ae78af54be admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:13.213279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2290e8b-d015-4cd7-9189-b0ae78af54be admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:13.213557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2290e8b-d015-4cd7-9189-b0ae78af54be admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:13.214287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2290e8b-d015-4cd7-9189-b0ae78af54be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:13.217858 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2290e8b-d015-4cd7-9189-b0ae78af54be admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:13.230754 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1208/2451] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:13.231952 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecc0ee-c60a-4b91-bf85-3df74a836036 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:13.242154 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecc0ee-c60a-4b91-bf85-3df74a836036 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:13.246999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952db075-1056-4feb-b9f1-382ab47316a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:13.247887 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952db075-1056-4feb-b9f1-382ab47316a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:13.248174 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952db075-1056-4feb-b9f1-382ab47316a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:13.248458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952db075-1056-4feb-b9f1-382ab47316a8 admin admin] PATH_INFO: `/v3/projects/ea81ec1a6456432ba42aba3e3b1b1873/users/023d60d9d8314eee813645754111210e/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:13.263263 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952db075-1056-4feb-b9f1-382ab47316a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea81ec1a6456432ba42aba3e3b1b1873, user_id=023d60d9d8314eee813645754111210e, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:13.266002 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952db075-1056-4feb-b9f1-382ab47316a8 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:13.364561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1244/2452] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:05:13 2022] PUT /identity/v3/projects/ea81ec1a6456432ba42aba3e3b1b1873/users/023d60d9d8314eee813645754111210e/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:13.368673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2290e8b-d015-4cd7-9189-b0ae78af54be admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:13.378734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2290e8b-d015-4cd7-9189-b0ae78af54be admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:13.436283 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c289f6-7507-4bf5-b61f-2f9710fbdaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:13.436958 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c289f6-7507-4bf5-b61f-2f9710fbdaa9 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:13.437246 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c289f6-7507-4bf5-b61f-2f9710fbdaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:13.437530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c289f6-7507-4bf5-b61f-2f9710fbdaa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:13.438255 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c289f6-7507-4bf5-b61f-2f9710fbdaa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:13.439890 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c289f6-7507-4bf5-b61f-2f9710fbdaa9 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:13.450021 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1209/2453] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:13.454236 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952db075-1056-4feb-b9f1-382ab47316a8 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:13.464947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952db075-1056-4feb-b9f1-382ab47316a8 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:13.469592 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9b43a-9eb9-4760-ad52-a355091e7e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:13.470515 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b43a-9eb9-4760-ad52-a355091e7e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:13.470809 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b43a-9eb9-4760-ad52-a355091e7e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:13.471098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b43a-9eb9-4760-ad52-a355091e7e2d admin admin] PATH_INFO: `/v3/projects/ea81ec1a6456432ba42aba3e3b1b1873/users/023d60d9d8314eee813645754111210e/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:13.473104 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9b43a-9eb9-4760-ad52-a355091e7e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea81ec1a6456432ba42aba3e3b1b1873, user_id=023d60d9d8314eee813645754111210e, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:13.475905 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9b43a-9eb9-4760-ad52-a355091e7e2d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:13.487303 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1245/2454] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:05:13 2022] PUT /identity/v3/projects/ea81ec1a6456432ba42aba3e3b1b1873/users/023d60d9d8314eee813645754111210e/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:13.498326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309b220-92e2-4a54-98a5-34ff86011916 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:13.498652 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309b220-92e2-4a54-98a5-34ff86011916 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:13.498941 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309b220-92e2-4a54-98a5-34ff86011916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:13.526682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-2309b220-92e2-4a54-98a5-34ff86011916 None None] MFA Rules not processed for user `023d60d9d8314eee813645754111210e`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:13.527816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2309b220-92e2-4a54-98a5-34ff86011916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:13.532783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:13.594641 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1210/2455] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:13.605877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9b43a-9eb9-4760-ad52-a355091e7e2d admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:13.607575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a9f9b43a-9eb9-4760-ad52-a355091e7e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:13.646488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:13.663804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9b43a-9eb9-4760-ad52-a355091e7e2d admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:13.667483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2b9d4-90c5-4101-a9e0-5cb29762156b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:13.668114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2b9d4-90c5-4101-a9e0-5cb29762156b service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:13.668399 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2b9d4-90c5-4101-a9e0-5cb29762156b service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:13.668678 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2b9d4-90c5-4101-a9e0-5cb29762156b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:13.725500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2b9d4-90c5-4101-a9e0-5cb29762156b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:13.726986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2b9d4-90c5-4101-a9e0-5cb29762156b service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:13.735645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1246/2456] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:15.535232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309b220-92e2-4a54-98a5-34ff86011916 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:15.536649 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2309b220-92e2-4a54-98a5-34ff86011916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:15.549826 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2309b220-92e2-4a54-98a5-34ff86011916 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:15.553553 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe0c512-98d9-4870-a348-ed542bee196a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:15.554195 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0c512-98d9-4870-a348-ed542bee196a service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:15.554542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0c512-98d9-4870-a348-ed542bee196a service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:15.554839 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0c512-98d9-4870-a348-ed542bee196a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:15.564186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0c512-98d9-4870-a348-ed542bee196a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:15.566127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe0c512-98d9-4870-a348-ed542bee196a service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:15.576198 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1211/2457] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:19.903599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2b9d4-90c5-4101-a9e0-5cb29762156b service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:19.963870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2b9d4-90c5-4101-a9e0-5cb29762156b service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:19.968371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46a6fc-f5cd-4471-aff5-896b40ffa3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:19.969236 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46a6fc-f5cd-4471-aff5-896b40ffa3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:19.969524 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46a6fc-f5cd-4471-aff5-896b40ffa3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:19.969805 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46a6fc-f5cd-4471-aff5-896b40ffa3cd admin admin] PATH_INFO: `/v3/users/05214484a892486b923d77ba46e8b72d` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:19.970979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46a6fc-f5cd-4471-aff5-896b40ffa3cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=05214484a892486b923d77ba46e8b72d)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:19.972907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46a6fc-f5cd-4471-aff5-896b40ffa3cd admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:20.151892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-0c46a6fc-f5cd-4471-aff5-896b40ffa3cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05214484a892486b923d77ba46e8b72d'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:20.232012 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-0c46a6fc-f5cd-4471-aff5-896b40ffa3cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05214484a892486b923d77ba46e8b72d'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:20.232646 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-0c46a6fc-f5cd-4471-aff5-896b40ffa3cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05214484a892486b923d77ba46e8b72d'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:20.239807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-0c46a6fc-f5cd-4471-aff5-896b40ffa3cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05214484a892486b923d77ba46e8b72d'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:20.252786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-0c46a6fc-f5cd-4471-aff5-896b40ffa3cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05214484a892486b923d77ba46e8b72d'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:20.258763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1247/2458] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:05:19 2022] DELETE /identity/v3/users/05214484a892486b923d77ba46e8b72d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:20.263983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f280de3-f9fe-4248-9be2-4e9dad6eb720 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:20.264444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f280de3-f9fe-4248-9be2-4e9dad6eb720 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:20.264573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f280de3-f9fe-4248-9be2-4e9dad6eb720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:20.282199 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-9f280de3-f9fe-4248-9be2-4e9dad6eb720 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:20.283416 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9f280de3-f9fe-4248-9be2-4e9dad6eb720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:20.340840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1212/2459] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:20.350397 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46a6fc-f5cd-4471-aff5-896b40ffa3cd admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:20.351819 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-0c46a6fc-f5cd-4471-aff5-896b40ffa3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:20.362920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:20.408387 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46a6fc-f5cd-4471-aff5-896b40ffa3cd admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:20.411973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498673cd-1f1f-4e63-9837-40142315c32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:20.415625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498673cd-1f1f-4e63-9837-40142315c32a service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:20.415625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498673cd-1f1f-4e63-9837-40142315c32a service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:20.415625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498673cd-1f1f-4e63-9837-40142315c32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:20.423088 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498673cd-1f1f-4e63-9837-40142315c32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:20.424547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498673cd-1f1f-4e63-9837-40142315c32a service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:20.434491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1248/2460] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:20.888468 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f280de3-f9fe-4248-9be2-4e9dad6eb720 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:20.889880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9f280de3-f9fe-4248-9be2-4e9dad6eb720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:20.902320 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f280de3-f9fe-4248-9be2-4e9dad6eb720 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:20.907564 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e45ef-a997-4b3a-80a2-ab3bcea1653a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:20.908460 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e45ef-a997-4b3a-80a2-ab3bcea1653a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:20.908720 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e45ef-a997-4b3a-80a2-ab3bcea1653a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:20.909001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e45ef-a997-4b3a-80a2-ab3bcea1653a admin admin] PATH_INFO: `/v3/projects/c02c5d76c9a545258f1d28ad20fedceb` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:20.910201 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e45ef-a997-4b3a-80a2-ab3bcea1653a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c02c5d76c9a545258f1d28ad20fedceb)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:20.912150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e45ef-a997-4b3a-80a2-ab3bcea1653a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:21.027081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-660e45ef-a997-4b3a-80a2-ab3bcea1653a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c02c5d76c9a545258f1d28ad20fedceb', 'request_id': 'req-660e45ef-a997-4b3a-80a2-ab3bcea1653a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:21.157721 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-660e45ef-a997-4b3a-80a2-ab3bcea1653a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c02c5d76c9a545258f1d28ad20fedceb', 'request_id': 'req-660e45ef-a997-4b3a-80a2-ab3bcea1653a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:21.164601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-660e45ef-a997-4b3a-80a2-ab3bcea1653a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c02c5d76c9a545258f1d28ad20fedceb', 'request_id': 'req-660e45ef-a997-4b3a-80a2-ab3bcea1653a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:21.176540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-660e45ef-a997-4b3a-80a2-ab3bcea1653a admin admin] The token cache is being invalidate because project c02c5d76c9a545258f1d28ad20fedceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:05:21.176836 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-660e45ef-a997-4b3a-80a2-ab3bcea1653a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:21.177475 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-660e45ef-a997-4b3a-80a2-ab3bcea1653a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:21.179134 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1213/2461] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:05:20 2022] DELETE /identity/v3/projects/c02c5d76c9a545258f1d28ad20fedceb => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:21.183156 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498673cd-1f1f-4e63-9837-40142315c32a service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:21.192807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498673cd-1f1f-4e63-9837-40142315c32a service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:21.249372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ca2e4-7908-4c2a-ac2d-fc335b9a4afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:21.250252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ca2e4-7908-4c2a-ac2d-fc335b9a4afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:21.250579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ca2e4-7908-4c2a-ac2d-fc335b9a4afe admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:21.250864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ca2e4-7908-4c2a-ac2d-fc335b9a4afe admin admin] PATH_INFO: `/v3/users/023d60d9d8314eee813645754111210e` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:21.252040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ca2e4-7908-4c2a-ac2d-fc335b9a4afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=023d60d9d8314eee813645754111210e)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:21.254034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ca2e4-7908-4c2a-ac2d-fc335b9a4afe admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:21.491466 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c07ca2e4-7908-4c2a-ac2d-fc335b9a4afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '023d60d9d8314eee813645754111210e'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:21.580486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c07ca2e4-7908-4c2a-ac2d-fc335b9a4afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '023d60d9d8314eee813645754111210e'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:21.581208 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c07ca2e4-7908-4c2a-ac2d-fc335b9a4afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '023d60d9d8314eee813645754111210e'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:21.588486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c07ca2e4-7908-4c2a-ac2d-fc335b9a4afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '023d60d9d8314eee813645754111210e'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:21.600426 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-c07ca2e4-7908-4c2a-ac2d-fc335b9a4afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '023d60d9d8314eee813645754111210e'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:21.606503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1249/2462] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:05:21 2022] DELETE /identity/v3/users/023d60d9d8314eee813645754111210e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:22.016900 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e45ef-a997-4b3a-80a2-ab3bcea1653a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:22.018449 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-660e45ef-a997-4b3a-80a2-ab3bcea1653a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:22.033113 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e45ef-a997-4b3a-80a2-ab3bcea1653a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:22.043663 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:22.091963 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02131972-87b9-45eb-821b-d2d10373271e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:22.093339 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02131972-87b9-45eb-821b-d2d10373271e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:22.093619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02131972-87b9-45eb-821b-d2d10373271e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:22.093897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02131972-87b9-45eb-821b-d2d10373271e admin admin] PATH_INFO: `/v3/projects/ea81ec1a6456432ba42aba3e3b1b1873` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:22.095121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02131972-87b9-45eb-821b-d2d10373271e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea81ec1a6456432ba42aba3e3b1b1873)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:22.097036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02131972-87b9-45eb-821b-d2d10373271e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:22.243290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-02131972-87b9-45eb-821b-d2d10373271e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea81ec1a6456432ba42aba3e3b1b1873', 'request_id': 'req-02131972-87b9-45eb-821b-d2d10373271e'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:22.344969 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-02131972-87b9-45eb-821b-d2d10373271e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea81ec1a6456432ba42aba3e3b1b1873', 'request_id': 'req-02131972-87b9-45eb-821b-d2d10373271e'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:22.351919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-02131972-87b9-45eb-821b-d2d10373271e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea81ec1a6456432ba42aba3e3b1b1873', 'request_id': 'req-02131972-87b9-45eb-821b-d2d10373271e'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:22.362853 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-02131972-87b9-45eb-821b-d2d10373271e admin admin] The token cache is being invalidate because project ea81ec1a6456432ba42aba3e3b1b1873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:05:22.363141 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-02131972-87b9-45eb-821b-d2d10373271e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:22.363778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-02131972-87b9-45eb-821b-d2d10373271e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:22.365427 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1214/2463] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:05:22 2022] DELETE /identity/v3/projects/ea81ec1a6456432ba42aba3e3b1b1873 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:22.370294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f44460-e324-4709-8197-2fc484f0398a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:22.373447 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f44460-e324-4709-8197-2fc484f0398a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:22.373447 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f44460-e324-4709-8197-2fc484f0398a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:22.388737 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-39f44460-e324-4709-8197-2fc484f0398a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:22.389918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-39f44460-e324-4709-8197-2fc484f0398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:22.415106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:22.449366 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1250/2464] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:22.457585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2816d-6d90-4008-9a85-4675997add0b None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:22.457885 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2816d-6d90-4008-9a85-4675997add0b None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:22.458189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2816d-6d90-4008-9a85-4675997add0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:22.477287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-cce2816d-6d90-4008-9a85-4675997add0b None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:22.478522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cce2816d-6d90-4008-9a85-4675997add0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:22.486537 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1215/2465] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:22.490682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f44460-e324-4709-8197-2fc484f0398a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:22.500420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f44460-e324-4709-8197-2fc484f0398a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:22.505161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945d28b-6753-4440-a709-0fba45d2c11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:22.505821 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945d28b-6753-4440-a709-0fba45d2c11f admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:22.506112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945d28b-6753-4440-a709-0fba45d2c11f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:22.506450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945d28b-6753-4440-a709-0fba45d2c11f admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:22.507189 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945d28b-6753-4440-a709-0fba45d2c11f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:05:22.507503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945d28b-6753-4440-a709-0fba45d2c11f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:22.509108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a945d28b-6753-4440-a709-0fba45d2c11f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:22.521427 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1251/2466] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:05:22.526040 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2816d-6d90-4008-9a85-4675997add0b None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:22.536125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2816d-6d90-4008-9a85-4675997add0b None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:22.540887 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176e89e-b4cb-44c8-af26-e660c611de3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:22.541538 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176e89e-b4cb-44c8-af26-e660c611de3d admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:22.541860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176e89e-b4cb-44c8-af26-e660c611de3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:22.542147 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176e89e-b4cb-44c8-af26-e660c611de3d admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:22.542886 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176e89e-b4cb-44c8-af26-e660c611de3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:22.545070 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176e89e-b4cb-44c8-af26-e660c611de3d admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:22.625496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1216/2467] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:05:22 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:22.629455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945d28b-6753-4440-a709-0fba45d2c11f admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:22.639454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945d28b-6753-4440-a709-0fba45d2c11f admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:22.695338 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b79395-86d7-4eed-b73d-a163938ea75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:22.696013 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b79395-86d7-4eed-b73d-a163938ea75c admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:22.696300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b79395-86d7-4eed-b73d-a163938ea75c admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:22.696585 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b79395-86d7-4eed-b73d-a163938ea75c admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:22.697277 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b79395-86d7-4eed-b73d-a163938ea75c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:22.699255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b79395-86d7-4eed-b73d-a163938ea75c admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:22.775819 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1252/2468] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:05:22 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:22.779791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176e89e-b4cb-44c8-af26-e660c611de3d admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:22.790786 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176e89e-b4cb-44c8-af26-e660c611de3d admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:22.795379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a43b1a-a726-4c2e-a21a-dd8d6182c47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:22.796037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a43b1a-a726-4c2e-a21a-dd8d6182c47f admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:22.796327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a43b1a-a726-4c2e-a21a-dd8d6182c47f admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:22.796612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a43b1a-a726-4c2e-a21a-dd8d6182c47f admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:22.797334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a43b1a-a726-4c2e-a21a-dd8d6182c47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:22.798977 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a43b1a-a726-4c2e-a21a-dd8d6182c47f admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:22.809222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1217/2469] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:22.813047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b79395-86d7-4eed-b73d-a163938ea75c admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:22.823244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b79395-86d7-4eed-b73d-a163938ea75c admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:22.828470 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c1956-84d3-4479-950e-fc41ba686d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:22.829128 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c1956-84d3-4479-950e-fc41ba686d39 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:22.829419 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c1956-84d3-4479-950e-fc41ba686d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:22.829731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c1956-84d3-4479-950e-fc41ba686d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:22.830507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c1956-84d3-4479-950e-fc41ba686d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:22.832143 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c1956-84d3-4479-950e-fc41ba686d39 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:22.842081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1253/2470] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:22.846926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a43b1a-a726-4c2e-a21a-dd8d6182c47f admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:22.856816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a43b1a-a726-4c2e-a21a-dd8d6182c47f admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:22.861693 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144aea3d-28d9-4fee-b50d-38435c9cff71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:22.862585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144aea3d-28d9-4fee-b50d-38435c9cff71 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:22.862869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144aea3d-28d9-4fee-b50d-38435c9cff71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:22.863149 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144aea3d-28d9-4fee-b50d-38435c9cff71 admin admin] PATH_INFO: `/v3/projects/63d8378a35a747c4a21a4a2b7012c5c7/users/db93efbd9f744e04be6eb1d5cdb1dd9a/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:22.877910 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144aea3d-28d9-4fee-b50d-38435c9cff71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d8378a35a747c4a21a4a2b7012c5c7, user_id=db93efbd9f744e04be6eb1d5cdb1dd9a, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:22.880518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144aea3d-28d9-4fee-b50d-38435c9cff71 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:22.963641 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1218/2471] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:05:22 2022] PUT /identity/v3/projects/63d8378a35a747c4a21a4a2b7012c5c7/users/db93efbd9f744e04be6eb1d5cdb1dd9a/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:22.973914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d1393-9cdb-4f63-abbf-8edb580adc18 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:22.974215 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d1393-9cdb-4f63-abbf-8edb580adc18 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:22.974536 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d1393-9cdb-4f63-abbf-8edb580adc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:23.001625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-b60d1393-9cdb-4f63-abbf-8edb580adc18 None None] MFA Rules not processed for user `db93efbd9f744e04be6eb1d5cdb1dd9a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:23.002871 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b60d1393-9cdb-4f63-abbf-8edb580adc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:23.065628 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1254/2472] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:23.070021 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144aea3d-28d9-4fee-b50d-38435c9cff71 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:23.111744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:23.130666 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144aea3d-28d9-4fee-b50d-38435c9cff71 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:23.135283 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6aebe-f881-4abc-80ed-395f60f8bfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:23.135937 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6aebe-f881-4abc-80ed-395f60f8bfae admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:23.136231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6aebe-f881-4abc-80ed-395f60f8bfae admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:23.136518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6aebe-f881-4abc-80ed-395f60f8bfae admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:23.137227 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6aebe-f881-4abc-80ed-395f60f8bfae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:23.139173 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6aebe-f881-4abc-80ed-395f60f8bfae admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:23.228171 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1219/2473] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:05:23 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:23.232157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d1393-9cdb-4f63-abbf-8edb580adc18 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:23.243542 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d1393-9cdb-4f63-abbf-8edb580adc18 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:23.268103 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:23.300628 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641c2a6-cd77-40c4-a1e1-59e626f79bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:23.301308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641c2a6-cd77-40c4-a1e1-59e626f79bbe admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:23.301606 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641c2a6-cd77-40c4-a1e1-59e626f79bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:23.301891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641c2a6-cd77-40c4-a1e1-59e626f79bbe admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:23.302660 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641c2a6-cd77-40c4-a1e1-59e626f79bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:23.304611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641c2a6-cd77-40c4-a1e1-59e626f79bbe admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:23.407458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1255/2474] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:05:23 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:23.411340 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6aebe-f881-4abc-80ed-395f60f8bfae admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:23.422258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6aebe-f881-4abc-80ed-395f60f8bfae admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:23.428370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da417c0c-edf6-47b1-9cb1-6f6601d6bcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:23.429038 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da417c0c-edf6-47b1-9cb1-6f6601d6bcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:23.429327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da417c0c-edf6-47b1-9cb1-6f6601d6bcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:23.439022 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da417c0c-edf6-47b1-9cb1-6f6601d6bcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:23.439022 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da417c0c-edf6-47b1-9cb1-6f6601d6bcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:23.439022 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da417c0c-edf6-47b1-9cb1-6f6601d6bcd8 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:23.443191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1220/2475] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:05:23.447312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641c2a6-cd77-40c4-a1e1-59e626f79bbe admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:23.457911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641c2a6-cd77-40c4-a1e1-59e626f79bbe admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:23.462744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea37c1b-f97d-4888-bf2e-33b3b6c45a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:23.463624 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea37c1b-f97d-4888-bf2e-33b3b6c45a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:23.463913 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea37c1b-f97d-4888-bf2e-33b3b6c45a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:23.464197 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea37c1b-f97d-4888-bf2e-33b3b6c45a06 admin admin] PATH_INFO: `/v3/projects/373525917e0f432ead8e5d64b1db308f/users/ef652d2f09d546298b386755efbe725b/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:23.481010 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea37c1b-f97d-4888-bf2e-33b3b6c45a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373525917e0f432ead8e5d64b1db308f, user_id=ef652d2f09d546298b386755efbe725b, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:23.484256 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea37c1b-f97d-4888-bf2e-33b3b6c45a06 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:23.607190 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1256/2476] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:05:23 2022] PUT /identity/v3/projects/373525917e0f432ead8e5d64b1db308f/users/ef652d2f09d546298b386755efbe725b/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:23.611923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da417c0c-edf6-47b1-9cb1-6f6601d6bcd8 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:23.622106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da417c0c-edf6-47b1-9cb1-6f6601d6bcd8 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:23.678418 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c1066-129a-4a5a-8b1f-24c73628959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:23.679017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c1066-129a-4a5a-8b1f-24c73628959b admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:23.679302 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c1066-129a-4a5a-8b1f-24c73628959b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:23.679573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c1066-129a-4a5a-8b1f-24c73628959b admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:23.680284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c1066-129a-4a5a-8b1f-24c73628959b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:23.681862 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c1066-129a-4a5a-8b1f-24c73628959b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:23.691256 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1221/2477] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:23.695491 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea37c1b-f97d-4888-bf2e-33b3b6c45a06 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:23.705510 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea37c1b-f97d-4888-bf2e-33b3b6c45a06 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:23.710079 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9735ce3-b70f-4a4f-946a-a2015923bde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:23.710994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9735ce3-b70f-4a4f-946a-a2015923bde3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:23.711283 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9735ce3-b70f-4a4f-946a-a2015923bde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:23.711564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9735ce3-b70f-4a4f-946a-a2015923bde3 admin admin] PATH_INFO: `/v3/projects/373525917e0f432ead8e5d64b1db308f/users/ef652d2f09d546298b386755efbe725b/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:23.713525 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9735ce3-b70f-4a4f-946a-a2015923bde3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373525917e0f432ead8e5d64b1db308f, user_id=ef652d2f09d546298b386755efbe725b, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:23.716247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9735ce3-b70f-4a4f-946a-a2015923bde3 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:23.726703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1257/2478] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:05:23 2022] PUT /identity/v3/projects/373525917e0f432ead8e5d64b1db308f/users/ef652d2f09d546298b386755efbe725b/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:23.738275 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0280059-f852-4c03-bb16-b6bcacf13590 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:23.738599 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0280059-f852-4c03-bb16-b6bcacf13590 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:23.738880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0280059-f852-4c03-bb16-b6bcacf13590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:23.764325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b0280059-f852-4c03-bb16-b6bcacf13590 None None] MFA Rules not processed for user `ef652d2f09d546298b386755efbe725b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:23.765510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b0280059-f852-4c03-bb16-b6bcacf13590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:23.832816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1222/2479] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:05:23.844300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9735ce3-b70f-4a4f-946a-a2015923bde3 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:23.846008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d9735ce3-b70f-4a4f-946a-a2015923bde3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:23.901383 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9735ce3-b70f-4a4f-946a-a2015923bde3 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:23.905028 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e05f2d-8072-4c2f-a6c8-8ec1afd152a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:23.905661 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e05f2d-8072-4c2f-a6c8-8ec1afd152a4 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:23.905947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e05f2d-8072-4c2f-a6c8-8ec1afd152a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:23.906758 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e05f2d-8072-4c2f-a6c8-8ec1afd152a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:23.915587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e05f2d-8072-4c2f-a6c8-8ec1afd152a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:23.917025 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e05f2d-8072-4c2f-a6c8-8ec1afd152a4 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:23.926843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1258/2480] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:23.988601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0280059-f852-4c03-bb16-b6bcacf13590 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:24.027518 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:24.050278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0280059-f852-4c03-bb16-b6bcacf13590 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:24.054960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6443b-c237-4496-b40d-c5443aaade9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:24.055836 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6443b-c237-4496-b40d-c5443aaade9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:24.056124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6443b-c237-4496-b40d-c5443aaade9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:24.056408 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6443b-c237-4496-b40d-c5443aaade9b admin admin] PATH_INFO: `/v3/users/db93efbd9f744e04be6eb1d5cdb1dd9a` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:24.057615 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6443b-c237-4496-b40d-c5443aaade9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=db93efbd9f744e04be6eb1d5cdb1dd9a)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:24.059587 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6443b-c237-4496-b40d-c5443aaade9b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:24.308649 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-8df6443b-c237-4496-b40d-c5443aaade9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db93efbd9f744e04be6eb1d5cdb1dd9a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:24.309310 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-8df6443b-c237-4496-b40d-c5443aaade9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db93efbd9f744e04be6eb1d5cdb1dd9a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:24.375743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-8df6443b-c237-4496-b40d-c5443aaade9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db93efbd9f744e04be6eb1d5cdb1dd9a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:24.387809 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-8df6443b-c237-4496-b40d-c5443aaade9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db93efbd9f744e04be6eb1d5cdb1dd9a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:24.395435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-8df6443b-c237-4496-b40d-c5443aaade9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db93efbd9f744e04be6eb1d5cdb1dd9a'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:24.401570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1223/2481] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:05:23 2022] DELETE /identity/v3/users/db93efbd9f744e04be6eb1d5cdb1dd9a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:24.406097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e1110-3ee8-4d89-b7ec-6a7d78c69d29 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:24.406442 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e1110-3ee8-4d89-b7ec-6a7d78c69d29 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:24.406730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e1110-3ee8-4d89-b7ec-6a7d78c69d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:24.424009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-780e1110-3ee8-4d89-b7ec-6a7d78c69d29 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:24.425199 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-780e1110-3ee8-4d89-b7ec-6a7d78c69d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:24.485346 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1259/2482] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:24.495049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6443b-c237-4496-b40d-c5443aaade9b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:24.496671 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-8df6443b-c237-4496-b40d-c5443aaade9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:24.553620 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6443b-c237-4496-b40d-c5443aaade9b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:24.557319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d029f-cfd5-41d0-99ea-f77f9b414aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:24.557968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d029f-cfd5-41d0-99ea-f77f9b414aee service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:24.558259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d029f-cfd5-41d0-99ea-f77f9b414aee service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:24.558575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d029f-cfd5-41d0-99ea-f77f9b414aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:24.568186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d029f-cfd5-41d0-99ea-f77f9b414aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:24.569565 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d029f-cfd5-41d0-99ea-f77f9b414aee service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:24.579593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1224/2483] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:24.976782 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e1110-3ee8-4d89-b7ec-6a7d78c69d29 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:24.978214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-780e1110-3ee8-4d89-b7ec-6a7d78c69d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:24.990646 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e1110-3ee8-4d89-b7ec-6a7d78c69d29 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:24.995324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:24.996188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:24.996481 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:24.996764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca admin admin] PATH_INFO: `/v3/projects/63d8378a35a747c4a21a4a2b7012c5c7` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:24.997974 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d8378a35a747c4a21a4a2b7012c5c7)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:24.999980 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:25.017879 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:25.147173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d8378a35a747c4a21a4a2b7012c5c7', 'request_id': 'req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:25.153483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d8378a35a747c4a21a4a2b7012c5c7', 'request_id': 'req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:25.159710 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d8378a35a747c4a21a4a2b7012c5c7', 'request_id': 'req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:25.237643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca admin admin] The token cache is being invalidate because project 63d8378a35a747c4a21a4a2b7012c5c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:05:25.237935 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:25.238575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:25.240146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1260/2484] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:05:24 2022] DELETE /identity/v3/projects/63d8378a35a747c4a21a4a2b7012c5c7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:25.244083 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d029f-cfd5-41d0-99ea-f77f9b414aee service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:25.253659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d029f-cfd5-41d0-99ea-f77f9b414aee service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:25.304141 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:25.309875 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50377d06-d38e-4078-b1c6-a3f268497048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:25.310780 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50377d06-d38e-4078-b1c6-a3f268497048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:25.311069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50377d06-d38e-4078-b1c6-a3f268497048 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:25.311352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50377d06-d38e-4078-b1c6-a3f268497048 admin admin] PATH_INFO: `/v3/users/ef652d2f09d546298b386755efbe725b` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:25.312534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50377d06-d38e-4078-b1c6-a3f268497048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef652d2f09d546298b386755efbe725b)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:25.314530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50377d06-d38e-4078-b1c6-a3f268497048 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:25.489484 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-50377d06-d38e-4078-b1c6-a3f268497048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef652d2f09d546298b386755efbe725b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:25.490196 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-50377d06-d38e-4078-b1c6-a3f268497048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef652d2f09d546298b386755efbe725b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:25.552191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-50377d06-d38e-4078-b1c6-a3f268497048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef652d2f09d546298b386755efbe725b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:25.564824 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-50377d06-d38e-4078-b1c6-a3f268497048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef652d2f09d546298b386755efbe725b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:25.571896 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-50377d06-d38e-4078-b1c6-a3f268497048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef652d2f09d546298b386755efbe725b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:25.577814 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1225/2485] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:05:25 2022] DELETE /identity/v3/users/ef652d2f09d546298b386755efbe725b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:26.045371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:26.046864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:26.062347 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b9c0f-3f3e-4d16-9b24-e038c05d46ca admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:26.120501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bd344-90f5-40e5-a1d1-eec17fce50b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:26.121365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd344-90f5-40e5-a1d1-eec17fce50b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:26.121649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd344-90f5-40e5-a1d1-eec17fce50b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:26.121925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd344-90f5-40e5-a1d1-eec17fce50b2 admin admin] PATH_INFO: `/v3/projects/373525917e0f432ead8e5d64b1db308f` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:26.123127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bd344-90f5-40e5-a1d1-eec17fce50b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=373525917e0f432ead8e5d64b1db308f)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:26.125047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bd344-90f5-40e5-a1d1-eec17fce50b2 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:26.255401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-335bd344-90f5-40e5-a1d1-eec17fce50b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373525917e0f432ead8e5d64b1db308f', 'request_id': 'req-335bd344-90f5-40e5-a1d1-eec17fce50b2'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:26.261516 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-335bd344-90f5-40e5-a1d1-eec17fce50b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373525917e0f432ead8e5d64b1db308f', 'request_id': 'req-335bd344-90f5-40e5-a1d1-eec17fce50b2'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:26.267084 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-335bd344-90f5-40e5-a1d1-eec17fce50b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373525917e0f432ead8e5d64b1db308f', 'request_id': 'req-335bd344-90f5-40e5-a1d1-eec17fce50b2'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:26.343719 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-335bd344-90f5-40e5-a1d1-eec17fce50b2 admin admin] The token cache is being invalidate because project 373525917e0f432ead8e5d64b1db308f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:05:26.343940 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-335bd344-90f5-40e5-a1d1-eec17fce50b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:26.344552 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-335bd344-90f5-40e5-a1d1-eec17fce50b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:26.346105 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1261/2486] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:05:26 2022] DELETE /identity/v3/projects/373525917e0f432ead8e5d64b1db308f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:26.351063 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f5488-39a7-4622-a320-09b70ee388c6 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:26.351539 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f5488-39a7-4622-a320-09b70ee388c6 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:26.351646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f5488-39a7-4622-a320-09b70ee388c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:26.370076 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-903f5488-39a7-4622-a320-09b70ee388c6 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:26.371333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-903f5488-39a7-4622-a320-09b70ee388c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:26.429602 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1226/2487] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:26.437173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587df42-cef5-4c23-9ec0-968686813883 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:26.437472 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587df42-cef5-4c23-9ec0-968686813883 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:26.437756 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587df42-cef5-4c23-9ec0-968686813883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:26.456827 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-1587df42-cef5-4c23-9ec0-968686813883 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:26.458062 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-1587df42-cef5-4c23-9ec0-968686813883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:26.466167 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1262/2488] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:26.470306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f5488-39a7-4622-a320-09b70ee388c6 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:26.480123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f5488-39a7-4622-a320-09b70ee388c6 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:26.484653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22d523-2d26-4e18-9303-b88a6e894500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:26.485846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22d523-2d26-4e18-9303-b88a6e894500 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:26.486132 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22d523-2d26-4e18-9303-b88a6e894500 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:26.486440 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22d523-2d26-4e18-9303-b88a6e894500 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:26.487167 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22d523-2d26-4e18-9303-b88a6e894500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:05:26.487480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22d523-2d26-4e18-9303-b88a6e894500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:26.489061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22d523-2d26-4e18-9303-b88a6e894500 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:26.500368 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1227/2489] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:05:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:05:26.505200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587df42-cef5-4c23-9ec0-968686813883 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:26.514497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587df42-cef5-4c23-9ec0-968686813883 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:26.519689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e02ec-e0e3-45e0-a6c8-7c306e1f471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:26.520346 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e02ec-e0e3-45e0-a6c8-7c306e1f471d admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:26.520635 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e02ec-e0e3-45e0-a6c8-7c306e1f471d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:26.520920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e02ec-e0e3-45e0-a6c8-7c306e1f471d admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:26.521620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e02ec-e0e3-45e0-a6c8-7c306e1f471d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:26.523575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e02ec-e0e3-45e0-a6c8-7c306e1f471d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:26.660441 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1263/2490] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:05:26 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:26.664240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22d523-2d26-4e18-9303-b88a6e894500 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:26.674205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22d523-2d26-4e18-9303-b88a6e894500 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:26.730360 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa73218-dd03-4142-bfc3-191e77847b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:26.731052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa73218-dd03-4142-bfc3-191e77847b63 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:26.731343 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa73218-dd03-4142-bfc3-191e77847b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:26.731627 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa73218-dd03-4142-bfc3-191e77847b63 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:26.732328 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa73218-dd03-4142-bfc3-191e77847b63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:26.734245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa73218-dd03-4142-bfc3-191e77847b63 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:26.742677 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:26.855143 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1228/2491] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:05:26 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:26.859371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e02ec-e0e3-45e0-a6c8-7c306e1f471d admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:26.869457 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e02ec-e0e3-45e0-a6c8-7c306e1f471d admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:26.873956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4efd0-b6df-4e55-9757-a7df38ff96c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:26.874652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4efd0-b6df-4e55-9757-a7df38ff96c6 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:26.874940 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4efd0-b6df-4e55-9757-a7df38ff96c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:26.875220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4efd0-b6df-4e55-9757-a7df38ff96c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:26.876451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4efd0-b6df-4e55-9757-a7df38ff96c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:26.878086 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4efd0-b6df-4e55-9757-a7df38ff96c6 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:26.879349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:26.888718 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1264/2492] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:26.896455 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa73218-dd03-4142-bfc3-191e77847b63 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:26.906529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa73218-dd03-4142-bfc3-191e77847b63 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:26.911303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8e014-d634-45f2-9342-5620cf404372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:26.911893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8e014-d634-45f2-9342-5620cf404372 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:26.912178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8e014-d634-45f2-9342-5620cf404372 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:26.912458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8e014-d634-45f2-9342-5620cf404372 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:26.913177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8e014-d634-45f2-9342-5620cf404372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:26.914840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8e014-d634-45f2-9342-5620cf404372 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:26.925705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1229/2493] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:26.929800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4efd0-b6df-4e55-9757-a7df38ff96c6 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:26.941799 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4efd0-b6df-4e55-9757-a7df38ff96c6 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:26.947383 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191c90d-8bfc-4f74-a7e1-5b21843b6f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:26.948312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191c90d-8bfc-4f74-a7e1-5b21843b6f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:26.948604 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191c90d-8bfc-4f74-a7e1-5b21843b6f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:26.948883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191c90d-8bfc-4f74-a7e1-5b21843b6f8f admin admin] PATH_INFO: `/v3/projects/29bbe7961d6646fb92d3f58ba17d855e/users/e0e2d3d10c6c4c1f944384d00b37514f/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:26.963068 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191c90d-8bfc-4f74-a7e1-5b21843b6f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=29bbe7961d6646fb92d3f58ba17d855e, user_id=e0e2d3d10c6c4c1f944384d00b37514f, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:26.965731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191c90d-8bfc-4f74-a7e1-5b21843b6f8f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:27.032146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1265/2494] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:05:26 2022] PUT /identity/v3/projects/29bbe7961d6646fb92d3f58ba17d855e/users/e0e2d3d10c6c4c1f944384d00b37514f/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:27.043448 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0d241-d033-473b-89c5-34d47808d82c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:27.043743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0d241-d033-473b-89c5-34d47808d82c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:27.044017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0d241-d033-473b-89c5-34d47808d82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:27.072558 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-74a0d241-d033-473b-89c5-34d47808d82c None None] MFA Rules not processed for user `e0e2d3d10c6c4c1f944384d00b37514f`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:27.073755 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-74a0d241-d033-473b-89c5-34d47808d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:27.137700 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1230/2495] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:27.142161 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191c90d-8bfc-4f74-a7e1-5b21843b6f8f admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:27.203410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191c90d-8bfc-4f74-a7e1-5b21843b6f8f admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:27.208079 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2834ab-e6f6-4894-8d62-d2afc46887c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:27.209865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2834ab-e6f6-4894-8d62-d2afc46887c9 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:27.209865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2834ab-e6f6-4894-8d62-d2afc46887c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:27.209865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2834ab-e6f6-4894-8d62-d2afc46887c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:27.210125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2834ab-e6f6-4894-8d62-d2afc46887c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:27.211882 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2834ab-e6f6-4894-8d62-d2afc46887c9 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:27.334561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1266/2496] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:05:27 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:27.338453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0d241-d033-473b-89c5-34d47808d82c None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:27.349593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0d241-d033-473b-89c5-34d47808d82c None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:27.404412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6a415-4ca8-4894-af71-1e71668a11df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:27.405066 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6a415-4ca8-4894-af71-1e71668a11df admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:27.405353 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6a415-4ca8-4894-af71-1e71668a11df admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:27.405629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6a415-4ca8-4894-af71-1e71668a11df admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:27.406324 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6a415-4ca8-4894-af71-1e71668a11df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:27.408749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6a415-4ca8-4894-af71-1e71668a11df admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:27.505357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1231/2497] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:05:27 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:27.508711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2834ab-e6f6-4894-8d62-d2afc46887c9 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:27.519053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2834ab-e6f6-4894-8d62-d2afc46887c9 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:27.524001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1144a4-a9a4-4fbb-b24f-b3df052ae88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:27.524651 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1144a4-a9a4-4fbb-b24f-b3df052ae88e admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:27.524936 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1144a4-a9a4-4fbb-b24f-b3df052ae88e admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:27.525217 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1144a4-a9a4-4fbb-b24f-b3df052ae88e admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:27.525996 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1144a4-a9a4-4fbb-b24f-b3df052ae88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:27.527659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1144a4-a9a4-4fbb-b24f-b3df052ae88e admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:27.538485 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1267/2498] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:27.542170 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6a415-4ca8-4894-af71-1e71668a11df admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:27.552722 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6a415-4ca8-4894-af71-1e71668a11df admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:27.557281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b75fa-2441-4f1f-a714-cd251e379c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:27.557933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b75fa-2441-4f1f-a714-cd251e379c44 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:27.558221 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b75fa-2441-4f1f-a714-cd251e379c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:27.558540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b75fa-2441-4f1f-a714-cd251e379c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:27.559265 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b75fa-2441-4f1f-a714-cd251e379c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:27.561021 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b75fa-2441-4f1f-a714-cd251e379c44 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:27.570867 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1232/2499] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:05:27.574957 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1144a4-a9a4-4fbb-b24f-b3df052ae88e admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:27.584778 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1144a4-a9a4-4fbb-b24f-b3df052ae88e admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:27.589383 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a310530-49cf-48e8-a52b-ddd217742458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:27.590255 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a310530-49cf-48e8-a52b-ddd217742458 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:27.590577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a310530-49cf-48e8-a52b-ddd217742458 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:27.590861 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a310530-49cf-48e8-a52b-ddd217742458 admin admin] PATH_INFO: `/v3/projects/fb907deefbd64ee7ba2d2cd04abba964/users/0730b21cf81e4fe68aec2371353c3108/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:27.606691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a310530-49cf-48e8-a52b-ddd217742458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb907deefbd64ee7ba2d2cd04abba964, user_id=0730b21cf81e4fe68aec2371353c3108, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:27.609342 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a310530-49cf-48e8-a52b-ddd217742458 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:27.683454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1268/2500] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:05:27 2022] PUT /identity/v3/projects/fb907deefbd64ee7ba2d2cd04abba964/users/0730b21cf81e4fe68aec2371353c3108/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:27.693618 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f8a0f-5af1-4074-83fc-d28b8dc025ad None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:27.693918 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f8a0f-5af1-4074-83fc-d28b8dc025ad None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:27.694200 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f8a0f-5af1-4074-83fc-d28b8dc025ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:27.720925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-970f8a0f-5af1-4074-83fc-d28b8dc025ad None None] MFA Rules not processed for user `0730b21cf81e4fe68aec2371353c3108`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:27.722130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-970f8a0f-5af1-4074-83fc-d28b8dc025ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:27.760332 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:27.784177 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1233/2501] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:27.788659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a310530-49cf-48e8-a52b-ddd217742458 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:27.848795 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a310530-49cf-48e8-a52b-ddd217742458 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:27.853523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2175679-71fc-4560-b5e1-2c758bfa11be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:27.854173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2175679-71fc-4560-b5e1-2c758bfa11be admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:27.854490 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2175679-71fc-4560-b5e1-2c758bfa11be admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:27.854772 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2175679-71fc-4560-b5e1-2c758bfa11be admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:27.855464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2175679-71fc-4560-b5e1-2c758bfa11be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:27.857359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2175679-71fc-4560-b5e1-2c758bfa11be admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:27.946056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1269/2502] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:05:27 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:27.950099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f8a0f-5af1-4074-83fc-d28b8dc025ad None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:27.960897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f8a0f-5af1-4074-83fc-d28b8dc025ad None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:28.017730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649779f-9888-4270-ab81-dad1610bfcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:28.018331 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649779f-9888-4270-ab81-dad1610bfcdf admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:28.018642 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649779f-9888-4270-ab81-dad1610bfcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:28.018923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649779f-9888-4270-ab81-dad1610bfcdf admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:28.019614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649779f-9888-4270-ab81-dad1610bfcdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:28.021562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649779f-9888-4270-ab81-dad1610bfcdf admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:28.104754 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1234/2503] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:05:27 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:28.108571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2175679-71fc-4560-b5e1-2c758bfa11be admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:28.119342 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2175679-71fc-4560-b5e1-2c758bfa11be admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:28.124070 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c1021-39de-427e-a4d2-532360d95bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:28.126141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c1021-39de-427e-a4d2-532360d95bce admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:28.126141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c1021-39de-427e-a4d2-532360d95bce admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:28.126141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c1021-39de-427e-a4d2-532360d95bce admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:28.126141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c1021-39de-427e-a4d2-532360d95bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:28.127773 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c1021-39de-427e-a4d2-532360d95bce admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:28.129041 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:28.138847 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1270/2504] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:28.142865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649779f-9888-4270-ab81-dad1610bfcdf admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:28.153135 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649779f-9888-4270-ab81-dad1610bfcdf admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:28.158270 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d3435-620e-48ee-ac7d-45025b7f3f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:28.160555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d3435-620e-48ee-ac7d-45025b7f3f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:28.160555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d3435-620e-48ee-ac7d-45025b7f3f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:28.160555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d3435-620e-48ee-ac7d-45025b7f3f75 admin admin] PATH_INFO: `/v3/projects/31442fa9af4d4da79e8fd7e629cb13ef/users/da9dd594de8143deb865b653dfc9c3c7/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:28.175424 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d3435-620e-48ee-ac7d-45025b7f3f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31442fa9af4d4da79e8fd7e629cb13ef, user_id=da9dd594de8143deb865b653dfc9c3c7, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:28.178144 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d3435-620e-48ee-ac7d-45025b7f3f75 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:28.253529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1235/2505] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:05:28 2022] PUT /identity/v3/projects/31442fa9af4d4da79e8fd7e629cb13ef/users/da9dd594de8143deb865b653dfc9c3c7/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:28.257484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c1021-39de-427e-a4d2-532360d95bce admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:28.269451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c1021-39de-427e-a4d2-532360d95bce admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:28.326757 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b5875-08fc-475b-aec8-cdf9f4fa569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:28.327440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b5875-08fc-475b-aec8-cdf9f4fa569a admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:28.327736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b5875-08fc-475b-aec8-cdf9f4fa569a admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:28.327998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b5875-08fc-475b-aec8-cdf9f4fa569a admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:28.328738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b5875-08fc-475b-aec8-cdf9f4fa569a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:28.330369 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b5875-08fc-475b-aec8-cdf9f4fa569a admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:28.343547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1271/2506] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:28.345480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d3435-620e-48ee-ac7d-45025b7f3f75 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:28.356056 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d3435-620e-48ee-ac7d-45025b7f3f75 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:28.361255 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d6281-6abb-4af2-aa61-55a5a915610b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:28.362123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d6281-6abb-4af2-aa61-55a5a915610b admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:28.362512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d6281-6abb-4af2-aa61-55a5a915610b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:28.362800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d6281-6abb-4af2-aa61-55a5a915610b admin admin] PATH_INFO: `/v3/projects/31442fa9af4d4da79e8fd7e629cb13ef/users/da9dd594de8143deb865b653dfc9c3c7/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:28.364774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d6281-6abb-4af2-aa61-55a5a915610b admin admin] RBAC: Authorizing `identity:create_grant(project_id=31442fa9af4d4da79e8fd7e629cb13ef, user_id=da9dd594de8143deb865b653dfc9c3c7, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:28.367469 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d6281-6abb-4af2-aa61-55a5a915610b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:28.377745 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1236/2507] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:05:28 2022] PUT /identity/v3/projects/31442fa9af4d4da79e8fd7e629cb13ef/users/da9dd594de8143deb865b653dfc9c3c7/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:28.388252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad6197-e2a5-4a03-b877-ee5f8151de07 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:28.388553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad6197-e2a5-4a03-b877-ee5f8151de07 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:28.388933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad6197-e2a5-4a03-b877-ee5f8151de07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:28.416948 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-03ad6197-e2a5-4a03-b877-ee5f8151de07 None None] MFA Rules not processed for user `da9dd594de8143deb865b653dfc9c3c7`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:28.418212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-03ad6197-e2a5-4a03-b877-ee5f8151de07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:28.468712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d6281-6abb-4af2-aa61-55a5a915610b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:28.471379 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c36d6281-6abb-4af2-aa61-55a5a915610b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:28.492994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1272/2508] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:28.503991 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad6197-e2a5-4a03-b877-ee5f8151de07 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:28.505406 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-03ad6197-e2a5-4a03-b877-ee5f8151de07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:28.552395 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d6281-6abb-4af2-aa61-55a5a915610b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:28.558067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcd530-e022-4d0e-be27-bfcd17929f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:28.558841 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcd530-e022-4d0e-be27-bfcd17929f05 service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:28.559135 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcd530-e022-4d0e-be27-bfcd17929f05 service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:28.559411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcd530-e022-4d0e-be27-bfcd17929f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:28.561182 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-93bcd530-e022-4d0e-be27-bfcd17929f05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:28.562912 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad6197-e2a5-4a03-b877-ee5f8151de07 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:28.566472 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c254d59-88c4-40c5-83d7-46d02caf6a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:28.567121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c254d59-88c4-40c5-83d7-46d02caf6a7c service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:28.567410 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c254d59-88c4-40c5-83d7-46d02caf6a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:28.567689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c254d59-88c4-40c5-83d7-46d02caf6a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:28.576749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c254d59-88c4-40c5-83d7-46d02caf6a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:28.578220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c254d59-88c4-40c5-83d7-46d02caf6a7c service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:28.588202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1273/2509] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:05:28.592343 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:28.621166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcd530-e022-4d0e-be27-bfcd17929f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:28.622798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bcd530-e022-4d0e-be27-bfcd17929f05 service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:28.632001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1237/2510] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:28.712277 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c254d59-88c4-40c5-83d7-46d02caf6a7c service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:28.722019 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c254d59-88c4-40c5-83d7-46d02caf6a7c service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:28.725751 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db575a66-e186-4765-84ca-3391b4f6b934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:28.726426 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db575a66-e186-4765-84ca-3391b4f6b934 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:28.726716 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db575a66-e186-4765-84ca-3391b4f6b934 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:28.726997 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db575a66-e186-4765-84ca-3391b4f6b934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:28.743770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:28.784138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db575a66-e186-4765-84ca-3391b4f6b934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:28.785653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db575a66-e186-4765-84ca-3391b4f6b934 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:28.794561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1274/2511] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:33.229311 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcd530-e022-4d0e-be27-bfcd17929f05 service nova] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:33.290469 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcd530-e022-4d0e-be27-bfcd17929f05 service nova] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:33.295051 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cd340-eb23-4782-a8d0-e9ccfb93c6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:33.295924 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cd340-eb23-4782-a8d0-e9ccfb93c6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:33.296211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cd340-eb23-4782-a8d0-e9ccfb93c6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:33.296487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cd340-eb23-4782-a8d0-e9ccfb93c6ff admin admin] PATH_INFO: `/v3/users/e0e2d3d10c6c4c1f944384d00b37514f` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:33.297655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cd340-eb23-4782-a8d0-e9ccfb93c6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0e2d3d10c6c4c1f944384d00b37514f)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:33.299601 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cd340-eb23-4782-a8d0-e9ccfb93c6ff admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:33.627597 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-025cd340-eb23-4782-a8d0-e9ccfb93c6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0e2d3d10c6c4c1f944384d00b37514f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:33.628267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-025cd340-eb23-4782-a8d0-e9ccfb93c6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0e2d3d10c6c4c1f944384d00b37514f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:33.710229 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-025cd340-eb23-4782-a8d0-e9ccfb93c6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0e2d3d10c6c4c1f944384d00b37514f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:33.723642 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-025cd340-eb23-4782-a8d0-e9ccfb93c6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0e2d3d10c6c4c1f944384d00b37514f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:33.731284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-025cd340-eb23-4782-a8d0-e9ccfb93c6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0e2d3d10c6c4c1f944384d00b37514f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:33.737290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1238/2512] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:05:33 2022] DELETE /identity/v3/users/e0e2d3d10c6c4c1f944384d00b37514f => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:05:33.741996 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30d3af-f1d7-4fdc-bae7-a847243669ba None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:33.742513 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30d3af-f1d7-4fdc-bae7-a847243669ba None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:33.742607 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30d3af-f1d7-4fdc-bae7-a847243669ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:33.759084 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-0f30d3af-f1d7-4fdc-bae7-a847243669ba None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:33.760867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-0f30d3af-f1d7-4fdc-bae7-a847243669ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:33.821068 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1275/2513] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:33.830877 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cd340-eb23-4782-a8d0-e9ccfb93c6ff admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:33.832762 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-025cd340-eb23-4782-a8d0-e9ccfb93c6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:33.888062 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:33.891748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cd340-eb23-4782-a8d0-e9ccfb93c6ff admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:33.896922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f8ead-e179-4bb1-a032-41fc806c4500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:33.898123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f8ead-e179-4bb1-a032-41fc806c4500 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:33.898660 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f8ead-e179-4bb1-a032-41fc806c4500 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:33.898832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f8ead-e179-4bb1-a032-41fc806c4500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:33.908669 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f8ead-e179-4bb1-a032-41fc806c4500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:33.910788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f8ead-e179-4bb1-a032-41fc806c4500 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:33.920607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1239/2514] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:34.412186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30d3af-f1d7-4fdc-bae7-a847243669ba None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:34.413637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-0f30d3af-f1d7-4fdc-bae7-a847243669ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:34.428259 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30d3af-f1d7-4fdc-bae7-a847243669ba None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:34.432759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b1acc-6fb4-4354-9835-9d0ab27215d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:34.433725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b1acc-6fb4-4354-9835-9d0ab27215d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:34.434230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b1acc-6fb4-4354-9835-9d0ab27215d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:34.434923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b1acc-6fb4-4354-9835-9d0ab27215d9 admin admin] PATH_INFO: `/v3/projects/29bbe7961d6646fb92d3f58ba17d855e` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:34.436162 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b1acc-6fb4-4354-9835-9d0ab27215d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29bbe7961d6646fb92d3f58ba17d855e)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:34.438139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b1acc-6fb4-4354-9835-9d0ab27215d9 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:34.571254 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a37b1acc-6fb4-4354-9835-9d0ab27215d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29bbe7961d6646fb92d3f58ba17d855e', 'request_id': 'req-a37b1acc-6fb4-4354-9835-9d0ab27215d9'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:34.577741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a37b1acc-6fb4-4354-9835-9d0ab27215d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29bbe7961d6646fb92d3f58ba17d855e', 'request_id': 'req-a37b1acc-6fb4-4354-9835-9d0ab27215d9'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:34.584143 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a37b1acc-6fb4-4354-9835-9d0ab27215d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29bbe7961d6646fb92d3f58ba17d855e', 'request_id': 'req-a37b1acc-6fb4-4354-9835-9d0ab27215d9'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:34.667338 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a37b1acc-6fb4-4354-9835-9d0ab27215d9 admin admin] The token cache is being invalidate because project 29bbe7961d6646fb92d3f58ba17d855e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:05:34.667699 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a37b1acc-6fb4-4354-9835-9d0ab27215d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:34.668346 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a37b1acc-6fb4-4354-9835-9d0ab27215d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:34.669965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1276/2515] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:05:34 2022] DELETE /identity/v3/projects/29bbe7961d6646fb92d3f58ba17d855e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:34.673873 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f8ead-e179-4bb1-a032-41fc806c4500 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:34.684235 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f8ead-e179-4bb1-a032-41fc806c4500 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:34.742112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c88d39-b6cf-4b8c-878c-c18015f838be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:34.743016 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c88d39-b6cf-4b8c-878c-c18015f838be admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:34.743297 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c88d39-b6cf-4b8c-878c-c18015f838be admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:34.743569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c88d39-b6cf-4b8c-878c-c18015f838be admin admin] PATH_INFO: `/v3/users/0730b21cf81e4fe68aec2371353c3108` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:34.744744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c88d39-b6cf-4b8c-878c-c18015f838be admin admin] RBAC: Authorizing `identity:delete_user(user_id=0730b21cf81e4fe68aec2371353c3108)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:34.746828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c88d39-b6cf-4b8c-878c-c18015f838be admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:34.914705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-14c88d39-b6cf-4b8c-878c-c18015f838be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0730b21cf81e4fe68aec2371353c3108'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:34.915359 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-14c88d39-b6cf-4b8c-878c-c18015f838be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0730b21cf81e4fe68aec2371353c3108'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:34.975585 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-14c88d39-b6cf-4b8c-878c-c18015f838be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0730b21cf81e4fe68aec2371353c3108'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:34.988769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-14c88d39-b6cf-4b8c-878c-c18015f838be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0730b21cf81e4fe68aec2371353c3108'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:34.996381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-14c88d39-b6cf-4b8c-878c-c18015f838be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0730b21cf81e4fe68aec2371353c3108'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:35.002747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1240/2516] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:05:34 2022] DELETE /identity/v3/users/0730b21cf81e4fe68aec2371353c3108 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:35.576239 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b1acc-6fb4-4354-9835-9d0ab27215d9 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:35.577910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a37b1acc-6fb4-4354-9835-9d0ab27215d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:35.606235 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b1acc-6fb4-4354-9835-9d0ab27215d9 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:35.647758 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:35.664401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:35.665270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:35.665559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:35.665915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f admin admin] PATH_INFO: `/v3/projects/fb907deefbd64ee7ba2d2cd04abba964` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:35.667127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb907deefbd64ee7ba2d2cd04abba964)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:35.669079 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:35.769358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb907deefbd64ee7ba2d2cd04abba964', 'request_id': 'req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:35.775579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb907deefbd64ee7ba2d2cd04abba964', 'request_id': 'req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:35.780863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb907deefbd64ee7ba2d2cd04abba964', 'request_id': 'req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:35.841095 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f admin admin] The token cache is being invalidate because project fb907deefbd64ee7ba2d2cd04abba964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:05:35.841388 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:35.842010 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:35.843623 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1277/2517] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:05:35 2022] DELETE /identity/v3/projects/fb907deefbd64ee7ba2d2cd04abba964 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:35.847586 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c88d39-b6cf-4b8c-878c-c18015f838be admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:35.849008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-14c88d39-b6cf-4b8c-878c-c18015f838be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:35.862687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c88d39-b6cf-4b8c-878c-c18015f838be admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:35.918548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4de4fd-7399-468b-a423-ea509c4fca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:35.919423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4de4fd-7399-468b-a423-ea509c4fca6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:35.919708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4de4fd-7399-468b-a423-ea509c4fca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:35.919987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4de4fd-7399-468b-a423-ea509c4fca6c admin admin] PATH_INFO: `/v3/users/da9dd594de8143deb865b653dfc9c3c7` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:35.921184 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4de4fd-7399-468b-a423-ea509c4fca6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da9dd594de8143deb865b653dfc9c3c7)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:35.923191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4de4fd-7399-468b-a423-ea509c4fca6c admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:35.935555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:36.109848 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-bd4de4fd-7399-468b-a423-ea509c4fca6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da9dd594de8143deb865b653dfc9c3c7'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:36.110584 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-bd4de4fd-7399-468b-a423-ea509c4fca6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da9dd594de8143deb865b653dfc9c3c7'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:36.186904 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-bd4de4fd-7399-468b-a423-ea509c4fca6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da9dd594de8143deb865b653dfc9c3c7'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:36.199713 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-bd4de4fd-7399-468b-a423-ea509c4fca6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da9dd594de8143deb865b653dfc9c3c7'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:36.206494 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-bd4de4fd-7399-468b-a423-ea509c4fca6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da9dd594de8143deb865b653dfc9c3c7'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:36.213051 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1241/2518] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:05:35 2022] DELETE /identity/v3/users/da9dd594de8143deb865b653dfc9c3c7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:36.651840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:36.653389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:36.666835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7456b0e-8559-46dc-8ee2-e5593aa1f61f admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:36.739189 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d66828-36fb-4179-b103-1551859b7696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:36.740137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d66828-36fb-4179-b103-1551859b7696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:36.741035 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d66828-36fb-4179-b103-1551859b7696 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:36.741408 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d66828-36fb-4179-b103-1551859b7696 admin admin] PATH_INFO: `/v3/projects/31442fa9af4d4da79e8fd7e629cb13ef` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:36.742722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d66828-36fb-4179-b103-1551859b7696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31442fa9af4d4da79e8fd7e629cb13ef)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:36.744738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d66828-36fb-4179-b103-1551859b7696 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:36.845357 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-37d66828-36fb-4179-b103-1551859b7696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31442fa9af4d4da79e8fd7e629cb13ef', 'request_id': 'req-37d66828-36fb-4179-b103-1551859b7696'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:36.851653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-37d66828-36fb-4179-b103-1551859b7696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31442fa9af4d4da79e8fd7e629cb13ef', 'request_id': 'req-37d66828-36fb-4179-b103-1551859b7696'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:36.857262 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-37d66828-36fb-4179-b103-1551859b7696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31442fa9af4d4da79e8fd7e629cb13ef', 'request_id': 'req-37d66828-36fb-4179-b103-1551859b7696'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:36.955962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-37d66828-36fb-4179-b103-1551859b7696 admin admin] The token cache is being invalidate because project 31442fa9af4d4da79e8fd7e629cb13ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:05:36.956191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-37d66828-36fb-4179-b103-1551859b7696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:36.956828 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-37d66828-36fb-4179-b103-1551859b7696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:36.958414 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1278/2519] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:05:36 2022] DELETE /identity/v3/projects/31442fa9af4d4da79e8fd7e629cb13ef => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:36.964484 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac3213-2225-4fc3-b61a-13feb63b7ab8 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:36.964963 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac3213-2225-4fc3-b61a-13feb63b7ab8 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:36.965058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac3213-2225-4fc3-b61a-13feb63b7ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:36.985734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-d1ac3213-2225-4fc3-b61a-13feb63b7ab8 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:36.985734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d1ac3213-2225-4fc3-b61a-13feb63b7ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:37.045505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1242/2520] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:37.056168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77724d2-d136-48d9-8aa6-f6afc2e739b1 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:37.056467 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77724d2-d136-48d9-8aa6-f6afc2e739b1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:37.056747 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77724d2-d136-48d9-8aa6-f6afc2e739b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:37.063703 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:37.075955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c77724d2-d136-48d9-8aa6-f6afc2e739b1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:37.077153 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c77724d2-d136-48d9-8aa6-f6afc2e739b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:37.085305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1279/2521] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:37.089593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac3213-2225-4fc3-b61a-13feb63b7ab8 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:37.099304 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac3213-2225-4fc3-b61a-13feb63b7ab8 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:37.104931 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64f1e5-747a-4017-8ad3-0838847644f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:37.105594 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64f1e5-747a-4017-8ad3-0838847644f4 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:37.105881 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64f1e5-747a-4017-8ad3-0838847644f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:37.106157 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64f1e5-747a-4017-8ad3-0838847644f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:37.106925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64f1e5-747a-4017-8ad3-0838847644f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:05:37.107263 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64f1e5-747a-4017-8ad3-0838847644f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:37.109164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64f1e5-747a-4017-8ad3-0838847644f4 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:37.122531 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1243/2522] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:05:37.126372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77724d2-d136-48d9-8aa6-f6afc2e739b1 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:37.135538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77724d2-d136-48d9-8aa6-f6afc2e739b1 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:37.140139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f43c67-e2a3-4959-ab87-8e49199a7fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:37.140804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f43c67-e2a3-4959-ab87-8e49199a7fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:37.141070 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f43c67-e2a3-4959-ab87-8e49199a7fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:37.141352 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f43c67-e2a3-4959-ab87-8e49199a7fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:37.142044 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f43c67-e2a3-4959-ab87-8e49199a7fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:37.144035 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f43c67-e2a3-4959-ab87-8e49199a7fc2 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:37.244313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1280/2523] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:05:37 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:37.245373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64f1e5-747a-4017-8ad3-0838847644f4 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:37.255660 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64f1e5-747a-4017-8ad3-0838847644f4 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:37.316659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869723c-7d87-405a-bafd-c5bc2105306b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:37.317344 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869723c-7d87-405a-bafd-c5bc2105306b admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:37.317630 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869723c-7d87-405a-bafd-c5bc2105306b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:37.317915 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869723c-7d87-405a-bafd-c5bc2105306b admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:37.318652 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869723c-7d87-405a-bafd-c5bc2105306b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:37.320635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869723c-7d87-405a-bafd-c5bc2105306b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:37.419871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1244/2524] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:05:37 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:05:37.421339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f43c67-e2a3-4959-ab87-8e49199a7fc2 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:37.431651 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f43c67-e2a3-4959-ab87-8e49199a7fc2 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:37.436664 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71982678-dc02-4e90-9052-0f09b3a71793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:37.437333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71982678-dc02-4e90-9052-0f09b3a71793 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:37.437620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71982678-dc02-4e90-9052-0f09b3a71793 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:37.437904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71982678-dc02-4e90-9052-0f09b3a71793 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:37.438672 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71982678-dc02-4e90-9052-0f09b3a71793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:37.440329 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71982678-dc02-4e90-9052-0f09b3a71793 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:37.451390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1281/2525] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:37.455441 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869723c-7d87-405a-bafd-c5bc2105306b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:37.466271 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869723c-7d87-405a-bafd-c5bc2105306b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:37.478193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68942bb3-34c9-4aa4-9007-aefd9e8a0e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:37.478917 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68942bb3-34c9-4aa4-9007-aefd9e8a0e48 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:37.479210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68942bb3-34c9-4aa4-9007-aefd9e8a0e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:37.479493 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68942bb3-34c9-4aa4-9007-aefd9e8a0e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:37.480239 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68942bb3-34c9-4aa4-9007-aefd9e8a0e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:37.482114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68942bb3-34c9-4aa4-9007-aefd9e8a0e48 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:37.483587 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:37.493933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1245/2526] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:05:37.497958 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71982678-dc02-4e90-9052-0f09b3a71793 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:37.508159 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71982678-dc02-4e90-9052-0f09b3a71793 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:37.513096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f578f4-6e7a-4a6e-8835-1f10e0fd86fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:37.513986 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f578f4-6e7a-4a6e-8835-1f10e0fd86fd admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:37.514271 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f578f4-6e7a-4a6e-8835-1f10e0fd86fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:37.514689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f578f4-6e7a-4a6e-8835-1f10e0fd86fd admin admin] PATH_INFO: `/v3/projects/4b09d31150ce4005bc0db5f02c970f10/users/baee0900964b4dd09c690307a9734794/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:37.531060 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f578f4-6e7a-4a6e-8835-1f10e0fd86fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b09d31150ce4005bc0db5f02c970f10, user_id=baee0900964b4dd09c690307a9734794, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:37.533853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f578f4-6e7a-4a6e-8835-1f10e0fd86fd admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:37.605336 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1282/2527] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:05:37 2022] PUT /identity/v3/projects/4b09d31150ce4005bc0db5f02c970f10/users/baee0900964b4dd09c690307a9734794/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:37.610800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5517fe4-c81c-41a4-9a84-e5b2d4e0ebf4 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:37.611097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5517fe4-c81c-41a4-9a84-e5b2d4e0ebf4 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:37.611385 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5517fe4-c81c-41a4-9a84-e5b2d4e0ebf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:37.628981 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b5517fe4-c81c-41a4-9a84-e5b2d4e0ebf4 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:37.630478 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b5517fe4-c81c-41a4-9a84-e5b2d4e0ebf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:37.688715 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1246/2528] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:37.698756 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f578f4-6e7a-4a6e-8835-1f10e0fd86fd admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:37.701340 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-49f578f4-6e7a-4a6e-8835-1f10e0fd86fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:37.759040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f578f4-6e7a-4a6e-8835-1f10e0fd86fd admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:37.762932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d458ec8-7216-4039-b06f-585e3cb90187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:37.763611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d458ec8-7216-4039-b06f-585e3cb90187 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:37.763925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d458ec8-7216-4039-b06f-585e3cb90187 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:37.764209 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d458ec8-7216-4039-b06f-585e3cb90187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:37.774433 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d458ec8-7216-4039-b06f-585e3cb90187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:37.775886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d458ec8-7216-4039-b06f-585e3cb90187 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:37.785349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1283/2529] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:38.151538 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5517fe4-c81c-41a4-9a84-e5b2d4e0ebf4 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:38.153003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b5517fe4-c81c-41a4-9a84-e5b2d4e0ebf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:38.237377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5517fe4-c81c-41a4-9a84-e5b2d4e0ebf4 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:38.244542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2856be2-e3a2-4edb-85c7-3f98173b154e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:38.245744 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2856be2-e3a2-4edb-85c7-3f98173b154e service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:38.246281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2856be2-e3a2-4edb-85c7-3f98173b154e service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:38.246803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2856be2-e3a2-4edb-85c7-3f98173b154e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:38.248927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e2856be2-e3a2-4edb-85c7-3f98173b154e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:38.263408 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2856be2-e3a2-4edb-85c7-3f98173b154e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:38.265168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2856be2-e3a2-4edb-85c7-3f98173b154e service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:38.279291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1247/2530] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:39.133396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda6131-5b8d-453f-a984-f16ef53a0bac None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:39.134002 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda6131-5b8d-453f-a984-f16ef53a0bac None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:39.134098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda6131-5b8d-453f-a984-f16ef53a0bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:39.169473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-8cda6131-5b8d-453f-a984-f16ef53a0bac None None] MFA Rules not processed for user `baee0900964b4dd09c690307a9734794`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:39.170798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8cda6131-5b8d-453f-a984-f16ef53a0bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:39.242243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1284/2531] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:39.247022 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2856be2-e3a2-4edb-85c7-3f98173b154e service nova] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:39.258261 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2856be2-e3a2-4edb-85c7-3f98173b154e service nova] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:39.262963 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ca3c5-6ddd-4621-8e4e-364f5330e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:39.263805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ca3c5-6ddd-4621-8e4e-364f5330e648 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:39.264017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ca3c5-6ddd-4621-8e4e-364f5330e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:39.264246 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ca3c5-6ddd-4621-8e4e-364f5330e648 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:39.264926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ca3c5-6ddd-4621-8e4e-364f5330e648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:39.267046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ca3c5-6ddd-4621-8e4e-364f5330e648 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:39.380483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1248/2532] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:05:39 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:39.382323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda6131-5b8d-453f-a984-f16ef53a0bac None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:39.393092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda6131-5b8d-453f-a984-f16ef53a0bac None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:39.421779 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:39.448683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d40c4-a05f-4199-9c42-d6bbe5760f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:39.449364 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d40c4-a05f-4199-9c42-d6bbe5760f9f admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:39.449681 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d40c4-a05f-4199-9c42-d6bbe5760f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:39.449962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d40c4-a05f-4199-9c42-d6bbe5760f9f admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:39.450698 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d40c4-a05f-4199-9c42-d6bbe5760f9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:39.452628 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d40c4-a05f-4199-9c42-d6bbe5760f9f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:39.593331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1285/2533] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:05:39 2022] POST /identity/v3/users => generated 291 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:39.597435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ca3c5-6ddd-4621-8e4e-364f5330e648 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:39.607833 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ca3c5-6ddd-4621-8e4e-364f5330e648 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:39.612454 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52f2fe-badc-4d5a-ac9e-1fe8467bd3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:39.613118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52f2fe-badc-4d5a-ac9e-1fe8467bd3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:39.613415 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52f2fe-badc-4d5a-ac9e-1fe8467bd3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:39.613697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52f2fe-badc-4d5a-ac9e-1fe8467bd3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:39.614454 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52f2fe-badc-4d5a-ac9e-1fe8467bd3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:39.616573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52f2fe-badc-4d5a-ac9e-1fe8467bd3a0 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:39.628351 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1249/2534] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:39.632942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d40c4-a05f-4199-9c42-d6bbe5760f9f admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:39.642864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d40c4-a05f-4199-9c42-d6bbe5760f9f admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:39.647663 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2634e12-f08f-4439-9bff-dedf95bfe39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:39.648523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2634e12-f08f-4439-9bff-dedf95bfe39e admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:39.648808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2634e12-f08f-4439-9bff-dedf95bfe39e admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:39.649088 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2634e12-f08f-4439-9bff-dedf95bfe39e admin admin] PATH_INFO: `/v3/projects/75de43f149ea43c19c512d6ad8d930e6/users/d46d4657026941f4949ecd33488c4ffe/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:39.664170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2634e12-f08f-4439-9bff-dedf95bfe39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=75de43f149ea43c19c512d6ad8d930e6, user_id=d46d4657026941f4949ecd33488c4ffe, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:39.666956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2634e12-f08f-4439-9bff-dedf95bfe39e admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:39.770280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1286/2535] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:05:39 2022] PUT /identity/v3/projects/75de43f149ea43c19c512d6ad8d930e6/users/d46d4657026941f4949ecd33488c4ffe/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:39.774136 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52f2fe-badc-4d5a-ac9e-1fe8467bd3a0 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:39.784322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52f2fe-badc-4d5a-ac9e-1fe8467bd3a0 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:39.828757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:39.840245 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f531cc-42e5-4d92-9670-9f818088e699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:39.840919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f531cc-42e5-4d92-9670-9f818088e699 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:39.841208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f531cc-42e5-4d92-9670-9f818088e699 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:39.841490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f531cc-42e5-4d92-9670-9f818088e699 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:39.842209 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f531cc-42e5-4d92-9670-9f818088e699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:39.843837 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f531cc-42e5-4d92-9670-9f818088e699 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:39.853533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1250/2536] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:39.857594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2634e12-f08f-4439-9bff-dedf95bfe39e admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:39.868395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2634e12-f08f-4439-9bff-dedf95bfe39e admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:39.873320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea04fa8-73fe-46af-abe4-96398a0cafc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:39.874209 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea04fa8-73fe-46af-abe4-96398a0cafc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:39.874633 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea04fa8-73fe-46af-abe4-96398a0cafc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:39.874921 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea04fa8-73fe-46af-abe4-96398a0cafc1 admin admin] PATH_INFO: `/v3/projects/75de43f149ea43c19c512d6ad8d930e6/users/d46d4657026941f4949ecd33488c4ffe/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:39.877019 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea04fa8-73fe-46af-abe4-96398a0cafc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75de43f149ea43c19c512d6ad8d930e6, user_id=d46d4657026941f4949ecd33488c4ffe, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:39.879808 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea04fa8-73fe-46af-abe4-96398a0cafc1 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:39.890698 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1287/2537] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:05:39 2022] PUT /identity/v3/projects/75de43f149ea43c19c512d6ad8d930e6/users/d46d4657026941f4949ecd33488c4ffe/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:41.225374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca409bbf-0def-4f22-8bc1-5a89bf47c0b6 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:41.225950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca409bbf-0def-4f22-8bc1-5a89bf47c0b6 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:41.225950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca409bbf-0def-4f22-8bc1-5a89bf47c0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:41.263841 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-ca409bbf-0def-4f22-8bc1-5a89bf47c0b6 None None] MFA Rules not processed for user `d46d4657026941f4949ecd33488c4ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:41.265350 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-ca409bbf-0def-4f22-8bc1-5a89bf47c0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:41.339684 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1251/2538] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:41.351530 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f64ff-ef06-493c-8c6c-e03414470986 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:41.352138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f64ff-ef06-493c-8c6c-e03414470986 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:41.352138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f64ff-ef06-493c-8c6c-e03414470986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:41.371690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-4b7f64ff-ef06-493c-8c6c-e03414470986 None None] MFA Rules not processed for user `baee0900964b4dd09c690307a9734794`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:41.373001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4b7f64ff-ef06-493c-8c6c-e03414470986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:41.432053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1288/2539] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:05:41.443483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca409bbf-0def-4f22-8bc1-5a89bf47c0b6 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:41.519212 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca409bbf-0def-4f22-8bc1-5a89bf47c0b6 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:41.524978 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2366763-fb18-4f5c-b057-6de29e22d7f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:41.525634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2366763-fb18-4f5c-b057-6de29e22d7f1 service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:41.525921 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2366763-fb18-4f5c-b057-6de29e22d7f1 service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:41.526205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2366763-fb18-4f5c-b057-6de29e22d7f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:41.534402 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2366763-fb18-4f5c-b057-6de29e22d7f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:41.536005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2366763-fb18-4f5c-b057-6de29e22d7f1 service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:41.545298 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1252/2540] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:41.775036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f64ff-ef06-493c-8c6c-e03414470986 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:41.776463 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4b7f64ff-ef06-493c-8c6c-e03414470986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:41.833745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f64ff-ef06-493c-8c6c-e03414470986 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:41.837886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4fc3c-4730-4d8b-ba81-d787789ec9dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:41.841966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4fc3c-4730-4d8b-ba81-d787789ec9dd service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:41.841966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4fc3c-4730-4d8b-ba81-d787789ec9dd service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:41.841966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4fc3c-4730-4d8b-ba81-d787789ec9dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:41.841966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-1de4fc3c-4730-4d8b-ba81-d787789ec9dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:41.850527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4fc3c-4730-4d8b-ba81-d787789ec9dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:41.852552 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4fc3c-4730-4d8b-ba81-d787789ec9dd service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:41.860527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1289/2541] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:45.209534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2366763-fb18-4f5c-b057-6de29e22d7f1 service nova] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:45.219239 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2366763-fb18-4f5c-b057-6de29e22d7f1 service nova] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:45.223091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546d2ec-d546-4e78-8d17-94d5e533bee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:45.224015 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546d2ec-d546-4e78-8d17-94d5e533bee1 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:45.224151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546d2ec-d546-4e78-8d17-94d5e533bee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:45.224365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546d2ec-d546-4e78-8d17-94d5e533bee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:45.226822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2546d2ec-d546-4e78-8d17-94d5e533bee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:45.281976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:45.295123 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546d2ec-d546-4e78-8d17-94d5e533bee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:45.296587 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546d2ec-d546-4e78-8d17-94d5e533bee1 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:45.316104 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1253/2542] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:49.322614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4fc3c-4730-4d8b-ba81-d787789ec9dd service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:49.324912 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-1de4fc3c-4730-4d8b-ba81-d787789ec9dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:49.382799 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:49.446894 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4fc3c-4730-4d8b-ba81-d787789ec9dd service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:49.453924 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe983ad-8b62-4eb6-9b5f-5fffcc442f7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394b43cef91f4990b4707cb7a6798068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:49.454717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe983ad-8b62-4eb6-9b5f-5fffcc442f7c service placement] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:49.455117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe983ad-8b62-4eb6-9b5f-5fffcc442f7c service placement] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:49.455502 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe983ad-8b62-4eb6-9b5f-5fffcc442f7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:49.457442 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8fe983ad-8b62-4eb6-9b5f-5fffcc442f7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:49.471077 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe983ad-8b62-4eb6-9b5f-5fffcc442f7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:49.473289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe983ad-8b62-4eb6-9b5f-5fffcc442f7c service placement] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:49.489907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1290/2543] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:49.538530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546d2ec-d546-4e78-8d17-94d5e533bee1 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:49.540539 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2546d2ec-d546-4e78-8d17-94d5e533bee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:49.554702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546d2ec-d546-4e78-8d17-94d5e533bee1 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:49.561596 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ecf4c-46c5-4af0-97fb-6a2f9105f3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:49.562771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ecf4c-46c5-4af0-97fb-6a2f9105f3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:49.563237 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ecf4c-46c5-4af0-97fb-6a2f9105f3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:49.563689 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ecf4c-46c5-4af0-97fb-6a2f9105f3ea admin admin] PATH_INFO: `/v3/users/e3667bac6fe34a0bb29cdf7c9fc556f6` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:49.565185 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ecf4c-46c5-4af0-97fb-6a2f9105f3ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3667bac6fe34a0bb29cdf7c9fc556f6)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:49.568208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ecf4c-46c5-4af0-97fb-6a2f9105f3ea admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:49.865139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f02ecf4c-46c5-4af0-97fb-6a2f9105f3ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3667bac6fe34a0bb29cdf7c9fc556f6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:49.865802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f02ecf4c-46c5-4af0-97fb-6a2f9105f3ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3667bac6fe34a0bb29cdf7c9fc556f6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:49.967121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f02ecf4c-46c5-4af0-97fb-6a2f9105f3ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3667bac6fe34a0bb29cdf7c9fc556f6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:49.994920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f02ecf4c-46c5-4af0-97fb-6a2f9105f3ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3667bac6fe34a0bb29cdf7c9fc556f6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:50.011290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-f02ecf4c-46c5-4af0-97fb-6a2f9105f3ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3667bac6fe34a0bb29cdf7c9fc556f6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:50.031228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1254/2544] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:05:49 2022] DELETE /identity/v3/users/e3667bac6fe34a0bb29cdf7c9fc556f6 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:50.350547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe983ad-8b62-4eb6-9b5f-5fffcc442f7c service placement] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:50.364254 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe983ad-8b62-4eb6-9b5f-5fffcc442f7c service placement] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:50.495576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad125586-e8ef-4a5d-b38d-ff361a9222d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:50.497032 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad125586-e8ef-4a5d-b38d-ff361a9222d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:50.497363 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad125586-e8ef-4a5d-b38d-ff361a9222d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:50.497655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad125586-e8ef-4a5d-b38d-ff361a9222d6 admin admin] PATH_INFO: `/v3/projects/237d903492de434ab6240b90291ff1e2` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:50.499742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad125586-e8ef-4a5d-b38d-ff361a9222d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=237d903492de434ab6240b90291ff1e2)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:50.503610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad125586-e8ef-4a5d-b38d-ff361a9222d6 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:50.710537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ad125586-e8ef-4a5d-b38d-ff361a9222d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '237d903492de434ab6240b90291ff1e2', 'request_id': 'req-ad125586-e8ef-4a5d-b38d-ff361a9222d6'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:50.747121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ad125586-e8ef-4a5d-b38d-ff361a9222d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '237d903492de434ab6240b90291ff1e2', 'request_id': 'req-ad125586-e8ef-4a5d-b38d-ff361a9222d6'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:50.747121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ad125586-e8ef-4a5d-b38d-ff361a9222d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '237d903492de434ab6240b90291ff1e2', 'request_id': 'req-ad125586-e8ef-4a5d-b38d-ff361a9222d6'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:50.990890 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ad125586-e8ef-4a5d-b38d-ff361a9222d6 admin admin] The token cache is being invalidate because project 237d903492de434ab6240b90291ff1e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:05:50.991332 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ad125586-e8ef-4a5d-b38d-ff361a9222d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:50.992109 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ad125586-e8ef-4a5d-b38d-ff361a9222d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:50.993683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1291/2545] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:05:50 2022] DELETE /identity/v3/projects/237d903492de434ab6240b90291ff1e2 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:05:50.998865 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d032f8-4af7-49b2-9d7f-8f0dc4d0408e None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:51.044735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d032f8-4af7-49b2-9d7f-8f0dc4d0408e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:51.044735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d032f8-4af7-49b2-9d7f-8f0dc4d0408e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:51.044735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-72d032f8-4af7-49b2-9d7f-8f0dc4d0408e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:51.044735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-72d032f8-4af7-49b2-9d7f-8f0dc4d0408e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:51.083490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1255/2546] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:51.094281 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223a46c-4138-41ba-b4e8-d74bb2a71c73 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:51.094763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223a46c-4138-41ba-b4e8-d74bb2a71c73 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:51.095124 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223a46c-4138-41ba-b4e8-d74bb2a71c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:51.113488 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-2223a46c-4138-41ba-b4e8-d74bb2a71c73 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:51.114730 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2223a46c-4138-41ba-b4e8-d74bb2a71c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:51.123449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1292/2547] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:51.135257 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d032f8-4af7-49b2-9d7f-8f0dc4d0408e None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:51.148116 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d032f8-4af7-49b2-9d7f-8f0dc4d0408e None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:51.154476 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd890c-f3b8-434f-b955-c208598f4d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:51.155356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd890c-f3b8-434f-b955-c208598f4d41 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:51.155649 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd890c-f3b8-434f-b955-c208598f4d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:51.155938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd890c-f3b8-434f-b955-c208598f4d41 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:51.156667 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd890c-f3b8-434f-b955-c208598f4d41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:05:51.156992 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd890c-f3b8-434f-b955-c208598f4d41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:51.158692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd890c-f3b8-434f-b955-c208598f4d41 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:51.178545 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223a46c-4138-41ba-b4e8-d74bb2a71c73 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:51.182455 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1256/2548] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:05:51.189327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223a46c-4138-41ba-b4e8-d74bb2a71c73 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:51.193897 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105d791-9208-476c-8ef5-ce70bfc2eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:51.193897 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105d791-9208-476c-8ef5-ce70bfc2eeba admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:51.194139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105d791-9208-476c-8ef5-ce70bfc2eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:51.194505 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105d791-9208-476c-8ef5-ce70bfc2eeba admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:51.195336 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105d791-9208-476c-8ef5-ce70bfc2eeba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:51.197301 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105d791-9208-476c-8ef5-ce70bfc2eeba admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:51.329336 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1293/2549] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:05:51 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:05:51.330594 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd890c-f3b8-434f-b955-c208598f4d41 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:51.341997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd890c-f3b8-434f-b955-c208598f4d41 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:51.390142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:51.403997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf6fdf-5744-4818-9782-f8f54601c888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:51.405147 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf6fdf-5744-4818-9782-f8f54601c888 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:51.405607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf6fdf-5744-4818-9782-f8f54601c888 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:51.406212 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf6fdf-5744-4818-9782-f8f54601c888 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:51.407077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf6fdf-5744-4818-9782-f8f54601c888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:51.409388 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf6fdf-5744-4818-9782-f8f54601c888 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:51.570315 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1257/2550] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:05:51 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:05:51.571412 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105d791-9208-476c-8ef5-ce70bfc2eeba admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:51.586953 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105d791-9208-476c-8ef5-ce70bfc2eeba admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:51.591846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ab458-d874-4eeb-b26d-f49000469fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:51.592583 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ab458-d874-4eeb-b26d-f49000469fbd admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:51.592868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ab458-d874-4eeb-b26d-f49000469fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:51.593144 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ab458-d874-4eeb-b26d-f49000469fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:51.593877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ab458-d874-4eeb-b26d-f49000469fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:51.595523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ab458-d874-4eeb-b26d-f49000469fbd admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:51.610211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1294/2551] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:51.611763 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf6fdf-5744-4818-9782-f8f54601c888 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:51.623217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf6fdf-5744-4818-9782-f8f54601c888 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:51.628789 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34349443-9d5e-4899-8133-013c2def1fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:51.629650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34349443-9d5e-4899-8133-013c2def1fad admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:51.629941 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34349443-9d5e-4899-8133-013c2def1fad admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:51.630223 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34349443-9d5e-4899-8133-013c2def1fad admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:51.631032 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34349443-9d5e-4899-8133-013c2def1fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:51.632633 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34349443-9d5e-4899-8133-013c2def1fad admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:51.648608 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1258/2552] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:05:51.649990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ab458-d874-4eeb-b26d-f49000469fbd admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:51.655689 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:51.660903 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ab458-d874-4eeb-b26d-f49000469fbd admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:51.666407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d1af6-d0b2-4659-803a-0796fb5014fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:51.667350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d1af6-d0b2-4659-803a-0796fb5014fe admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:51.668139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d1af6-d0b2-4659-803a-0796fb5014fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:51.668139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d1af6-d0b2-4659-803a-0796fb5014fe admin admin] PATH_INFO: `/v3/projects/e05d29e01c5046ddac905550655c466e/users/c85ce74df7c84c90bd9146eee279f460/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:51.685251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d1af6-d0b2-4659-803a-0796fb5014fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05d29e01c5046ddac905550655c466e, user_id=c85ce74df7c84c90bd9146eee279f460, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:51.688461 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23d1af6-d0b2-4659-803a-0796fb5014fe admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:51.698328 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34349443-9d5e-4899-8133-013c2def1fad admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:51.702159 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-34349443-9d5e-4899-8133-013c2def1fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:51.780791 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1295/2553] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:05:51 2022] PUT /identity/v3/projects/e05d29e01c5046ddac905550655c466e/users/c85ce74df7c84c90bd9146eee279f460/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:05:51.790916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e4451-81ab-4c6f-bf27-ce294bd8eb83 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:51.791349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e4451-81ab-4c6f-bf27-ce294bd8eb83 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:51.791768 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e4451-81ab-4c6f-bf27-ce294bd8eb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:51.806016 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34349443-9d5e-4899-8133-013c2def1fad admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:51.837370 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e01e4451-81ab-4c6f-bf27-ce294bd8eb83 None None] MFA Rules not processed for user `c85ce74df7c84c90bd9146eee279f460`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:51.838617 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e01e4451-81ab-4c6f-bf27-ce294bd8eb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:51.895672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbde305-af2b-4722-a5ee-5bfb62f05874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:51.896433 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbde305-af2b-4722-a5ee-5bfb62f05874 service nova] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:51.896797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbde305-af2b-4722-a5ee-5bfb62f05874 service nova] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:51.897079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbde305-af2b-4722-a5ee-5bfb62f05874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:51.900504 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4cbde305-af2b-4722-a5ee-5bfb62f05874 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:51.914820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbde305-af2b-4722-a5ee-5bfb62f05874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:51.914820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbde305-af2b-4722-a5ee-5bfb62f05874 service nova] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:51.920046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1296/2554] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:05:51.929994 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1259/2555] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:05:51.967330 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e4451-81ab-4c6f-bf27-ce294bd8eb83 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:51.982212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e4451-81ab-4c6f-bf27-ce294bd8eb83 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:51.989809 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2bc1c-3dd2-419e-96b3-32f1400675cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:51.990945 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2bc1c-3dd2-419e-96b3-32f1400675cf service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:51.991544 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2bc1c-3dd2-419e-96b3-32f1400675cf service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:51.992842 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2bc1c-3dd2-419e-96b3-32f1400675cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:52.005259 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2bc1c-3dd2-419e-96b3-32f1400675cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:52.006973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d2bc1c-3dd2-419e-96b3-32f1400675cf service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:52.024165 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1297/2556] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:57.031615 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbde305-af2b-4722-a5ee-5bfb62f05874 service nova] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:57.033047 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4cbde305-af2b-4722-a5ee-5bfb62f05874 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:57.089938 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbde305-af2b-4722-a5ee-5bfb62f05874 service nova] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:57.094158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a379d-f546-458f-bf82-e7572525d21f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:57.094844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a379d-f546-458f-bf82-e7572525d21f service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:57.095137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a379d-f546-458f-bf82-e7572525d21f service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:57.095427 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a379d-f546-458f-bf82-e7572525d21f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:57.097221 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-bf8a379d-f546-458f-bf82-e7572525d21f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:57.102324 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:57.160163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a379d-f546-458f-bf82-e7572525d21f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:57.161591 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a379d-f546-458f-bf82-e7572525d21f service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:57.171277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1260/2557] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:57 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:58.831813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2bc1c-3dd2-419e-96b3-32f1400675cf service nova] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:58.899567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2bc1c-3dd2-419e-96b3-32f1400675cf service nova] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:58.905030 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee92669-b4ad-4dc7-a137-7e164b3afa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:58.909593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee92669-b4ad-4dc7-a137-7e164b3afa74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:58.909593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee92669-b4ad-4dc7-a137-7e164b3afa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:58.909593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee92669-b4ad-4dc7-a137-7e164b3afa74 admin admin] PATH_INFO: `/v3/users/c85ce74df7c84c90bd9146eee279f460` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:58.909593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee92669-b4ad-4dc7-a137-7e164b3afa74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85ce74df7c84c90bd9146eee279f460)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:58.909901 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee92669-b4ad-4dc7-a137-7e164b3afa74 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:59.145224 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9ee92669-b4ad-4dc7-a137-7e164b3afa74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85ce74df7c84c90bd9146eee279f460'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:59.242360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9ee92669-b4ad-4dc7-a137-7e164b3afa74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85ce74df7c84c90bd9146eee279f460'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:59.242999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9ee92669-b4ad-4dc7-a137-7e164b3afa74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85ce74df7c84c90bd9146eee279f460'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:59.245361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:05:59.251501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9ee92669-b4ad-4dc7-a137-7e164b3afa74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85ce74df7c84c90bd9146eee279f460'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:59.264041 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-9ee92669-b4ad-4dc7-a137-7e164b3afa74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85ce74df7c84c90bd9146eee279f460'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:05:59.269838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1298/2558] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:05:58 2022] DELETE /identity/v3/users/c85ce74df7c84c90bd9146eee279f460 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:05:59.274529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cd1b3-5568-4b87-8d8f-a7276f3a98b4 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:59.275264 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cd1b3-5568-4b87-8d8f-a7276f3a98b4 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:59.275361 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cd1b3-5568-4b87-8d8f-a7276f3a98b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:59.292170 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-cf0cd1b3-5568-4b87-8d8f-a7276f3a98b4 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:05:59.293878 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cf0cd1b3-5568-4b87-8d8f-a7276f3a98b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:59.353136 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1261/2559] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:05:59.363140 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee92669-b4ad-4dc7-a137-7e164b3afa74 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:59.364549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9ee92669-b4ad-4dc7-a137-7e164b3afa74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:59.422320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee92669-b4ad-4dc7-a137-7e164b3afa74 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:59.425891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66ef61-ad04-4e1d-8abb-da23816ba82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:59.426577 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66ef61-ad04-4e1d-8abb-da23816ba82d service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:59.426864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66ef61-ad04-4e1d-8abb-da23816ba82d service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:59.427148 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66ef61-ad04-4e1d-8abb-da23816ba82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:59.436977 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66ef61-ad04-4e1d-8abb-da23816ba82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:59.438529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66ef61-ad04-4e1d-8abb-da23816ba82d service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:05:59.448013 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1299/2560] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:05:59.920729 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cd1b3-5568-4b87-8d8f-a7276f3a98b4 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:05:59.922222 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cf0cd1b3-5568-4b87-8d8f-a7276f3a98b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:05:59.934405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cd1b3-5568-4b87-8d8f-a7276f3a98b4 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:05:59.940336 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb71f5-9b17-49fc-bad7-0a7bd800ec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:05:59.941658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb71f5-9b17-49fc-bad7-0a7bd800ec4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:05:59.945024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb71f5-9b17-49fc-bad7-0a7bd800ec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:05:59.945024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb71f5-9b17-49fc-bad7-0a7bd800ec4e admin admin] PATH_INFO: `/v3/projects/e05d29e01c5046ddac905550655c466e` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:05:59.945024 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb71f5-9b17-49fc-bad7-0a7bd800ec4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e05d29e01c5046ddac905550655c466e)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:05:59.947804 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb71f5-9b17-49fc-bad7-0a7bd800ec4e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:00.089439 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a7cb71f5-9b17-49fc-bad7-0a7bd800ec4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e05d29e01c5046ddac905550655c466e', 'request_id': 'req-a7cb71f5-9b17-49fc-bad7-0a7bd800ec4e'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:00.171471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a7cb71f5-9b17-49fc-bad7-0a7bd800ec4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e05d29e01c5046ddac905550655c466e', 'request_id': 'req-a7cb71f5-9b17-49fc-bad7-0a7bd800ec4e'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:00.180600 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a7cb71f5-9b17-49fc-bad7-0a7bd800ec4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e05d29e01c5046ddac905550655c466e', 'request_id': 'req-a7cb71f5-9b17-49fc-bad7-0a7bd800ec4e'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:00.193806 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a7cb71f5-9b17-49fc-bad7-0a7bd800ec4e admin admin] The token cache is being invalidate because project e05d29e01c5046ddac905550655c466e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:06:00.194103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a7cb71f5-9b17-49fc-bad7-0a7bd800ec4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:00.194798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a7cb71f5-9b17-49fc-bad7-0a7bd800ec4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:00.196529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1262/2561] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:05:59 2022] DELETE /identity/v3/projects/e05d29e01c5046ddac905550655c466e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:00.204082 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2feda1-e626-4863-a2cd-170f028ce4f1 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:00.211786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2feda1-e626-4863-a2cd-170f028ce4f1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:00.211786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2feda1-e626-4863-a2cd-170f028ce4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:00.235890 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-6b2feda1-e626-4863-a2cd-170f028ce4f1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:00.237323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-6b2feda1-e626-4863-a2cd-170f028ce4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:00.307821 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1300/2562] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:00.317272 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edeea74-a5b4-4ecd-8967-ec9420fa53e6 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:00.318169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edeea74-a5b4-4ecd-8967-ec9420fa53e6 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:00.318549 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edeea74-a5b4-4ecd-8967-ec9420fa53e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:00.341370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-2edeea74-a5b4-4ecd-8967-ec9420fa53e6 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:00.342760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2edeea74-a5b4-4ecd-8967-ec9420fa53e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:00.351544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1263/2563] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:06:00.356046 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2feda1-e626-4863-a2cd-170f028ce4f1 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:00.367758 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2feda1-e626-4863-a2cd-170f028ce4f1 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:00.373062 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262421ff-aea9-4e65-abc2-14a798e10216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:00.374312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262421ff-aea9-4e65-abc2-14a798e10216 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:00.374857 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262421ff-aea9-4e65-abc2-14a798e10216 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:00.375553 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262421ff-aea9-4e65-abc2-14a798e10216 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:00.376469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262421ff-aea9-4e65-abc2-14a798e10216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:06:00.376933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262421ff-aea9-4e65-abc2-14a798e10216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:00.379008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262421ff-aea9-4e65-abc2-14a798e10216 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:00.398066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1301/2564] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 20:06:00.402544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edeea74-a5b4-4ecd-8967-ec9420fa53e6 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:00.428072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edeea74-a5b4-4ecd-8967-ec9420fa53e6 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:00.436434 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60b7bc-f16a-4822-b332-d76eb2d665ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:00.437112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60b7bc-f16a-4822-b332-d76eb2d665ee admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:00.437400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60b7bc-f16a-4822-b332-d76eb2d665ee admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:00.437682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60b7bc-f16a-4822-b332-d76eb2d665ee admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:00.438802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60b7bc-f16a-4822-b332-d76eb2d665ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:00.440487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60b7bc-f16a-4822-b332-d76eb2d665ee admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:00.465370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:00.618783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1264/2565] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:06:00 2022] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:06:00.622873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262421ff-aea9-4e65-abc2-14a798e10216 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:00.632774 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262421ff-aea9-4e65-abc2-14a798e10216 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:00.695768 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d173c66-3c5c-4437-8d1a-25fafea5aeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:00.696452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d173c66-3c5c-4437-8d1a-25fafea5aeee admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:00.696739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d173c66-3c5c-4437-8d1a-25fafea5aeee admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:00.697018 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d173c66-3c5c-4437-8d1a-25fafea5aeee admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:00.697721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d173c66-3c5c-4437-8d1a-25fafea5aeee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:00.699760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d173c66-3c5c-4437-8d1a-25fafea5aeee admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:00.709439 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:00.827150 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1302/2566] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:06:00 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:06:00.831144 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60b7bc-f16a-4822-b332-d76eb2d665ee admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:00.842284 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60b7bc-f16a-4822-b332-d76eb2d665ee admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:00.851303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b80cf9-0177-4a10-a97f-17ab1437f596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:00.851303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80cf9-0177-4a10-a97f-17ab1437f596 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:00.851303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80cf9-0177-4a10-a97f-17ab1437f596 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:00.851303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80cf9-0177-4a10-a97f-17ab1437f596 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:00.851691 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b80cf9-0177-4a10-a97f-17ab1437f596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:00.851691 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b80cf9-0177-4a10-a97f-17ab1437f596 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:00.861349 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1265/2567] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:00.865538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d173c66-3c5c-4437-8d1a-25fafea5aeee admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:00.887651 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d173c66-3c5c-4437-8d1a-25fafea5aeee admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:00.887878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6788a-b7cd-409d-9004-696cc455e99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:00.888447 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6788a-b7cd-409d-9004-696cc455e99d admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:00.888738 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6788a-b7cd-409d-9004-696cc455e99d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:00.889022 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6788a-b7cd-409d-9004-696cc455e99d admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:00.889763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6788a-b7cd-409d-9004-696cc455e99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:00.891424 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6788a-b7cd-409d-9004-696cc455e99d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:00.903547 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1303/2568] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:00.907954 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b80cf9-0177-4a10-a97f-17ab1437f596 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:00.917850 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b80cf9-0177-4a10-a97f-17ab1437f596 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:00.922542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced304e9-470e-4f59-9694-0f1c5b03f875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:00.923413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced304e9-470e-4f59-9694-0f1c5b03f875 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:00.923696 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced304e9-470e-4f59-9694-0f1c5b03f875 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:00.923972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced304e9-470e-4f59-9694-0f1c5b03f875 admin admin] PATH_INFO: `/v3/projects/f4cf68b04cee45fa944a501b3e391dc6/users/2b5bc921996b4d239c14229bb373c9a6/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:00.938680 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced304e9-470e-4f59-9694-0f1c5b03f875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4cf68b04cee45fa944a501b3e391dc6, user_id=2b5bc921996b4d239c14229bb373c9a6, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:00.941376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced304e9-470e-4f59-9694-0f1c5b03f875 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:01.054016 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1266/2569] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:06:00 2022] PUT /identity/v3/projects/f4cf68b04cee45fa944a501b3e391dc6/users/2b5bc921996b4d239c14229bb373c9a6/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:01.066864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a0334-d2c8-4c15-a41a-b8f658648330 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:01.067176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a0334-d2c8-4c15-a41a-b8f658648330 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:01.067471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a0334-d2c8-4c15-a41a-b8f658648330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:01.094323 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-251a0334-d2c8-4c15-a41a-b8f658648330 None None] MFA Rules not processed for user `2b5bc921996b4d239c14229bb373c9a6`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:01.095564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-251a0334-d2c8-4c15-a41a-b8f658648330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:01.157710 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1304/2570] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:01.162282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced304e9-470e-4f59-9694-0f1c5b03f875 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:01.225628 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced304e9-470e-4f59-9694-0f1c5b03f875 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:01.230599 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af40f96-f7a5-41a4-b606-8d14d45cb20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:01.231467 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af40f96-f7a5-41a4-b606-8d14d45cb20c admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:01.231758 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af40f96-f7a5-41a4-b606-8d14d45cb20c admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:01.232036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af40f96-f7a5-41a4-b606-8d14d45cb20c admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:01.232728 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af40f96-f7a5-41a4-b606-8d14d45cb20c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:01.234644 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af40f96-f7a5-41a4-b606-8d14d45cb20c admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:01.383835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1267/2571] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:06:01 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:06:01.388548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a0334-d2c8-4c15-a41a-b8f658648330 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:01.399145 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a0334-d2c8-4c15-a41a-b8f658648330 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:01.456369 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e283b3a-1d50-4d8c-af8e-26f118d875f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:01.457047 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e283b3a-1d50-4d8c-af8e-26f118d875f4 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:01.457334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e283b3a-1d50-4d8c-af8e-26f118d875f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:01.457616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e283b3a-1d50-4d8c-af8e-26f118d875f4 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:01.458315 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e283b3a-1d50-4d8c-af8e-26f118d875f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:01.460285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e283b3a-1d50-4d8c-af8e-26f118d875f4 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:01.600994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1305/2572] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:06:01 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:06:01.602289 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af40f96-f7a5-41a4-b606-8d14d45cb20c admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:01.613341 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af40f96-f7a5-41a4-b606-8d14d45cb20c admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:01.618541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427bfb3-29fc-4ab6-a66d-d68c44120774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:01.619215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427bfb3-29fc-4ab6-a66d-d68c44120774 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:01.619506 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427bfb3-29fc-4ab6-a66d-d68c44120774 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:01.619790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427bfb3-29fc-4ab6-a66d-d68c44120774 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:01.620557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427bfb3-29fc-4ab6-a66d-d68c44120774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:01.622963 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427bfb3-29fc-4ab6-a66d-d68c44120774 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:01.634655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1268/2573] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:01.638633 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e283b3a-1d50-4d8c-af8e-26f118d875f4 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:01.649307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e283b3a-1d50-4d8c-af8e-26f118d875f4 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:01.654265 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e817b63-b30e-4602-bae4-c84b7f691311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:01.655236 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e817b63-b30e-4602-bae4-c84b7f691311 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:01.655526 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e817b63-b30e-4602-bae4-c84b7f691311 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:01.655994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e817b63-b30e-4602-bae4-c84b7f691311 admin admin] PATH_INFO: `/v3/projects/731802e996564987a86b3d695d2f1170/users/5df4e266980b46ab8661d7584d56d06d/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:01.672176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e817b63-b30e-4602-bae4-c84b7f691311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=731802e996564987a86b3d695d2f1170, user_id=5df4e266980b46ab8661d7584d56d06d, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:01.679973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e817b63-b30e-4602-bae4-c84b7f691311 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:01.804200 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1306/2574] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:06:01 2022] PUT /identity/v3/projects/731802e996564987a86b3d695d2f1170/users/5df4e266980b46ab8661d7584d56d06d/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:01.808290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427bfb3-29fc-4ab6-a66d-d68c44120774 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:01.821959 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427bfb3-29fc-4ab6-a66d-d68c44120774 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:01.892497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447db6c8-ede7-4f86-af50-085ccab71a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:01.893174 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447db6c8-ede7-4f86-af50-085ccab71a2c admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:01.893464 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447db6c8-ede7-4f86-af50-085ccab71a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:01.893742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447db6c8-ede7-4f86-af50-085ccab71a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:01.894517 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447db6c8-ede7-4f86-af50-085ccab71a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:01.896308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447db6c8-ede7-4f86-af50-085ccab71a2c admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:01.907220 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1269/2575] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:01.911497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e817b63-b30e-4602-bae4-c84b7f691311 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:01.922373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e817b63-b30e-4602-bae4-c84b7f691311 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:01.926939 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287edd7b-bbf3-4b4e-a69b-1e826b631e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:01.927819 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287edd7b-bbf3-4b4e-a69b-1e826b631e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:01.928110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287edd7b-bbf3-4b4e-a69b-1e826b631e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:01.928395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287edd7b-bbf3-4b4e-a69b-1e826b631e34 admin admin] PATH_INFO: `/v3/projects/731802e996564987a86b3d695d2f1170/users/5df4e266980b46ab8661d7584d56d06d/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:01.930430 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287edd7b-bbf3-4b4e-a69b-1e826b631e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=731802e996564987a86b3d695d2f1170, user_id=5df4e266980b46ab8661d7584d56d06d, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:01.933172 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287edd7b-bbf3-4b4e-a69b-1e826b631e34 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:01.944300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1307/2576] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:06:01 2022] PUT /identity/v3/projects/731802e996564987a86b3d695d2f1170/users/5df4e266980b46ab8661d7584d56d06d/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:01.954322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdc4a6-a1de-468d-91d2-0c377bc46d72 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:01.954646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdc4a6-a1de-468d-91d2-0c377bc46d72 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:01.954932 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bdc4a6-a1de-468d-91d2-0c377bc46d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:01.982959 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-d9bdc4a6-a1de-468d-91d2-0c377bc46d72 None None] MFA Rules not processed for user `5df4e266980b46ab8661d7584d56d06d`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:01.984190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d9bdc4a6-a1de-468d-91d2-0c377bc46d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:02.002499 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:02.050976 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1270/2577] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:02.061487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287edd7b-bbf3-4b4e-a69b-1e826b631e34 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:02.063355 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-287edd7b-bbf3-4b4e-a69b-1e826b631e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:02.093609 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:02.124938 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287edd7b-bbf3-4b4e-a69b-1e826b631e34 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:02.128608 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2688d2-9f06-450d-96f0-de18fdd44afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:02.129292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2688d2-9f06-450d-96f0-de18fdd44afd service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:02.129592 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2688d2-9f06-450d-96f0-de18fdd44afd service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:02.129859 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2688d2-9f06-450d-96f0-de18fdd44afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:02.184642 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2688d2-9f06-450d-96f0-de18fdd44afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:02.186006 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2688d2-9f06-450d-96f0-de18fdd44afd service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:02.195080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1308/2578] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:06:02.599163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052dc6d-906f-46ef-aa09-2725ff3aa4c4 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:02.599614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052dc6d-906f-46ef-aa09-2725ff3aa4c4 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:02.599729 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052dc6d-906f-46ef-aa09-2725ff3aa4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:02.618896 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-3052dc6d-906f-46ef-aa09-2725ff3aa4c4 None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:02.620105 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-3052dc6d-906f-46ef-aa09-2725ff3aa4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:02.675151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1271/2579] 10.222.0.15 () {58 vars in 967 bytes} [Fri May 27 20:06:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:02.716915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2688d2-9f06-450d-96f0-de18fdd44afd service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:02.718509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-fe2688d2-9f06-450d-96f0-de18fdd44afd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:02.794069 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2688d2-9f06-450d-96f0-de18fdd44afd service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:02.799325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3fde4-a9cb-44f9-8f8d-c19143ef61a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:02.799983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3fde4-a9cb-44f9-8f8d-c19143ef61a7 service swift] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:02.800275 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3fde4-a9cb-44f9-8f8d-c19143ef61a7 service swift] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:02.800562 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3fde4-a9cb-44f9-8f8d-c19143ef61a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:02.809863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3fde4-a9cb-44f9-8f8d-c19143ef61a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:02.811552 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3fde4-a9cb-44f9-8f8d-c19143ef61a7 service swift] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:02.821502 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1309/2580] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:06:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 20:06:05.658597 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052dc6d-906f-46ef-aa09-2725ff3aa4c4 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:05.660005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-3052dc6d-906f-46ef-aa09-2725ff3aa4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:05.671266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052dc6d-906f-46ef-aa09-2725ff3aa4c4 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:05.674973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c2b69-e6cc-46fc-98ea-e7fbf569588a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:05.675619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c2b69-e6cc-46fc-98ea-e7fbf569588a service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:05.675902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c2b69-e6cc-46fc-98ea-e7fbf569588a service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:05.676178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c2b69-e6cc-46fc-98ea-e7fbf569588a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:05.686026 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c2b69-e6cc-46fc-98ea-e7fbf569588a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:05.687497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c2b69-e6cc-46fc-98ea-e7fbf569588a service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:05.697100 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1272/2581] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:06:08.213304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3fde4-a9cb-44f9-8f8d-c19143ef61a7 service swift] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:08.215098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-83b3fde4-a9cb-44f9-8f8d-c19143ef61a7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:08.310050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3fde4-a9cb-44f9-8f8d-c19143ef61a7 service swift] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:08.316335 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ed269-9032-4015-9e30-ac0768a594fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394b43cef91f4990b4707cb7a6798068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:08.318898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ed269-9032-4015-9e30-ac0768a594fd service placement] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:08.319191 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ed269-9032-4015-9e30-ac0768a594fd service placement] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:08.319474 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ed269-9032-4015-9e30-ac0768a594fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:08.321341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-0c3ed269-9032-4015-9e30-ac0768a594fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:08.334835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ed269-9032-4015-9e30-ac0768a594fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:08.337036 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ed269-9032-4015-9e30-ac0768a594fd service placement] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:08.342319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:08.350076 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1310/2582] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:06:09.656620 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9652719-5258-4838-95e8-c64058126c2a None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:09.669137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9652719-5258-4838-95e8-c64058126c2a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:09.669137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9652719-5258-4838-95e8-c64058126c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:09.696776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-e9652719-5258-4838-95e8-c64058126c2a None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:09.698043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e9652719-5258-4838-95e8-c64058126c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:09.709826 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1273/2583] 10.222.0.15 () {58 vars in 1009 bytes} [Fri May 27 20:06:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:09.724038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ed269-9032-4015-9e30-ac0768a594fd service placement] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:09.735964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ed269-9032-4015-9e30-ac0768a594fd service placement] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:09.741653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa4cfb-6c12-489c-b69f-44b66dc4caa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:09.742503 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa4cfb-6c12-489c-b69f-44b66dc4caa6 service swift] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:09.742865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa4cfb-6c12-489c-b69f-44b66dc4caa6 service swift] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:09.743320 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa4cfb-6c12-489c-b69f-44b66dc4caa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:09.753659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa4cfb-6c12-489c-b69f-44b66dc4caa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:09.756218 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa4cfb-6c12-489c-b69f-44b66dc4caa6 service swift] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:09.770965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1311/2584] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:06:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 20:06:12.998923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9652719-5258-4838-95e8-c64058126c2a None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:13.001049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e9652719-5258-4838-95e8-c64058126c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:13.083209 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9652719-5258-4838-95e8-c64058126c2a None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:13.090192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab79eaa-0a06-4a70-b4cb-b4b77b70b127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:13.091910 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab79eaa-0a06-4a70-b4cb-b4b77b70b127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:13.092259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab79eaa-0a06-4a70-b4cb-b4b77b70b127 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:13.092609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab79eaa-0a06-4a70-b4cb-b4b77b70b127 admin admin] PATH_INFO: `/v3/users/7ee06ebacbc04c49add09fa5fd709555` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:13.093945 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab79eaa-0a06-4a70-b4cb-b4b77b70b127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ee06ebacbc04c49add09fa5fd709555)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:13.095975 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab79eaa-0a06-4a70-b4cb-b4b77b70b127 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:13.397697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:13.400951 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9ab79eaa-0a06-4a70-b4cb-b4b77b70b127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ee06ebacbc04c49add09fa5fd709555'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:13.401634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9ab79eaa-0a06-4a70-b4cb-b4b77b70b127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ee06ebacbc04c49add09fa5fd709555'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:13.749176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9ab79eaa-0a06-4a70-b4cb-b4b77b70b127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ee06ebacbc04c49add09fa5fd709555'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:13.761631 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9ab79eaa-0a06-4a70-b4cb-b4b77b70b127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ee06ebacbc04c49add09fa5fd709555'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:13.768805 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9ab79eaa-0a06-4a70-b4cb-b4b77b70b127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ee06ebacbc04c49add09fa5fd709555'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:13.774904 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1274/2585] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:06:12 2022] DELETE /identity/v3/users/7ee06ebacbc04c49add09fa5fd709555 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:14.048092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa4cfb-6c12-489c-b69f-44b66dc4caa6 service swift] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:14.065517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa4cfb-6c12-489c-b69f-44b66dc4caa6 service swift] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:14.178368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f26a8-49e6-4305-9e50-8e8d53c3412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:14.179298 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f26a8-49e6-4305-9e50-8e8d53c3412c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:14.179592 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f26a8-49e6-4305-9e50-8e8d53c3412c admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:14.179870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f26a8-49e6-4305-9e50-8e8d53c3412c admin admin] PATH_INFO: `/v3/projects/7ca6f770f8194777b2998aa6f74a5d05` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:14.181214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f26a8-49e6-4305-9e50-8e8d53c3412c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca6f770f8194777b2998aa6f74a5d05)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:14.185066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f26a8-49e6-4305-9e50-8e8d53c3412c admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:14.360667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a51f26a8-49e6-4305-9e50-8e8d53c3412c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca6f770f8194777b2998aa6f74a5d05', 'request_id': 'req-a51f26a8-49e6-4305-9e50-8e8d53c3412c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:14.369435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a51f26a8-49e6-4305-9e50-8e8d53c3412c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca6f770f8194777b2998aa6f74a5d05', 'request_id': 'req-a51f26a8-49e6-4305-9e50-8e8d53c3412c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:14.376168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a51f26a8-49e6-4305-9e50-8e8d53c3412c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca6f770f8194777b2998aa6f74a5d05', 'request_id': 'req-a51f26a8-49e6-4305-9e50-8e8d53c3412c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:14.464078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a51f26a8-49e6-4305-9e50-8e8d53c3412c admin admin] The token cache is being invalidate because project 7ca6f770f8194777b2998aa6f74a5d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:06:14.464078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a51f26a8-49e6-4305-9e50-8e8d53c3412c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:14.464078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a51f26a8-49e6-4305-9e50-8e8d53c3412c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:14.465265 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1312/2586] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:06:14 2022] DELETE /identity/v3/projects/7ca6f770f8194777b2998aa6f74a5d05 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:14.470812 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab79eaa-0a06-4a70-b4cb-b4b77b70b127 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:14.473135 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9ab79eaa-0a06-4a70-b4cb-b4b77b70b127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:14.493040 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab79eaa-0a06-4a70-b4cb-b4b77b70b127 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:14.584826 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd471bb-2f4b-44de-b27d-6e91c954aa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:14.585854 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd471bb-2f4b-44de-b27d-6e91c954aa73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:14.586208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd471bb-2f4b-44de-b27d-6e91c954aa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:14.586593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd471bb-2f4b-44de-b27d-6e91c954aa73 admin admin] PATH_INFO: `/v3/users/7a56c98955d145c3b721f25dcfcd8546` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:14.587891 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd471bb-2f4b-44de-b27d-6e91c954aa73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a56c98955d145c3b721f25dcfcd8546)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:14.589933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd471bb-2f4b-44de-b27d-6e91c954aa73 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:14.824081 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cfd471bb-2f4b-44de-b27d-6e91c954aa73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a56c98955d145c3b721f25dcfcd8546'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:14.825116 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cfd471bb-2f4b-44de-b27d-6e91c954aa73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a56c98955d145c3b721f25dcfcd8546'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:14.919978 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cfd471bb-2f4b-44de-b27d-6e91c954aa73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a56c98955d145c3b721f25dcfcd8546'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:14.934804 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cfd471bb-2f4b-44de-b27d-6e91c954aa73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a56c98955d145c3b721f25dcfcd8546'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:14.943536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cfd471bb-2f4b-44de-b27d-6e91c954aa73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a56c98955d145c3b721f25dcfcd8546'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:14.951635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1275/2587] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:06:14 2022] DELETE /identity/v3/users/7a56c98955d145c3b721f25dcfcd8546 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:15.341059 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f26a8-49e6-4305-9e50-8e8d53c3412c admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:15.341580 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a51f26a8-49e6-4305-9e50-8e8d53c3412c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:15.355382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f26a8-49e6-4305-9e50-8e8d53c3412c admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:15.459910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4928da-4e6f-4311-a5f4-aeecbb099095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:15.463602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4928da-4e6f-4311-a5f4-aeecbb099095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:15.464062 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4928da-4e6f-4311-a5f4-aeecbb099095 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:15.464732 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4928da-4e6f-4311-a5f4-aeecbb099095 admin admin] PATH_INFO: `/v3/projects/5f577e5e9371400c8234960b82505bd1` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:15.470640 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4928da-4e6f-4311-a5f4-aeecbb099095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f577e5e9371400c8234960b82505bd1)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:15.472851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4928da-4e6f-4311-a5f4-aeecbb099095 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:15.494173 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:15.675270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ca4928da-4e6f-4311-a5f4-aeecbb099095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f577e5e9371400c8234960b82505bd1', 'request_id': 'req-ca4928da-4e6f-4311-a5f4-aeecbb099095'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:15.682206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ca4928da-4e6f-4311-a5f4-aeecbb099095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f577e5e9371400c8234960b82505bd1', 'request_id': 'req-ca4928da-4e6f-4311-a5f4-aeecbb099095'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:15.692279 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ca4928da-4e6f-4311-a5f4-aeecbb099095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f577e5e9371400c8234960b82505bd1', 'request_id': 'req-ca4928da-4e6f-4311-a5f4-aeecbb099095'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:15.774568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ca4928da-4e6f-4311-a5f4-aeecbb099095 admin admin] The token cache is being invalidate because project 5f577e5e9371400c8234960b82505bd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:06:15.774568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ca4928da-4e6f-4311-a5f4-aeecbb099095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:15.774568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ca4928da-4e6f-4311-a5f4-aeecbb099095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:15.779509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1313/2588] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:06:15 2022] DELETE /identity/v3/projects/5f577e5e9371400c8234960b82505bd1 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:23.599277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd471bb-2f4b-44de-b27d-6e91c954aa73 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:23.600701 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cfd471bb-2f4b-44de-b27d-6e91c954aa73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:23.613593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd471bb-2f4b-44de-b27d-6e91c954aa73 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:23.652251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:23.670013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b70ab-a520-4136-8783-4e6b555ef1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:23.678120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b70ab-a520-4136-8783-4e6b555ef1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:23.678120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b70ab-a520-4136-8783-4e6b555ef1de admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:23.678120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b70ab-a520-4136-8783-4e6b555ef1de admin admin] PATH_INFO: `/v3/users/2b5bc921996b4d239c14229bb373c9a6` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:23.678120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b70ab-a520-4136-8783-4e6b555ef1de admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b5bc921996b4d239c14229bb373c9a6)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:23.678120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b70ab-a520-4136-8783-4e6b555ef1de admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:23.932166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9d6b70ab-a520-4136-8783-4e6b555ef1de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b5bc921996b4d239c14229bb373c9a6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:23.932831 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9d6b70ab-a520-4136-8783-4e6b555ef1de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b5bc921996b4d239c14229bb373c9a6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:24.034233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9d6b70ab-a520-4136-8783-4e6b555ef1de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b5bc921996b4d239c14229bb373c9a6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:24.047937 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9d6b70ab-a520-4136-8783-4e6b555ef1de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b5bc921996b4d239c14229bb373c9a6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:24.054767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-9d6b70ab-a520-4136-8783-4e6b555ef1de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b5bc921996b4d239c14229bb373c9a6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:24.060975 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1276/2589] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:06:23 2022] DELETE /identity/v3/users/2b5bc921996b4d239c14229bb373c9a6 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:24.066106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b490a-6b95-4c7d-9a38-6e0b69fb9301 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:24.066604 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b490a-6b95-4c7d-9a38-6e0b69fb9301 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:24.071141 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b490a-6b95-4c7d-9a38-6e0b69fb9301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:24.084101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-4e1b490a-6b95-4c7d-9a38-6e0b69fb9301 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:24.085301 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4e1b490a-6b95-4c7d-9a38-6e0b69fb9301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:24.144554 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1314/2590] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:24.156179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b70ab-a520-4136-8783-4e6b555ef1de admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:24.157722 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9d6b70ab-a520-4136-8783-4e6b555ef1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:24.216577 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b70ab-a520-4136-8783-4e6b555ef1de admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:24.220416 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fc00b-11f3-47f8-80b0-139a544c5a07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:24.221005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fc00b-11f3-47f8-80b0-139a544c5a07 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:24.221292 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fc00b-11f3-47f8-80b0-139a544c5a07 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:24.221574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fc00b-11f3-47f8-80b0-139a544c5a07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:24.230786 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fc00b-11f3-47f8-80b0-139a544c5a07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:24.232210 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fc00b-11f3-47f8-80b0-139a544c5a07 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:24.242248 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1277/2591] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:06:24.544946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b490a-6b95-4c7d-9a38-6e0b69fb9301 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:24.547074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4e1b490a-6b95-4c7d-9a38-6e0b69fb9301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:24.560266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b490a-6b95-4c7d-9a38-6e0b69fb9301 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:24.565375 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a87332-e24e-489c-af7e-960acd3f0f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:24.566263 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a87332-e24e-489c-af7e-960acd3f0f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:24.566579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a87332-e24e-489c-af7e-960acd3f0f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:24.566864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a87332-e24e-489c-af7e-960acd3f0f6c admin admin] PATH_INFO: `/v3/users/baee0900964b4dd09c690307a9734794` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:24.568167 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a87332-e24e-489c-af7e-960acd3f0f6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=baee0900964b4dd09c690307a9734794)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:24.570188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a87332-e24e-489c-af7e-960acd3f0f6c admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:24.728719 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fc00b-11f3-47f8-80b0-139a544c5a07 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:24.729247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-5c0fc00b-11f3-47f8-80b0-139a544c5a07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:24.748168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fc00b-11f3-47f8-80b0-139a544c5a07 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:24.753778 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1b5be-cd68-40e9-925c-b755f1515151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:24.754648 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1b5be-cd68-40e9-925c-b755f1515151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:24.754948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1b5be-cd68-40e9-925c-b755f1515151 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:24.755217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1b5be-cd68-40e9-925c-b755f1515151 admin admin] PATH_INFO: `/v3/projects/f4cf68b04cee45fa944a501b3e391dc6` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:24.756936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1b5be-cd68-40e9-925c-b755f1515151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4cf68b04cee45fa944a501b3e391dc6)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:24.758912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1b5be-cd68-40e9-925c-b755f1515151 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:24.770430 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b2a87332-e24e-489c-af7e-960acd3f0f6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baee0900964b4dd09c690307a9734794'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:24.862795 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b2a87332-e24e-489c-af7e-960acd3f0f6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baee0900964b4dd09c690307a9734794'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:24.863415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b2a87332-e24e-489c-af7e-960acd3f0f6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baee0900964b4dd09c690307a9734794'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:24.871145 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b2a87332-e24e-489c-af7e-960acd3f0f6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baee0900964b4dd09c690307a9734794'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:24.883389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-b2a87332-e24e-489c-af7e-960acd3f0f6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baee0900964b4dd09c690307a9734794'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:24.890734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1315/2592] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:06:24 2022] DELETE /identity/v3/users/baee0900964b4dd09c690307a9734794 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:24.973310 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-07f1b5be-cd68-40e9-925c-b755f1515151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4cf68b04cee45fa944a501b3e391dc6', 'request_id': 'req-07f1b5be-cd68-40e9-925c-b755f1515151'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.078312 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-07f1b5be-cd68-40e9-925c-b755f1515151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4cf68b04cee45fa944a501b3e391dc6', 'request_id': 'req-07f1b5be-cd68-40e9-925c-b755f1515151'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.079732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:25.085734 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-07f1b5be-cd68-40e9-925c-b755f1515151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4cf68b04cee45fa944a501b3e391dc6', 'request_id': 'req-07f1b5be-cd68-40e9-925c-b755f1515151'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.097872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-07f1b5be-cd68-40e9-925c-b755f1515151 admin admin] The token cache is being invalidate because project f4cf68b04cee45fa944a501b3e391dc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:06:25.098198 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-07f1b5be-cd68-40e9-925c-b755f1515151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.098889 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-07f1b5be-cd68-40e9-925c-b755f1515151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.100469 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1278/2593] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:06:24 2022] DELETE /identity/v3/projects/f4cf68b04cee45fa944a501b3e391dc6 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:06:25.104452 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a87332-e24e-489c-af7e-960acd3f0f6c admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:25.105891 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-b2a87332-e24e-489c-af7e-960acd3f0f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:25.126276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:25.170259 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a87332-e24e-489c-af7e-960acd3f0f6c admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:25.188278 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1b5be-cd68-40e9-925c-b755f1515151 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:25.190017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-07f1b5be-cd68-40e9-925c-b755f1515151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:25.243648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64be68c-3ff7-45b5-bf8f-645b3c50ef96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:25.244461 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64be68c-3ff7-45b5-bf8f-645b3c50ef96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:25.244753 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64be68c-3ff7-45b5-bf8f-645b3c50ef96 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:25.245034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64be68c-3ff7-45b5-bf8f-645b3c50ef96 admin admin] PATH_INFO: `/v3/users/5df4e266980b46ab8661d7584d56d06d` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:25.246263 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64be68c-3ff7-45b5-bf8f-645b3c50ef96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df4e266980b46ab8661d7584d56d06d)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:25.248257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64be68c-3ff7-45b5-bf8f-645b3c50ef96 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:25.269306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1b5be-cd68-40e9-925c-b755f1515151 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:25.274117 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:25.275010 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:25.275301 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:25.275584 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc admin admin] PATH_INFO: `/v3/projects/4b09d31150ce4005bc0db5f02c970f10` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:25.277037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b09d31150ce4005bc0db5f02c970f10)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:25.278993 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:25.490743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b09d31150ce4005bc0db5f02c970f10', 'request_id': 'req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.491050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a64be68c-3ff7-45b5-bf8f-645b3c50ef96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df4e266980b46ab8661d7584d56d06d'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.588641 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b09d31150ce4005bc0db5f02c970f10', 'request_id': 'req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.595639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b09d31150ce4005bc0db5f02c970f10', 'request_id': 'req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.607001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc admin admin] The token cache is being invalidate because project 4b09d31150ce4005bc0db5f02c970f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:06:25.607298 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.608265 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.610510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1279/2594] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:06:25 2022] DELETE /identity/v3/projects/4b09d31150ce4005bc0db5f02c970f10 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:06:25.614686 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:25.616151 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:25.684754 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9dfd8-8dc1-40cd-adcc-6d634808e1dc admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:25.692835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f533b3-4bad-406b-b318-94654e9aaaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:25.692835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f533b3-4bad-406b-b318-94654e9aaaef admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:25.692835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f533b3-4bad-406b-b318-94654e9aaaef admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:25.692835 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f533b3-4bad-406b-b318-94654e9aaaef admin admin] PATH_INFO: `/v3/users/d46d4657026941f4949ecd33488c4ffe` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:25.693234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f533b3-4bad-406b-b318-94654e9aaaef admin admin] RBAC: Authorizing `identity:delete_user(user_id=d46d4657026941f4949ecd33488c4ffe)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:25.694529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f533b3-4bad-406b-b318-94654e9aaaef admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:25.765776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a64be68c-3ff7-45b5-bf8f-645b3c50ef96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df4e266980b46ab8661d7584d56d06d'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.765915 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:25.766391 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a64be68c-3ff7-45b5-bf8f-645b3c50ef96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df4e266980b46ab8661d7584d56d06d'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.773840 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a64be68c-3ff7-45b5-bf8f-645b3c50ef96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df4e266980b46ab8661d7584d56d06d'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.786151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a64be68c-3ff7-45b5-bf8f-645b3c50ef96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df4e266980b46ab8661d7584d56d06d'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.792308 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1316/2595] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:06:25 2022] DELETE /identity/v3/users/5df4e266980b46ab8661d7584d56d06d => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:25.984699 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-d2f533b3-4bad-406b-b318-94654e9aaaef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd46d4657026941f4949ecd33488c4ffe'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:25.985899 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-d2f533b3-4bad-406b-b318-94654e9aaaef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd46d4657026941f4949ecd33488c4ffe'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:26.074231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-d2f533b3-4bad-406b-b318-94654e9aaaef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd46d4657026941f4949ecd33488c4ffe'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:26.088782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-d2f533b3-4bad-406b-b318-94654e9aaaef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd46d4657026941f4949ecd33488c4ffe'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:26.096897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-d2f533b3-4bad-406b-b318-94654e9aaaef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd46d4657026941f4949ecd33488c4ffe'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:26.106636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1280/2596] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:06:25 2022] DELETE /identity/v3/users/d46d4657026941f4949ecd33488c4ffe => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:26.345608 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64be68c-3ff7-45b5-bf8f-645b3c50ef96 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:26.345608 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a64be68c-3ff7-45b5-bf8f-645b3c50ef96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:26.394822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f533b3-4bad-406b-b318-94654e9aaaef admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:26.396615 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d2f533b3-4bad-406b-b318-94654e9aaaef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:26.419114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:26.437969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64be68c-3ff7-45b5-bf8f-645b3c50ef96 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:26.465919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f533b3-4bad-406b-b318-94654e9aaaef admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:26.475044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3dfc6-6776-4e2a-8618-f3a7a14a50f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:26.479047 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3dfc6-6776-4e2a-8618-f3a7a14a50f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:26.479047 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3dfc6-6776-4e2a-8618-f3a7a14a50f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:26.479047 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3dfc6-6776-4e2a-8618-f3a7a14a50f6 admin admin] PATH_INFO: `/v3/projects/75de43f149ea43c19c512d6ad8d930e6` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:26.480743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3dfc6-6776-4e2a-8618-f3a7a14a50f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75de43f149ea43c19c512d6ad8d930e6)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:26.483300 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3dfc6-6776-4e2a-8618-f3a7a14a50f6 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:26.493894 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896add3-bf34-4824-a7b2-073bac9739df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:26.494801 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896add3-bf34-4824-a7b2-073bac9739df admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:26.495083 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896add3-bf34-4824-a7b2-073bac9739df admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:26.495362 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896add3-bf34-4824-a7b2-073bac9739df admin admin] PATH_INFO: `/v3/projects/731802e996564987a86b3d695d2f1170` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:26.496549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896add3-bf34-4824-a7b2-073bac9739df admin admin] RBAC: Authorizing `identity:delete_project(project_id=731802e996564987a86b3d695d2f1170)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:26.498533 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896add3-bf34-4824-a7b2-073bac9739df admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:26.626176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cda3dfc6-6776-4e2a-8618-f3a7a14a50f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75de43f149ea43c19c512d6ad8d930e6', 'request_id': 'req-cda3dfc6-6776-4e2a-8618-f3a7a14a50f6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:26.662658 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-f896add3-bf34-4824-a7b2-073bac9739df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731802e996564987a86b3d695d2f1170', 'request_id': 'req-f896add3-bf34-4824-a7b2-073bac9739df'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:26.668740 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-f896add3-bf34-4824-a7b2-073bac9739df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731802e996564987a86b3d695d2f1170', 'request_id': 'req-f896add3-bf34-4824-a7b2-073bac9739df'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:26.674146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-f896add3-bf34-4824-a7b2-073bac9739df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731802e996564987a86b3d695d2f1170', 'request_id': 'req-f896add3-bf34-4824-a7b2-073bac9739df'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:26.725488 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cda3dfc6-6776-4e2a-8618-f3a7a14a50f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75de43f149ea43c19c512d6ad8d930e6', 'request_id': 'req-cda3dfc6-6776-4e2a-8618-f3a7a14a50f6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:26.732099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cda3dfc6-6776-4e2a-8618-f3a7a14a50f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75de43f149ea43c19c512d6ad8d930e6', 'request_id': 'req-cda3dfc6-6776-4e2a-8618-f3a7a14a50f6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:26.742326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cda3dfc6-6776-4e2a-8618-f3a7a14a50f6 admin admin] The token cache is being invalidate because project 75de43f149ea43c19c512d6ad8d930e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:06:26.742649 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cda3dfc6-6776-4e2a-8618-f3a7a14a50f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:26.743292 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cda3dfc6-6776-4e2a-8618-f3a7a14a50f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:26.744833 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1281/2597] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:06:26 2022] DELETE /identity/v3/projects/75de43f149ea43c19c512d6ad8d930e6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:06:26.750358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07884837-3c79-4c4d-a7c3-37c37b3b48f5 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:26.751171 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07884837-3c79-4c4d-a7c3-37c37b3b48f5 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:26.751460 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07884837-3c79-4c4d-a7c3-37c37b3b48f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:26.770101 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-07884837-3c79-4c4d-a7c3-37c37b3b48f5 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:26.771407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-07884837-3c79-4c4d-a7c3-37c37b3b48f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:26.810150 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-f896add3-bf34-4824-a7b2-073bac9739df admin admin] The token cache is being invalidate because project 731802e996564987a86b3d695d2f1170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:06:26.810150 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-f896add3-bf34-4824-a7b2-073bac9739df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:26.810150 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-f896add3-bf34-4824-a7b2-073bac9739df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:26.810150 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1317/2598] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:06:26 2022] DELETE /identity/v3/projects/731802e996564987a86b3d695d2f1170 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:26.812483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d883cc2-c865-45db-b5ff-f39853273fd1 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:26.812777 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d883cc2-c865-45db-b5ff-f39853273fd1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:26.813061 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d883cc2-c865-45db-b5ff-f39853273fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:26.830055 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1282/2599] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:06:26.832025 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-3d883cc2-c865-45db-b5ff-f39853273fd1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:26.834389 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-3d883cc2-c865-45db-b5ff-f39853273fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:26.837440 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907c2c6-15ae-4f49-aaad-c366947280ce None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:26.837742 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907c2c6-15ae-4f49-aaad-c366947280ce None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:26.838046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907c2c6-15ae-4f49-aaad-c366947280ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:26.842727 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1318/2600] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:06:26.851409 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0893cbf-f51e-47d9-8b23-3ea84fb6ef21 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:26.851701 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0893cbf-f51e-47d9-8b23-3ea84fb6ef21 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:26.851984 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0893cbf-f51e-47d9-8b23-3ea84fb6ef21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:26.855968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-a907c2c6-15ae-4f49-aaad-c366947280ce None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:26.861782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-a907c2c6-15ae-4f49-aaad-c366947280ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:26.865318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1283/2601] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:06:26.869423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907c2c6-15ae-4f49-aaad-c366947280ce None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:26.869976 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a0893cbf-f51e-47d9-8b23-3ea84fb6ef21 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:26.871355 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a0893cbf-f51e-47d9-8b23-3ea84fb6ef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:26.879357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907c2c6-15ae-4f49-aaad-c366947280ce None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:26.879874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1319/2602] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:06:26.884322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0893cbf-f51e-47d9-8b23-3ea84fb6ef21 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:26.886371 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:26.888190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619c991-5a43-4c59-81d7-18112b5e5598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:26.888859 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619c991-5a43-4c59-81d7-18112b5e5598 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:26.889148 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619c991-5a43-4c59-81d7-18112b5e5598 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:26.889447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619c991-5a43-4c59-81d7-18112b5e5598 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:26.890159 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619c991-5a43-4c59-81d7-18112b5e5598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:06:26.890522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619c991-5a43-4c59-81d7-18112b5e5598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:26.892781 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619c991-5a43-4c59-81d7-18112b5e5598 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:26.902436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0893cbf-f51e-47d9-8b23-3ea84fb6ef21 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:26.908540 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1284/2603] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 20:06:26.908704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c68321-147e-4364-ac40-86e9c7d1f494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:26.908704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c68321-147e-4364-ac40-86e9c7d1f494 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:26.908704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c68321-147e-4364-ac40-86e9c7d1f494 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:26.908704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c68321-147e-4364-ac40-86e9c7d1f494 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:26.909058 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c68321-147e-4364-ac40-86e9c7d1f494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:06:26.909270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c68321-147e-4364-ac40-86e9c7d1f494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:26.909874 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619c991-5a43-4c59-81d7-18112b5e5598 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:26.910928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c68321-147e-4364-ac40-86e9c7d1f494 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:26.920095 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619c991-5a43-4c59-81d7-18112b5e5598 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:26.923588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1320/2604] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:06:26.926292 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52cf5f-2de8-44f1-a60f-98bce0d7f994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:26.926292 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52cf5f-2de8-44f1-a60f-98bce0d7f994 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:26.926292 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52cf5f-2de8-44f1-a60f-98bce0d7f994 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:26.926683 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52cf5f-2de8-44f1-a60f-98bce0d7f994 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:26.927093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52cf5f-2de8-44f1-a60f-98bce0d7f994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:26.929004 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52cf5f-2de8-44f1-a60f-98bce0d7f994 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:26.929543 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c68321-147e-4364-ac40-86e9c7d1f494 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:26.939571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c68321-147e-4364-ac40-86e9c7d1f494 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:26.944471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69b373-e9a8-4e8a-a5e8-42e79a61561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:26.945114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69b373-e9a8-4e8a-a5e8-42e79a61561a admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:26.945396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69b373-e9a8-4e8a-a5e8-42e79a61561a admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:26.945673 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69b373-e9a8-4e8a-a5e8-42e79a61561a admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:26.946381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69b373-e9a8-4e8a-a5e8-42e79a61561a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:26.948297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69b373-e9a8-4e8a-a5e8-42e79a61561a admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:27.013394 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1285/2605] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:06:26 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:06:27.017539 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52cf5f-2de8-44f1-a60f-98bce0d7f994 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:27.039124 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1321/2606] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:06:26 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:06:27.045995 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69b373-e9a8-4e8a-a5e8-42e79a61561a admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:27.079630 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52cf5f-2de8-44f1-a60f-98bce0d7f994 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:27.106984 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69b373-e9a8-4e8a-a5e8-42e79a61561a admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:27.112149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6fded-a91a-45a9-bf9b-78d824add84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:27.112863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6fded-a91a-45a9-bf9b-78d824add84a admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:27.113152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6fded-a91a-45a9-bf9b-78d824add84a admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:27.113451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6fded-a91a-45a9-bf9b-78d824add84a admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:27.114131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6fded-a91a-45a9-bf9b-78d824add84a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:27.116104 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6fded-a91a-45a9-bf9b-78d824add84a admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:27.142265 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba476c4-905f-404a-93b0-70753f3dec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:27.142984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba476c4-905f-404a-93b0-70753f3dec19 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:27.143277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba476c4-905f-404a-93b0-70753f3dec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:27.143556 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba476c4-905f-404a-93b0-70753f3dec19 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:27.144249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba476c4-905f-404a-93b0-70753f3dec19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:27.146231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba476c4-905f-404a-93b0-70753f3dec19 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:27.220770 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1322/2607] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:06:27 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:06:27.224485 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6fded-a91a-45a9-bf9b-78d824add84a admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:27.233107 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1286/2608] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:06:27 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:06:27.234596 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6fded-a91a-45a9-bf9b-78d824add84a admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:27.237662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba476c4-905f-404a-93b0-70753f3dec19 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:27.239979 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c30d97-649b-46a1-ba06-9c80f79bb7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:27.240651 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c30d97-649b-46a1-ba06-9c80f79bb7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:27.240951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c30d97-649b-46a1-ba06-9c80f79bb7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:27.241237 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c30d97-649b-46a1-ba06-9c80f79bb7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:27.241982 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c30d97-649b-46a1-ba06-9c80f79bb7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:27.243645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c30d97-649b-46a1-ba06-9c80f79bb7f7 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:27.251652 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba476c4-905f-404a-93b0-70753f3dec19 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:27.255409 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1323/2609] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:06:27.258696 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29405ec5-e9a9-4133-ad02-57186cd9214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:27.258966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c30d97-649b-46a1-ba06-9c80f79bb7f7 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:27.259381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29405ec5-e9a9-4133-ad02-57186cd9214c admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:27.259673 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29405ec5-e9a9-4133-ad02-57186cd9214c admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:27.259956 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29405ec5-e9a9-4133-ad02-57186cd9214c admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:27.260720 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29405ec5-e9a9-4133-ad02-57186cd9214c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:27.262322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29405ec5-e9a9-4133-ad02-57186cd9214c admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:27.269745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c30d97-649b-46a1-ba06-9c80f79bb7f7 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:27.276322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1287/2610] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:27.277609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29405ec5-e9a9-4133-ad02-57186cd9214c admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:27.278434 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2438f9-0e19-4569-b77b-dd9c5b90f358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:27.279107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2438f9-0e19-4569-b77b-dd9c5b90f358 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:27.279402 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2438f9-0e19-4569-b77b-dd9c5b90f358 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:27.279685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2438f9-0e19-4569-b77b-dd9c5b90f358 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:27.280495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2438f9-0e19-4569-b77b-dd9c5b90f358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:27.282035 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2438f9-0e19-4569-b77b-dd9c5b90f358 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:27.287395 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29405ec5-e9a9-4133-ad02-57186cd9214c admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:27.292037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c9860-88b5-4a7b-80ee-fd5d08127c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:27.292688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c9860-88b5-4a7b-80ee-fd5d08127c54 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:27.292984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c9860-88b5-4a7b-80ee-fd5d08127c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:27.295696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1324/2611] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:27.295798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c9860-88b5-4a7b-80ee-fd5d08127c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:27.295798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c9860-88b5-4a7b-80ee-fd5d08127c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:27.295798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c9860-88b5-4a7b-80ee-fd5d08127c54 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:27.297234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2438f9-0e19-4569-b77b-dd9c5b90f358 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:27.309605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1288/2612] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:27.309766 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2438f9-0e19-4569-b77b-dd9c5b90f358 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:27.310608 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c9860-88b5-4a7b-80ee-fd5d08127c54 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:27.312528 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7ab48-6355-4327-8c9c-a11242ad1cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:27.313990 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7ab48-6355-4327-8c9c-a11242ad1cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:27.314468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7ab48-6355-4327-8c9c-a11242ad1cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:27.314752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7ab48-6355-4327-8c9c-a11242ad1cf7 admin admin] PATH_INFO: `/v3/projects/fbfc93ae76cb4a3fb4026116687203d0/users/82e32420a9d04a08ace4fcfd60fd683a/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:27.321291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c9860-88b5-4a7b-80ee-fd5d08127c54 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:27.326089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d53c4a-22c8-41dc-a07d-1c1449451c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:27.327155 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d53c4a-22c8-41dc-a07d-1c1449451c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:27.327508 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d53c4a-22c8-41dc-a07d-1c1449451c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:27.327795 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d53c4a-22c8-41dc-a07d-1c1449451c5e admin admin] PATH_INFO: `/v3/projects/2ab5c2776d1d49c3bd3611000e4eaf76/users/018911dffda74243be8368d3b7132372/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:27.330019 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7ab48-6355-4327-8c9c-a11242ad1cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbfc93ae76cb4a3fb4026116687203d0, user_id=82e32420a9d04a08ace4fcfd60fd683a, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:27.332964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7ab48-6355-4327-8c9c-a11242ad1cf7 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:27.344122 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d53c4a-22c8-41dc-a07d-1c1449451c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab5c2776d1d49c3bd3611000e4eaf76, user_id=018911dffda74243be8368d3b7132372, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:27.347430 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d53c4a-22c8-41dc-a07d-1c1449451c5e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:27.483743 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1325/2613] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:06:27 2022] PUT /identity/v3/projects/fbfc93ae76cb4a3fb4026116687203d0/users/82e32420a9d04a08ace4fcfd60fd683a/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:06:27.494816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9fae3-f204-4650-b737-48ecad5778af None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:27.495286 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9fae3-f204-4650-b737-48ecad5778af None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:27.495752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9fae3-f204-4650-b737-48ecad5778af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:27.499794 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:27.502662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1289/2614] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:06:27 2022] PUT /identity/v3/projects/2ab5c2776d1d49c3bd3611000e4eaf76/users/018911dffda74243be8368d3b7132372/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:27.513186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6b4d3-a7d5-4767-b795-0dab5e635089 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:27.513484 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6b4d3-a7d5-4767-b795-0dab5e635089 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:27.513770 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6b4d3-a7d5-4767-b795-0dab5e635089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:27.526589 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-80c9fae3-f204-4650-b737-48ecad5778af None None] MFA Rules not processed for user `82e32420a9d04a08ace4fcfd60fd683a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:27.527951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-80c9fae3-f204-4650-b737-48ecad5778af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:27.540902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-c9b6b4d3-a7d5-4767-b795-0dab5e635089 None None] MFA Rules not processed for user `018911dffda74243be8368d3b7132372`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:27.542114 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c9b6b4d3-a7d5-4767-b795-0dab5e635089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:27.592475 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1326/2615] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:06:27.603912 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9fae3-f204-4650-b737-48ecad5778af None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:27.605319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-80c9fae3-f204-4650-b737-48ecad5778af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:27.605914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1290/2616] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:27.610966 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6b4d3-a7d5-4767-b795-0dab5e635089 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:27.661649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9fae3-f204-4650-b737-48ecad5778af None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:27.665939 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f7073-f093-4125-b179-5146ed2a8671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:27.666617 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f7073-f093-4125-b179-5146ed2a8671 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:27.666850 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f7073-f093-4125-b179-5146ed2a8671 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:27.667137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f7073-f093-4125-b179-5146ed2a8671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:27.674863 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6b4d3-a7d5-4767-b795-0dab5e635089 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:27.683755 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f7073-f093-4125-b179-5146ed2a8671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:27.683755 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f7073-f093-4125-b179-5146ed2a8671 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:27.683912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8d4f8-f6b2-4803-9fda-5238a4a7e167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:27.683912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8d4f8-f6b2-4803-9fda-5238a4a7e167 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:27.683912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8d4f8-f6b2-4803-9fda-5238a4a7e167 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:27.683912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8d4f8-f6b2-4803-9fda-5238a4a7e167 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:27.684228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8d4f8-f6b2-4803-9fda-5238a4a7e167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:27.684228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8d4f8-f6b2-4803-9fda-5238a4a7e167 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:27.688364 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1327/2617] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:06:27.709588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f7073-f093-4125-b179-5146ed2a8671 service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:27.727621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f7073-f093-4125-b179-5146ed2a8671 service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:27.727621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351db8b-9d2e-4ae7-b74c-95160bbb0326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:27.727621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351db8b-9d2e-4ae7-b74c-95160bbb0326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:27.727621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351db8b-9d2e-4ae7-b74c-95160bbb0326 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:27.728027 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351db8b-9d2e-4ae7-b74c-95160bbb0326 admin admin] PATH_INFO: `/v3/users/82e32420a9d04a08ace4fcfd60fd683a` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:27.728785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351db8b-9d2e-4ae7-b74c-95160bbb0326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e32420a9d04a08ace4fcfd60fd683a)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:27.730752 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351db8b-9d2e-4ae7-b74c-95160bbb0326 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:27.806535 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1291/2618] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:06:27 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:06:27.808116 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8d4f8-f6b2-4803-9fda-5238a4a7e167 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:27.827110 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:27.873277 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8d4f8-f6b2-4803-9fda-5238a4a7e167 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:27.877951 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd55dd6-3328-4b92-be19-5bf544c0a2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:27.878686 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd55dd6-3328-4b92-be19-5bf544c0a2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:27.878978 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd55dd6-3328-4b92-be19-5bf544c0a2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:27.879264 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd55dd6-3328-4b92-be19-5bf544c0a2e3 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:27.879956 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd55dd6-3328-4b92-be19-5bf544c0a2e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:27.881873 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd55dd6-3328-4b92-be19-5bf544c0a2e3 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:27.962579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3351db8b-9d2e-4ae7-b74c-95160bbb0326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e32420a9d04a08ace4fcfd60fd683a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:27.981438 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1292/2619] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:06:27 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:06:27.985265 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd55dd6-3328-4b92-be19-5bf544c0a2e3 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:27.994788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd55dd6-3328-4b92-be19-5bf544c0a2e3 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:27.999463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c65274-f974-4131-be56-8a9b5e54be8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:28.000097 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c65274-f974-4131-be56-8a9b5e54be8a admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:28.000382 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c65274-f974-4131-be56-8a9b5e54be8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:28.000658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c65274-f974-4131-be56-8a9b5e54be8a admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:28.001581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c65274-f974-4131-be56-8a9b5e54be8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:28.003246 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c65274-f974-4131-be56-8a9b5e54be8a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:28.013136 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1293/2620] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:06:28.017412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c65274-f974-4131-be56-8a9b5e54be8a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:28.026881 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c65274-f974-4131-be56-8a9b5e54be8a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:28.031650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb95ce-ddc3-45e6-b101-73a9faebe0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:28.033170 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb95ce-ddc3-45e6-b101-73a9faebe0fd admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:28.033458 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb95ce-ddc3-45e6-b101-73a9faebe0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:28.033738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb95ce-ddc3-45e6-b101-73a9faebe0fd admin admin] PATH_INFO: `/v3/projects/6b71c514f4984755bd698c319d96f9f7/users/4be1e5f4e41842c5a6ba0ff25f72be0e/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:28.047901 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb95ce-ddc3-45e6-b101-73a9faebe0fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b71c514f4984755bd698c319d96f9f7, user_id=4be1e5f4e41842c5a6ba0ff25f72be0e, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:28.050528 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb95ce-ddc3-45e6-b101-73a9faebe0fd admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:28.131733 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3351db8b-9d2e-4ae7-b74c-95160bbb0326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e32420a9d04a08ace4fcfd60fd683a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:28.132295 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3351db8b-9d2e-4ae7-b74c-95160bbb0326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e32420a9d04a08ace4fcfd60fd683a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:28.140155 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3351db8b-9d2e-4ae7-b74c-95160bbb0326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e32420a9d04a08ace4fcfd60fd683a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:28.152604 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3351db8b-9d2e-4ae7-b74c-95160bbb0326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e32420a9d04a08ace4fcfd60fd683a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:28.158682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1328/2621] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:06:27 2022] DELETE /identity/v3/users/82e32420a9d04a08ace4fcfd60fd683a => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:28.162917 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f5174-7ab6-4426-890a-f451a44799c5 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:28.163211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f5174-7ab6-4426-890a-f451a44799c5 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:28.163496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f5174-7ab6-4426-890a-f451a44799c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:28.167544 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:28.172293 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1294/2622] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:06:28 2022] PUT /identity/v3/projects/6b71c514f4984755bd698c319d96f9f7/users/4be1e5f4e41842c5a6ba0ff25f72be0e/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:06:28.179619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb95ce-ddc3-45e6-b101-73a9faebe0fd admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:28.183860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b5eb95ce-ddc3-45e6-b101-73a9faebe0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:28.202522 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-dc2f5174-7ab6-4426-890a-f451a44799c5 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:28.203742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-dc2f5174-7ab6-4426-890a-f451a44799c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:28.251722 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb95ce-ddc3-45e6-b101-73a9faebe0fd admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:28.257039 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f32fa-f21b-49aa-a079-6acfac9b93fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:28.257822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f32fa-f21b-49aa-a079-6acfac9b93fd admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:28.258110 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f32fa-f21b-49aa-a079-6acfac9b93fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:28.258432 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f32fa-f21b-49aa-a079-6acfac9b93fd admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:28.259296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f32fa-f21b-49aa-a079-6acfac9b93fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:28.261544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f32fa-f21b-49aa-a079-6acfac9b93fd admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:28.270687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1329/2623] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:06:28.276798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1295/2624] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:06:28.276798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:28.278223 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f5174-7ab6-4426-890a-f451a44799c5 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:28.282827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f32fa-f21b-49aa-a079-6acfac9b93fd admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:28.284624 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-845f32fa-f21b-49aa-a079-6acfac9b93fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:28.289459 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f5174-7ab6-4426-890a-f451a44799c5 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:28.294812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f038903-6b71-4901-a14c-7dfe4de44f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:28.295815 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f038903-6b71-4901-a14c-7dfe4de44f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:28.296099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f038903-6b71-4901-a14c-7dfe4de44f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:28.296375 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f038903-6b71-4901-a14c-7dfe4de44f16 admin admin] PATH_INFO: `/v3/projects/6b71c514f4984755bd698c319d96f9f7/users/4be1e5f4e41842c5a6ba0ff25f72be0e/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:28.298484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f038903-6b71-4901-a14c-7dfe4de44f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b71c514f4984755bd698c319d96f9f7, user_id=4be1e5f4e41842c5a6ba0ff25f72be0e, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:28.301518 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f038903-6b71-4901-a14c-7dfe4de44f16 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:28.314137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1330/2625] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:06:28 2022] PUT /identity/v3/projects/6b71c514f4984755bd698c319d96f9f7/users/4be1e5f4e41842c5a6ba0ff25f72be0e/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:28.315911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16578a-a1ff-471f-8ee1-1b9fca14d4c3 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:28.316207 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16578a-a1ff-471f-8ee1-1b9fca14d4c3 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:28.316521 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16578a-a1ff-471f-8ee1-1b9fca14d4c3 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:28.318001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1331/2626] 10.222.0.15 () {54 vars in 921 bytes} [Fri May 27 20:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 20:06:28.327012 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498fd8e-02e7-4d29-b4eb-d137331fc5aa None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:28.327451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498fd8e-02e7-4d29-b4eb-d137331fc5aa None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:28.327819 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498fd8e-02e7-4d29-b4eb-d137331fc5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:28.360136 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c498fd8e-02e7-4d29-b4eb-d137331fc5aa None None] MFA Rules not processed for user `4be1e5f4e41842c5a6ba0ff25f72be0e`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:28.361398 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c498fd8e-02e7-4d29-b4eb-d137331fc5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:28.369356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f32fa-f21b-49aa-a079-6acfac9b93fd admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:28.428444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d4758-6500-4a3e-85f3-710a23a4c763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:28.428738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d4758-6500-4a3e-85f3-710a23a4c763 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:28.428986 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d4758-6500-4a3e-85f3-710a23a4c763 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:28.429266 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d4758-6500-4a3e-85f3-710a23a4c763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:28.440797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:28.444286 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1332/2627] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:28.446526 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6f7f4-3e93-4ce4-be54-824e37c9c75b None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:28.449356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6f7f4-3e93-4ce4-be54-824e37c9c75b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:28.449356 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6f7f4-3e93-4ce4-be54-824e37c9c75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:28.484388 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:28.495621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-dbf6f7f4-3e93-4ce4-be54-824e37c9c75b None None] MFA Rules not processed for user `105353b6b1a941ac81df7ad35567ba7c`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:28.496947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-dbf6f7f4-3e93-4ce4-be54-824e37c9c75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:28.517439 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d4758-6500-4a3e-85f3-710a23a4c763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:28.519372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27d4758-6500-4a3e-85f3-710a23a4c763 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:28.530558 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1296/2628] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:06:28.531441 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d4758-6500-4a3e-85f3-710a23a4c763 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:28.532963 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d27d4758-6500-4a3e-85f3-710a23a4c763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:28.584468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1333/2629] 10.222.0.15 () {58 vars in 1018 bytes} [Fri May 27 20:06:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:28.597306 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6f7f4-3e93-4ce4-be54-824e37c9c75b None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:28.599821 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-dbf6f7f4-3e93-4ce4-be54-824e37c9c75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:28.606000 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d4758-6500-4a3e-85f3-710a23a4c763 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:28.612428 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8a2dd-b5f2-48b1-a77c-72719f03737b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:28.613309 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8a2dd-b5f2-48b1-a77c-72719f03737b service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:28.613607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8a2dd-b5f2-48b1-a77c-72719f03737b service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:28.613929 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8a2dd-b5f2-48b1-a77c-72719f03737b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:28.615910 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-26c8a2dd-b5f2-48b1-a77c-72719f03737b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:28.692438 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8a2dd-b5f2-48b1-a77c-72719f03737b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:28.693135 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6f7f4-3e93-4ce4-be54-824e37c9c75b None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:28.693827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8a2dd-b5f2-48b1-a77c-72719f03737b service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:28.696874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205dd94-3dcb-4916-a7e5-0b3acb865f30 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2b57ae83164912a4e23dda9dc239f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:28.697561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205dd94-3dcb-4916-a7e5-0b3acb865f30 service glance] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:28.704523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205dd94-3dcb-4916-a7e5-0b3acb865f30 service glance] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:28.704523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205dd94-3dcb-4916-a7e5-0b3acb865f30 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:28.704731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1297/2630] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:06:28.708453 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205dd94-3dcb-4916-a7e5-0b3acb865f30 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:28.709836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205dd94-3dcb-4916-a7e5-0b3acb865f30 service glance] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:28.720789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1334/2631] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:06:28.973807 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f84806-882f-44b4-8748-6e116171dd1f None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:28.974330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f84806-882f-44b4-8748-6e116171dd1f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:28.974330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f84806-882f-44b4-8748-6e116171dd1f None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:28.975726 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1298/2632] 10.222.0.15 () {54 vars in 921 bytes} [Fri May 27 20:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 20:06:28.980361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625f967-f1eb-4674-8a88-ad4506ac44c9 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:28.980706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625f967-f1eb-4674-8a88-ad4506ac44c9 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:28.980989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625f967-f1eb-4674-8a88-ad4506ac44c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:28.999115 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-8625f967-f1eb-4674-8a88-ad4506ac44c9 None None] MFA Rules not processed for user `af7e51b89f4c4dcc9963061e6e509eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:29.000293 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8625f967-f1eb-4674-8a88-ad4506ac44c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:29.007007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1335/2633] 10.222.0.15 () {58 vars in 1018 bytes} [Fri May 27 20:06:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:29.018634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f84806-882f-44b4-8748-6e116171dd1f None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:29.020348 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-46f84806-882f-44b4-8748-6e116171dd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:29.034478 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f84806-882f-44b4-8748-6e116171dd1f None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:29.038253 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a114f6-f860-4e6e-9ba2-fe06d069ebd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:29.038922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a114f6-f860-4e6e-9ba2-fe06d069ebd1 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:29.039213 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a114f6-f860-4e6e-9ba2-fe06d069ebd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:29.039496 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a114f6-f860-4e6e-9ba2-fe06d069ebd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:29.046548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a114f6-f860-4e6e-9ba2-fe06d069ebd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:29.048645 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a114f6-f860-4e6e-9ba2-fe06d069ebd1 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:29.057073 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1299/2634] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:06:29.096594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625f967-f1eb-4674-8a88-ad4506ac44c9 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:29.098104 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8625f967-f1eb-4674-8a88-ad4506ac44c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:29.113125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625f967-f1eb-4674-8a88-ad4506ac44c9 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:29.118719 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ef0de-fa18-4082-b30c-29c63613fc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:29.120211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ef0de-fa18-4082-b30c-29c63613fc8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:29.120683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ef0de-fa18-4082-b30c-29c63613fc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:29.121345 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ef0de-fa18-4082-b30c-29c63613fc8a admin admin] PATH_INFO: `/v3/projects/fbfc93ae76cb4a3fb4026116687203d0` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:29.123869 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ef0de-fa18-4082-b30c-29c63613fc8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbfc93ae76cb4a3fb4026116687203d0)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:29.126069 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ef0de-fa18-4082-b30c-29c63613fc8a admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:29.169579 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8545e06-418e-48a8-947a-ca2fd50dd64d None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:29.169882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8545e06-418e-48a8-947a-ca2fd50dd64d None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:29.170176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8545e06-418e-48a8-947a-ca2fd50dd64d None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:29.171588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1300/2635] 10.222.0.15 () {54 vars in 921 bytes} [Fri May 27 20:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 20:06:29.177486 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081ed1f-d9cc-48c0-bc4b-4d2818edda53 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:29.177807 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081ed1f-d9cc-48c0-bc4b-4d2818edda53 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:29.178091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081ed1f-d9cc-48c0-bc4b-4d2818edda53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:29.197711 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b081ed1f-d9cc-48c0-bc4b-4d2818edda53 None None] MFA Rules not processed for user `105353b6b1a941ac81df7ad35567ba7c`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:29.198959 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b081ed1f-d9cc-48c0-bc4b-4d2818edda53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:29.208909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1301/2636] 10.222.0.15 () {58 vars in 1018 bytes} [Fri May 27 20:06:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:06:29.219027 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081ed1f-d9cc-48c0-bc4b-4d2818edda53 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:29.229074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081ed1f-d9cc-48c0-bc4b-4d2818edda53 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:29.232722 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb7b6a-f8e1-47bd-a371-6072be868576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:29.233356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb7b6a-f8e1-47bd-a371-6072be868576 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:29.233645 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb7b6a-f8e1-47bd-a371-6072be868576 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:29.233928 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb7b6a-f8e1-47bd-a371-6072be868576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:29.244163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb7b6a-f8e1-47bd-a371-6072be868576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:29.245556 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb7b6a-f8e1-47bd-a371-6072be868576 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:29.256204 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1302/2637] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:06:29.287379 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-536ef0de-fa18-4082-b30c-29c63613fc8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbfc93ae76cb4a3fb4026116687203d0', 'request_id': 'req-536ef0de-fa18-4082-b30c-29c63613fc8a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:29.294144 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-536ef0de-fa18-4082-b30c-29c63613fc8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbfc93ae76cb4a3fb4026116687203d0', 'request_id': 'req-536ef0de-fa18-4082-b30c-29c63613fc8a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:29.301331 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-536ef0de-fa18-4082-b30c-29c63613fc8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbfc93ae76cb4a3fb4026116687203d0', 'request_id': 'req-536ef0de-fa18-4082-b30c-29c63613fc8a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:29.309169 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:29.440373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-536ef0de-fa18-4082-b30c-29c63613fc8a admin admin] The token cache is being invalidate because project fbfc93ae76cb4a3fb4026116687203d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:06:29.440732 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-536ef0de-fa18-4082-b30c-29c63613fc8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:29.446605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-536ef0de-fa18-4082-b30c-29c63613fc8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:29.446605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1336/2638] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:06:29 2022] DELETE /identity/v3/projects/fbfc93ae76cb4a3fb4026116687203d0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:29.447892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09a2d-9d43-4a0e-b290-5e124fdda662 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:29.448188 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09a2d-9d43-4a0e-b290-5e124fdda662 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:29.448472 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe09a2d-9d43-4a0e-b290-5e124fdda662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:29.466833 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-abe09a2d-9d43-4a0e-b290-5e124fdda662 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:29.468020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-abe09a2d-9d43-4a0e-b290-5e124fdda662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:29.489336 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:29.527570 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1303/2639] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:29.536201 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d371a2-2b4a-4cf7-b1a8-d23284063792 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:29.536682 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d371a2-2b4a-4cf7-b1a8-d23284063792 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:29.536779 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d371a2-2b4a-4cf7-b1a8-d23284063792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:29.555202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-d3d371a2-2b4a-4cf7-b1a8-d23284063792 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:29.556441 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d3d371a2-2b4a-4cf7-b1a8-d23284063792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:29.565707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1337/2640] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:29.570431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe09a2d-9d43-4a0e-b290-5e124fdda662 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:29.581909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe09a2d-9d43-4a0e-b290-5e124fdda662 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:29.587096 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f7048-31c1-4e20-8cce-de2d3f4c14df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:29.587770 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7048-31c1-4e20-8cce-de2d3f4c14df admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:29.588135 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7048-31c1-4e20-8cce-de2d3f4c14df admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:29.588320 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7048-31c1-4e20-8cce-de2d3f4c14df admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:29.589048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f7048-31c1-4e20-8cce-de2d3f4c14df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:06:29.589365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f7048-31c1-4e20-8cce-de2d3f4c14df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:29.591315 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f7048-31c1-4e20-8cce-de2d3f4c14df admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:29.604599 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1304/2641] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:06:29.609327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d371a2-2b4a-4cf7-b1a8-d23284063792 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:29.620848 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d371a2-2b4a-4cf7-b1a8-d23284063792 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:29.626595 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ad9d4-fc0c-4aa1-89c3-cefcdf3f8d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:29.627645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ad9d4-fc0c-4aa1-89c3-cefcdf3f8d47 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:29.637722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ad9d4-fc0c-4aa1-89c3-cefcdf3f8d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:29.637722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ad9d4-fc0c-4aa1-89c3-cefcdf3f8d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:29.637722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ad9d4-fc0c-4aa1-89c3-cefcdf3f8d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:29.637722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ad9d4-fc0c-4aa1-89c3-cefcdf3f8d47 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:29.741573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1338/2642] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:06:29 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:06:29.744144 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f7048-31c1-4e20-8cce-de2d3f4c14df admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:29.755889 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f7048-31c1-4e20-8cce-de2d3f4c14df admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:29.823483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c1392-7bea-4be4-b588-67e9bcac19f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:29.827709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c1392-7bea-4be4-b588-67e9bcac19f4 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:29.827709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c1392-7bea-4be4-b588-67e9bcac19f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:29.827709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c1392-7bea-4be4-b588-67e9bcac19f4 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:29.827709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c1392-7bea-4be4-b588-67e9bcac19f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:29.827709 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c1392-7bea-4be4-b588-67e9bcac19f4 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:29.909188 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1305/2643] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:06:29 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:06:29.913215 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ad9d4-fc0c-4aa1-89c3-cefcdf3f8d47 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:29.923737 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ad9d4-fc0c-4aa1-89c3-cefcdf3f8d47 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:29.928420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b6901-2d00-4241-b282-6bf6bbb63447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:29.929081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b6901-2d00-4241-b282-6bf6bbb63447 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:29.929372 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b6901-2d00-4241-b282-6bf6bbb63447 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:29.929658 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b6901-2d00-4241-b282-6bf6bbb63447 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:29.930420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b6901-2d00-4241-b282-6bf6bbb63447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:29.932140 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b6901-2d00-4241-b282-6bf6bbb63447 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:29.943549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1339/2644] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:29.948279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c1392-7bea-4be4-b588-67e9bcac19f4 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:29.958812 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c1392-7bea-4be4-b588-67e9bcac19f4 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:29.963389 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95a6b4-e3ab-46fc-864e-cbe31a779491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:29.964050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95a6b4-e3ab-46fc-864e-cbe31a779491 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:29.964335 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95a6b4-e3ab-46fc-864e-cbe31a779491 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:29.964618 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95a6b4-e3ab-46fc-864e-cbe31a779491 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:29.965357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95a6b4-e3ab-46fc-864e-cbe31a779491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:29.967004 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95a6b4-e3ab-46fc-864e-cbe31a779491 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:29.977447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1306/2645] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:29.981702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b6901-2d00-4241-b282-6bf6bbb63447 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:29.993276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b6901-2d00-4241-b282-6bf6bbb63447 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:29.997834 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867de2c-ec9a-4966-bd5b-cb824fc34510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:29.998754 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867de2c-ec9a-4966-bd5b-cb824fc34510 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:29.999035 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867de2c-ec9a-4966-bd5b-cb824fc34510 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:29.999310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0867de2c-ec9a-4966-bd5b-cb824fc34510 admin admin] PATH_INFO: `/v3/projects/9f3a5a5ccba84a62a64933b871e77625/users/4b385a2b4aba4cedb093a2dc2f82b48a/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:30.015373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867de2c-ec9a-4966-bd5b-cb824fc34510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3a5a5ccba84a62a64933b871e77625, user_id=4b385a2b4aba4cedb093a2dc2f82b48a, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:30.019004 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0867de2c-ec9a-4966-bd5b-cb824fc34510 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:30.140964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1340/2646] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:06:29 2022] PUT /identity/v3/projects/9f3a5a5ccba84a62a64933b871e77625/users/4b385a2b4aba4cedb093a2dc2f82b48a/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:06:30.152428 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9491a-52b4-4e34-908c-c69acf6d6c47 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:30.152727 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9491a-52b4-4e34-908c-c69acf6d6c47 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:30.153046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b9491a-52b4-4e34-908c-c69acf6d6c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:30.179639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-73b9491a-52b4-4e34-908c-c69acf6d6c47 None None] MFA Rules not processed for user `4b385a2b4aba4cedb093a2dc2f82b48a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:30.180936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-73b9491a-52b4-4e34-908c-c69acf6d6c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:30.246318 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1307/2647] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:30.258164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867de2c-ec9a-4966-bd5b-cb824fc34510 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:30.260045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-0867de2c-ec9a-4966-bd5b-cb824fc34510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:30.317484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0867de2c-ec9a-4966-bd5b-cb824fc34510 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:30.321125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09ccd4-9d00-4087-873f-c7c05d570b02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:30.321772 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09ccd4-9d00-4087-873f-c7c05d570b02 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:30.322059 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09ccd4-9d00-4087-873f-c7c05d570b02 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:30.322354 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09ccd4-9d00-4087-873f-c7c05d570b02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:30.330589 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09ccd4-9d00-4087-873f-c7c05d570b02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:30.332045 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09ccd4-9d00-4087-873f-c7c05d570b02 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:30.340884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1341/2648] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:06:32.861695 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1a1d1-6434-4c62-9064-b0c933b8cb11 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:32.862174 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1a1d1-6434-4c62-9064-b0c933b8cb11 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:32.862306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1a1d1-6434-4c62-9064-b0c933b8cb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:32.880145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-d9e1a1d1-6434-4c62-9064-b0c933b8cb11 None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:32.881347 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d9e1a1d1-6434-4c62-9064-b0c933b8cb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:32.898927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:32.937259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1308/2649] 10.222.0.15 () {58 vars in 1009 bytes} [Fri May 27 20:06:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:32.950169 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09ccd4-9d00-4087-873f-c7c05d570b02 service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:32.951700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-7a09ccd4-9d00-4087-873f-c7c05d570b02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:33.022659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09ccd4-9d00-4087-873f-c7c05d570b02 service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:33.027967 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dcb44-4f23-4f7b-8d18-a90c1c036441 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:33.028616 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dcb44-4f23-4f7b-8d18-a90c1c036441 service swift] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:33.028900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dcb44-4f23-4f7b-8d18-a90c1c036441 service swift] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:33.029176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dcb44-4f23-4f7b-8d18-a90c1c036441 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:33.037970 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dcb44-4f23-4f7b-8d18-a90c1c036441 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:33.039602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dcb44-4f23-4f7b-8d18-a90c1c036441 service swift] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:33.047489 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1342/2650] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:06:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 20:06:34.589895 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1a1d1-6434-4c62-9064-b0c933b8cb11 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:34.604337 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1a1d1-6434-4c62-9064-b0c933b8cb11 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:34.616574 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b4c30-afef-4607-9dbb-48f64425beb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:34.617603 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b4c30-afef-4607-9dbb-48f64425beb9 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:34.618162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b4c30-afef-4607-9dbb-48f64425beb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:34.618624 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b4c30-afef-4607-9dbb-48f64425beb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:34.628323 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-950b4c30-afef-4607-9dbb-48f64425beb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:34.758552 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b4c30-afef-4607-9dbb-48f64425beb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:34.763503 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b4c30-afef-4607-9dbb-48f64425beb9 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:34.771080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1309/2651] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:06:37.765327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dcb44-4f23-4f7b-8d18-a90c1c036441 service swift] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:37.801387 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:37.856674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dcb44-4f23-4f7b-8d18-a90c1c036441 service swift] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:37.864598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642787d1-871d-4749-9a3f-9c9ab90a18a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:37.866435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642787d1-871d-4749-9a3f-9c9ab90a18a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:37.867513 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642787d1-871d-4749-9a3f-9c9ab90a18a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:37.867912 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642787d1-871d-4749-9a3f-9c9ab90a18a7 admin admin] PATH_INFO: `/v3/users/4b385a2b4aba4cedb093a2dc2f82b48a` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:37.869969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642787d1-871d-4749-9a3f-9c9ab90a18a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b385a2b4aba4cedb093a2dc2f82b48a)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:37.873604 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642787d1-871d-4749-9a3f-9c9ab90a18a7 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:38.143250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-642787d1-871d-4749-9a3f-9c9ab90a18a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b385a2b4aba4cedb093a2dc2f82b48a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:38.446079 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-642787d1-871d-4749-9a3f-9c9ab90a18a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b385a2b4aba4cedb093a2dc2f82b48a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:38.446759 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-642787d1-871d-4749-9a3f-9c9ab90a18a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b385a2b4aba4cedb093a2dc2f82b48a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:38.455973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-642787d1-871d-4749-9a3f-9c9ab90a18a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b385a2b4aba4cedb093a2dc2f82b48a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:38.495916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-642787d1-871d-4749-9a3f-9c9ab90a18a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b385a2b4aba4cedb093a2dc2f82b48a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:38.503978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1343/2652] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:06:37 2022] DELETE /identity/v3/users/4b385a2b4aba4cedb093a2dc2f82b48a => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:38.508945 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6debda5-ba41-4d74-9e87-0c4524f8c84d None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:38.509575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6debda5-ba41-4d74-9e87-0c4524f8c84d None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:38.509575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6debda5-ba41-4d74-9e87-0c4524f8c84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:38.535198 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-c6debda5-ba41-4d74-9e87-0c4524f8c84d None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:38.536405 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c6debda5-ba41-4d74-9e87-0c4524f8c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:38.603361 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1310/2653] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:38.612994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642787d1-871d-4749-9a3f-9c9ab90a18a7 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:38.614421 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-642787d1-871d-4749-9a3f-9c9ab90a18a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:38.687531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642787d1-871d-4749-9a3f-9c9ab90a18a7 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:38.692274 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd2ac6-f014-4639-af07-d1d55addefc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:38.692938 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd2ac6-f014-4639-af07-d1d55addefc9 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:38.693238 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd2ac6-f014-4639-af07-d1d55addefc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:38.693498 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd2ac6-f014-4639-af07-d1d55addefc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:38.705739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd2ac6-f014-4639-af07-d1d55addefc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:38.709648 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd2ac6-f014-4639-af07-d1d55addefc9 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:38.728436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1344/2654] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:06:39.205862 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6debda5-ba41-4d74-9e87-0c4524f8c84d None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:39.207888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c6debda5-ba41-4d74-9e87-0c4524f8c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:39.227433 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6debda5-ba41-4d74-9e87-0c4524f8c84d None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:39.232543 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa13528-c8e8-4fdf-a24e-36d0609d40c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:39.233525 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa13528-c8e8-4fdf-a24e-36d0609d40c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:39.233883 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa13528-c8e8-4fdf-a24e-36d0609d40c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:39.234231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa13528-c8e8-4fdf-a24e-36d0609d40c2 admin admin] PATH_INFO: `/v3/projects/9f3a5a5ccba84a62a64933b871e77625` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:39.236058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa13528-c8e8-4fdf-a24e-36d0609d40c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3a5a5ccba84a62a64933b871e77625)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:39.238550 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa13528-c8e8-4fdf-a24e-36d0609d40c2 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:39.365733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-3aa13528-c8e8-4fdf-a24e-36d0609d40c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3a5a5ccba84a62a64933b871e77625', 'request_id': 'req-3aa13528-c8e8-4fdf-a24e-36d0609d40c2'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:39.512940 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-3aa13528-c8e8-4fdf-a24e-36d0609d40c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3a5a5ccba84a62a64933b871e77625', 'request_id': 'req-3aa13528-c8e8-4fdf-a24e-36d0609d40c2'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:39.516892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:39.520828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-3aa13528-c8e8-4fdf-a24e-36d0609d40c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3a5a5ccba84a62a64933b871e77625', 'request_id': 'req-3aa13528-c8e8-4fdf-a24e-36d0609d40c2'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:39.534045 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-3aa13528-c8e8-4fdf-a24e-36d0609d40c2 admin admin] The token cache is being invalidate because project 9f3a5a5ccba84a62a64933b871e77625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:06:39.534358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-3aa13528-c8e8-4fdf-a24e-36d0609d40c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:39.535136 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-3aa13528-c8e8-4fdf-a24e-36d0609d40c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:39.540562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1311/2655] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:06:39 2022] DELETE /identity/v3/projects/9f3a5a5ccba84a62a64933b871e77625 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:39.541929 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9dc3b-f84f-46c7-aead-d1de5fa9989f None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:39.542471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9dc3b-f84f-46c7-aead-d1de5fa9989f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:39.546608 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9dc3b-f84f-46c7-aead-d1de5fa9989f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:39.567533 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-72a9dc3b-f84f-46c7-aead-d1de5fa9989f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:39.568769 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-72a9dc3b-f84f-46c7-aead-d1de5fa9989f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:39.625756 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:39.654383 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1345/2656] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:06:39.666148 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7fce5-a4da-4fb3-8ad7-315cf1756ac7 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:39.666148 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7fce5-a4da-4fb3-8ad7-315cf1756ac7 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:39.666148 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7fce5-a4da-4fb3-8ad7-315cf1756ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:39.681957 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-c5a7fce5-a4da-4fb3-8ad7-315cf1756ac7 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:39.683322 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c5a7fce5-a4da-4fb3-8ad7-315cf1756ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:39.696522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1312/2657] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:39.711987 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9dc3b-f84f-46c7-aead-d1de5fa9989f None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:39.711987 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9dc3b-f84f-46c7-aead-d1de5fa9989f None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:39.712974 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e56af-9650-4550-98d6-d3fa5492f350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:39.713656 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e56af-9650-4550-98d6-d3fa5492f350 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:39.713940 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e56af-9650-4550-98d6-d3fa5492f350 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:39.714229 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e56af-9650-4550-98d6-d3fa5492f350 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:39.715001 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e56af-9650-4550-98d6-d3fa5492f350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:06:39.715318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e56af-9650-4550-98d6-d3fa5492f350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:39.716989 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e56af-9650-4550-98d6-d3fa5492f350 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:39.742412 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7fce5-a4da-4fb3-8ad7-315cf1756ac7 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:39.752880 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1346/2658] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:06:39.754606 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7fce5-a4da-4fb3-8ad7-315cf1756ac7 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:39.760473 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8e188-46b3-4e9c-b9cf-a0c59e5bcaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:39.761349 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8e188-46b3-4e9c-b9cf-a0c59e5bcaea admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:39.761692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8e188-46b3-4e9c-b9cf-a0c59e5bcaea admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:39.762021 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8e188-46b3-4e9c-b9cf-a0c59e5bcaea admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:39.762821 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8e188-46b3-4e9c-b9cf-a0c59e5bcaea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:39.765217 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8e188-46b3-4e9c-b9cf-a0c59e5bcaea admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:39.884379 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e56af-9650-4550-98d6-d3fa5492f350 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:39.889649 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1313/2659] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:06:39 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:06:39.896102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e56af-9650-4550-98d6-d3fa5492f350 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:39.965865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d9b91-53f2-4283-b168-dbd53d596a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:39.966584 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d9b91-53f2-4283-b168-dbd53d596a36 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:39.966878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d9b91-53f2-4283-b168-dbd53d596a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:39.967223 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d9b91-53f2-4283-b168-dbd53d596a36 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:39.968071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d9b91-53f2-4283-b168-dbd53d596a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:39.970637 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d9b91-53f2-4283-b168-dbd53d596a36 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:40.063390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1347/2660] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:06:39 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:06:40.067105 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8e188-46b3-4e9c-b9cf-a0c59e5bcaea admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:40.078687 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8e188-46b3-4e9c-b9cf-a0c59e5bcaea admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:40.085359 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058de444-549e-4365-bca9-fb5af465da34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:40.086308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de444-549e-4365-bca9-fb5af465da34 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:40.086615 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de444-549e-4365-bca9-fb5af465da34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:40.086920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058de444-549e-4365-bca9-fb5af465da34 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:40.088186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058de444-549e-4365-bca9-fb5af465da34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:40.090056 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058de444-549e-4365-bca9-fb5af465da34 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:40.104697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1314/2661] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:06:40.115601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d9b91-53f2-4283-b168-dbd53d596a36 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:40.128153 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d9b91-53f2-4283-b168-dbd53d596a36 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:40.134258 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f4fdb-5c14-4f6a-b636-c9d07efae180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:40.135349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f4fdb-5c14-4f6a-b636-c9d07efae180 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:40.135769 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f4fdb-5c14-4f6a-b636-c9d07efae180 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:40.136257 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f4fdb-5c14-4f6a-b636-c9d07efae180 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:40.137376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f4fdb-5c14-4f6a-b636-c9d07efae180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:40.140254 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f4fdb-5c14-4f6a-b636-c9d07efae180 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:40.162946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1348/2662] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:40.164131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058de444-549e-4365-bca9-fb5af465da34 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:40.175027 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058de444-549e-4365-bca9-fb5af465da34 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:40.181517 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6989bd-d958-4a0d-b27a-b238c768c7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:40.182892 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6989bd-d958-4a0d-b27a-b238c768c7c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:40.183186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6989bd-d958-4a0d-b27a-b238c768c7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:40.183589 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6989bd-d958-4a0d-b27a-b238c768c7c5 admin admin] PATH_INFO: `/v3/projects/1889f9038fe947e89bdb3968c0d2f97b/users/99c0e9157949440996b6763af800d13b/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:40.203454 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6989bd-d958-4a0d-b27a-b238c768c7c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1889f9038fe947e89bdb3968c0d2f97b, user_id=99c0e9157949440996b6763af800d13b, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:40.206802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6989bd-d958-4a0d-b27a-b238c768c7c5 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:40.292129 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1315/2663] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:06:40 2022] PUT /identity/v3/projects/1889f9038fe947e89bdb3968c0d2f97b/users/99c0e9157949440996b6763af800d13b/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:40.303704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d5ba8-5ab2-4c6c-bea8-3878750692f4 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:40.304091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d5ba8-5ab2-4c6c-bea8-3878750692f4 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:40.304381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d5ba8-5ab2-4c6c-bea8-3878750692f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:40.333942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-cb2d5ba8-5ab2-4c6c-bea8-3878750692f4 None None] MFA Rules not processed for user `99c0e9157949440996b6763af800d13b`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:40.335514 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-cb2d5ba8-5ab2-4c6c-bea8-3878750692f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:40.416078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1349/2664] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:40.420712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6989bd-d958-4a0d-b27a-b238c768c7c5 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:40.518226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6989bd-d958-4a0d-b27a-b238c768c7c5 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:40.527161 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca03bb-d014-4208-b046-df221de24d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:40.528296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca03bb-d014-4208-b046-df221de24d7e admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:40.528296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca03bb-d014-4208-b046-df221de24d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:40.528516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca03bb-d014-4208-b046-df221de24d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:40.529543 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca03bb-d014-4208-b046-df221de24d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:40.531947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca03bb-d014-4208-b046-df221de24d7e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:40.685974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1316/2665] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:06:40 2022] POST /identity/v3/projects => generated 385 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:06:40.691071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d5ba8-5ab2-4c6c-bea8-3878750692f4 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:40.703361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d5ba8-5ab2-4c6c-bea8-3878750692f4 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:40.739247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:40.763189 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de759a-799d-4cff-b53c-62ea2f46bbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:40.763969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de759a-799d-4cff-b53c-62ea2f46bbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:40.764376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de759a-799d-4cff-b53c-62ea2f46bbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:40.764889 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de759a-799d-4cff-b53c-62ea2f46bbe7 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:40.765527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de759a-799d-4cff-b53c-62ea2f46bbe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:40.767591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de759a-799d-4cff-b53c-62ea2f46bbe7 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:40.863906 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1350/2666] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:06:40 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:06:40.864949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca03bb-d014-4208-b046-df221de24d7e admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:40.878160 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca03bb-d014-4208-b046-df221de24d7e admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:40.880650 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b181138-3ab1-4714-96e6-16e65aed635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:40.881327 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b181138-3ab1-4714-96e6-16e65aed635f admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:40.881625 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b181138-3ab1-4714-96e6-16e65aed635f admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:40.881910 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b181138-3ab1-4714-96e6-16e65aed635f admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:40.882690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b181138-3ab1-4714-96e6-16e65aed635f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:40.884310 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b181138-3ab1-4714-96e6-16e65aed635f admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:40.897465 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1317/2667] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:40.901605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de759a-799d-4cff-b53c-62ea2f46bbe7 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:40.913034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de759a-799d-4cff-b53c-62ea2f46bbe7 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:40.918290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61725313-2059-4abb-a93c-45eff2885b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:40.919019 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61725313-2059-4abb-a93c-45eff2885b7e admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:40.919309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61725313-2059-4abb-a93c-45eff2885b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:40.919588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61725313-2059-4abb-a93c-45eff2885b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:40.920471 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61725313-2059-4abb-a93c-45eff2885b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:40.922114 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61725313-2059-4abb-a93c-45eff2885b7e admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:40.937786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1351/2668] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:40.938730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b181138-3ab1-4714-96e6-16e65aed635f admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:40.951328 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b181138-3ab1-4714-96e6-16e65aed635f admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:40.956571 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78d1b8-dec6-41ed-9a41-23be1149742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:40.957583 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78d1b8-dec6-41ed-9a41-23be1149742a admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:40.958071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78d1b8-dec6-41ed-9a41-23be1149742a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:40.958476 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78d1b8-dec6-41ed-9a41-23be1149742a admin admin] PATH_INFO: `/v3/projects/ae42f7d5c2db440bbf5d4a48f1e32500/users/363845e90d034a1f869152be8eb1839b/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:40.994453 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78d1b8-dec6-41ed-9a41-23be1149742a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae42f7d5c2db440bbf5d4a48f1e32500, user_id=363845e90d034a1f869152be8eb1839b, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:40.997262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f78d1b8-dec6-41ed-9a41-23be1149742a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:41.200862 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61725313-2059-4abb-a93c-45eff2885b7e admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:41.203586 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-61725313-2059-4abb-a93c-45eff2885b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:41.219226 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61725313-2059-4abb-a93c-45eff2885b7e admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:41.225160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c8dcb-0fd8-45ba-9727-75ef2fbce80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:41.226147 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c8dcb-0fd8-45ba-9727-75ef2fbce80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:41.226572 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c8dcb-0fd8-45ba-9727-75ef2fbce80f admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:41.226910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c8dcb-0fd8-45ba-9727-75ef2fbce80f admin admin] PATH_INFO: `/v3/users/018911dffda74243be8368d3b7132372` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:41.228137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c8dcb-0fd8-45ba-9727-75ef2fbce80f admin admin] RBAC: Authorizing `identity:delete_user(user_id=018911dffda74243be8368d3b7132372)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:41.230131 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c8dcb-0fd8-45ba-9727-75ef2fbce80f admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:41.458947 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1318/2669] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:06:40 2022] PUT /identity/v3/projects/ae42f7d5c2db440bbf5d4a48f1e32500/users/363845e90d034a1f869152be8eb1839b/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:06:41.474821 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc076774-cc27-4b04-ac5d-3f11264d2266 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:41.475796 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc076774-cc27-4b04-ac5d-3f11264d2266 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:41.476533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc076774-cc27-4b04-ac5d-3f11264d2266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:41.508817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-bc076774-cc27-4b04-ac5d-3f11264d2266 None None] MFA Rules not processed for user `363845e90d034a1f869152be8eb1839b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:41.510178 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-bc076774-cc27-4b04-ac5d-3f11264d2266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:41.533471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:41.582037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1319/2670] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:41.586840 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc076774-cc27-4b04-ac5d-3f11264d2266 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:41.649162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc076774-cc27-4b04-ac5d-3f11264d2266 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:41.653920 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb4bb8-56bc-4d0e-a57e-be958129d062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:41.654606 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb4bb8-56bc-4d0e-a57e-be958129d062 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:41.654895 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb4bb8-56bc-4d0e-a57e-be958129d062 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:41.655172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb4bb8-56bc-4d0e-a57e-be958129d062 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:41.655851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb4bb8-56bc-4d0e-a57e-be958129d062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:41.657764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb4bb8-56bc-4d0e-a57e-be958129d062 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:41.688041 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3b2c8dcb-0fd8-45ba-9727-75ef2fbce80f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018911dffda74243be8368d3b7132372'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:41.774096 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1320/2671] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:06:41 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:06:41.778157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3b2c8dcb-0fd8-45ba-9727-75ef2fbce80f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018911dffda74243be8368d3b7132372'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:41.778743 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb4bb8-56bc-4d0e-a57e-be958129d062 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:41.778886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3b2c8dcb-0fd8-45ba-9727-75ef2fbce80f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018911dffda74243be8368d3b7132372'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:41.779940 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d3eb4bb8-56bc-4d0e-a57e-be958129d062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:41.786382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3b2c8dcb-0fd8-45ba-9727-75ef2fbce80f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018911dffda74243be8368d3b7132372'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:41.799019 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-3b2c8dcb-0fd8-45ba-9727-75ef2fbce80f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018911dffda74243be8368d3b7132372'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:41.808112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1352/2672] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:06:41 2022] DELETE /identity/v3/users/018911dffda74243be8368d3b7132372 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:06:41.815403 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013e3fe-d4e8-46e4-8fad-4c9195401ee6 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:41.820425 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013e3fe-d4e8-46e4-8fad-4c9195401ee6 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:41.820425 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013e3fe-d4e8-46e4-8fad-4c9195401ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:41.838848 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a013e3fe-d4e8-46e4-8fad-4c9195401ee6 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:41.840676 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a013e3fe-d4e8-46e4-8fad-4c9195401ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:41.845020 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb4bb8-56bc-4d0e-a57e-be958129d062 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:41.899087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:41.912442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2da42f-c59e-4e42-a7ac-ae658228479a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:41.912442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da42f-c59e-4e42-a7ac-ae658228479a admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:41.912442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da42f-c59e-4e42-a7ac-ae658228479a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:41.912442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da42f-c59e-4e42-a7ac-ae658228479a admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:41.912832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2da42f-c59e-4e42-a7ac-ae658228479a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:41.912915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1353/2673] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:41.913002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2da42f-c59e-4e42-a7ac-ae658228479a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:41.921120 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013e3fe-d4e8-46e4-8fad-4c9195401ee6 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:41.922655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a013e3fe-d4e8-46e4-8fad-4c9195401ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:41.957350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:41.983342 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013e3fe-d4e8-46e4-8fad-4c9195401ee6 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:41.987565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421fc88-9b4d-4684-91a4-96c8c00ac952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:41.988376 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421fc88-9b4d-4684-91a4-96c8c00ac952 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:41.988665 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421fc88-9b4d-4684-91a4-96c8c00ac952 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:41.988949 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421fc88-9b4d-4684-91a4-96c8c00ac952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:41.998856 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421fc88-9b4d-4684-91a4-96c8c00ac952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:42.000322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421fc88-9b4d-4684-91a4-96c8c00ac952 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:42.011346 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1354/2674] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:06:42.019495 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1321/2675] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:06:41 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:06:42.023534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421fc88-9b4d-4684-91a4-96c8c00ac952 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:42.033789 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421fc88-9b4d-4684-91a4-96c8c00ac952 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:42.038573 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16274a2-e1ba-4890-b070-7f08a3740282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:42.039307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16274a2-e1ba-4890-b070-7f08a3740282 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:42.039605 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16274a2-e1ba-4890-b070-7f08a3740282 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:42.039881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16274a2-e1ba-4890-b070-7f08a3740282 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:42.040611 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16274a2-e1ba-4890-b070-7f08a3740282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:42.042273 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16274a2-e1ba-4890-b070-7f08a3740282 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:42.052965 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1355/2676] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:06:42.061408 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2da42f-c59e-4e42-a7ac-ae658228479a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:42.072185 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2da42f-c59e-4e42-a7ac-ae658228479a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:42.077971 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4626d-f28a-4cc9-afb2-ae111bd2b41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:42.078332 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4626d-f28a-4cc9-afb2-ae111bd2b41a admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:42.088017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4626d-f28a-4cc9-afb2-ae111bd2b41a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:42.088017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4626d-f28a-4cc9-afb2-ae111bd2b41a admin admin] PATH_INFO: `/v3/projects/893fe9a0026f42c1a28ce1f0fe9712d6/users/8a293f9e6b3d4a478b1789e6fde3ea78/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:42.094868 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4626d-f28a-4cc9-afb2-ae111bd2b41a admin admin] RBAC: Authorizing `identity:create_grant(project_id=893fe9a0026f42c1a28ce1f0fe9712d6, user_id=8a293f9e6b3d4a478b1789e6fde3ea78, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:42.097703 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4626d-f28a-4cc9-afb2-ae111bd2b41a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:42.175551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1322/2677] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:06:42 2022] PUT /identity/v3/projects/893fe9a0026f42c1a28ce1f0fe9712d6/users/8a293f9e6b3d4a478b1789e6fde3ea78/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:42.179519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16274a2-e1ba-4890-b070-7f08a3740282 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:42.190884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16274a2-e1ba-4890-b070-7f08a3740282 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:42.250638 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a993a14-8bcb-41e5-b29b-2781f93eddd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:42.254523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a993a14-8bcb-41e5-b29b-2781f93eddd1 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:42.254523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a993a14-8bcb-41e5-b29b-2781f93eddd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:42.254523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a993a14-8bcb-41e5-b29b-2781f93eddd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:42.254523 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a993a14-8bcb-41e5-b29b-2781f93eddd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:42.254921 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a993a14-8bcb-41e5-b29b-2781f93eddd1 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:42.264959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1356/2678] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:06:42.269132 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4626d-f28a-4cc9-afb2-ae111bd2b41a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:42.281573 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4626d-f28a-4cc9-afb2-ae111bd2b41a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:42.286543 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f281895-0078-44a5-940c-3847aea87110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:42.287790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f281895-0078-44a5-940c-3847aea87110 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:42.287790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f281895-0078-44a5-940c-3847aea87110 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:42.288022 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f281895-0078-44a5-940c-3847aea87110 admin admin] PATH_INFO: `/v3/projects/893fe9a0026f42c1a28ce1f0fe9712d6/users/8a293f9e6b3d4a478b1789e6fde3ea78/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:42.290067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f281895-0078-44a5-940c-3847aea87110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=893fe9a0026f42c1a28ce1f0fe9712d6, user_id=8a293f9e6b3d4a478b1789e6fde3ea78, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:42.292770 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f281895-0078-44a5-940c-3847aea87110 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:42.305159 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1323/2679] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:06:42 2022] PUT /identity/v3/projects/893fe9a0026f42c1a28ce1f0fe9712d6/users/8a293f9e6b3d4a478b1789e6fde3ea78/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:42.316098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4fde2-d93e-4a55-8a7b-3d7d690025fe None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:42.317538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4fde2-d93e-4a55-8a7b-3d7d690025fe None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:42.317538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4fde2-d93e-4a55-8a7b-3d7d690025fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:42.343382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-9cf4fde2-d93e-4a55-8a7b-3d7d690025fe None None] MFA Rules not processed for user `8a293f9e6b3d4a478b1789e6fde3ea78`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:42.345118 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9cf4fde2-d93e-4a55-8a7b-3d7d690025fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:42.414266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1357/2680] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:42.426138 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f281895-0078-44a5-940c-3847aea87110 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:42.428012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-8f281895-0078-44a5-940c-3847aea87110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:42.486462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4fde2-d93e-4a55-8a7b-3d7d690025fe None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:42.488180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-9cf4fde2-d93e-4a55-8a7b-3d7d690025fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:42.491341 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f281895-0078-44a5-940c-3847aea87110 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:42.496629 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089dd79-dc79-4d3d-99ce-425776fa9172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:42.497285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089dd79-dc79-4d3d-99ce-425776fa9172 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:42.497577 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089dd79-dc79-4d3d-99ce-425776fa9172 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:42.498027 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089dd79-dc79-4d3d-99ce-425776fa9172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:42.500033 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-c089dd79-dc79-4d3d-99ce-425776fa9172 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:42.550785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:42.563207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089dd79-dc79-4d3d-99ce-425776fa9172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:42.564710 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089dd79-dc79-4d3d-99ce-425776fa9172 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:42.569763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4fde2-d93e-4a55-8a7b-3d7d690025fe None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:42.573906 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1324/2681] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:06:42.574924 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661a760-ed37-4d3f-9a35-00904e8a907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:42.575783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661a760-ed37-4d3f-9a35-00904e8a907a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:42.576066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661a760-ed37-4d3f-9a35-00904e8a907a admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:42.576341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661a760-ed37-4d3f-9a35-00904e8a907a admin admin] PATH_INFO: `/v3/projects/2ab5c2776d1d49c3bd3611000e4eaf76` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:42.577524 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661a760-ed37-4d3f-9a35-00904e8a907a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab5c2776d1d49c3bd3611000e4eaf76)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:42.579708 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1661a760-ed37-4d3f-9a35-00904e8a907a admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:42.697500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-1661a760-ed37-4d3f-9a35-00904e8a907a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab5c2776d1d49c3bd3611000e4eaf76', 'request_id': 'req-1661a760-ed37-4d3f-9a35-00904e8a907a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:42.703639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-1661a760-ed37-4d3f-9a35-00904e8a907a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab5c2776d1d49c3bd3611000e4eaf76', 'request_id': 'req-1661a760-ed37-4d3f-9a35-00904e8a907a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:42.709775 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-1661a760-ed37-4d3f-9a35-00904e8a907a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab5c2776d1d49c3bd3611000e4eaf76', 'request_id': 'req-1661a760-ed37-4d3f-9a35-00904e8a907a'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:42.770797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-1661a760-ed37-4d3f-9a35-00904e8a907a admin admin] The token cache is being invalidate because project 2ab5c2776d1d49c3bd3611000e4eaf76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:06:42.771091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-1661a760-ed37-4d3f-9a35-00904e8a907a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:42.771765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-1661a760-ed37-4d3f-9a35-00904e8a907a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:42.773358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1358/2682] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:06:42 2022] DELETE /identity/v3/projects/2ab5c2776d1d49c3bd3611000e4eaf76 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:06:42.777618 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089dd79-dc79-4d3d-99ce-425776fa9172 service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:42.788308 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089dd79-dc79-4d3d-99ce-425776fa9172 service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:42.844270 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e276a-d4d8-4b35-b577-2fdbe29da918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:42.845150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e276a-d4d8-4b35-b577-2fdbe29da918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:42.845491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e276a-d4d8-4b35-b577-2fdbe29da918 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:42.845772 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e276a-d4d8-4b35-b577-2fdbe29da918 admin admin] PATH_INFO: `/v3/users/4be1e5f4e41842c5a6ba0ff25f72be0e` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:42.847051 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e276a-d4d8-4b35-b577-2fdbe29da918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be1e5f4e41842c5a6ba0ff25f72be0e)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:42.848967 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e276a-d4d8-4b35-b577-2fdbe29da918 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:42.850553 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:43.063089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a71e276a-d4d8-4b35-b577-2fdbe29da918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be1e5f4e41842c5a6ba0ff25f72be0e'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:43.064368 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a71e276a-d4d8-4b35-b577-2fdbe29da918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be1e5f4e41842c5a6ba0ff25f72be0e'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:43.134767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a71e276a-d4d8-4b35-b577-2fdbe29da918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be1e5f4e41842c5a6ba0ff25f72be0e'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:43.148653 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a71e276a-d4d8-4b35-b577-2fdbe29da918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be1e5f4e41842c5a6ba0ff25f72be0e'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:43.155890 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a71e276a-d4d8-4b35-b577-2fdbe29da918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be1e5f4e41842c5a6ba0ff25f72be0e'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:43.161839 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1325/2683] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:06:42 2022] DELETE /identity/v3/users/4be1e5f4e41842c5a6ba0ff25f72be0e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:43.596710 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661a760-ed37-4d3f-9a35-00904e8a907a admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:43.596710 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-1661a760-ed37-4d3f-9a35-00904e8a907a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:43.608247 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1661a760-ed37-4d3f-9a35-00904e8a907a admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:43.666175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2a2e0-d856-42c5-bfd7-a9fdb602be45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:43.667064 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2a2e0-d856-42c5-bfd7-a9fdb602be45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:43.667348 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2a2e0-d856-42c5-bfd7-a9fdb602be45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:43.667625 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2a2e0-d856-42c5-bfd7-a9fdb602be45 admin admin] PATH_INFO: `/v3/projects/6b71c514f4984755bd698c319d96f9f7` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:43.668796 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2a2e0-d856-42c5-bfd7-a9fdb602be45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b71c514f4984755bd698c319d96f9f7)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:43.670751 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2a2e0-d856-42c5-bfd7-a9fdb602be45 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:43.820557 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a6d2a2e0-d856-42c5-bfd7-a9fdb602be45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b71c514f4984755bd698c319d96f9f7', 'request_id': 'req-a6d2a2e0-d856-42c5-bfd7-a9fdb602be45'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:43.826639 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a6d2a2e0-d856-42c5-bfd7-a9fdb602be45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b71c514f4984755bd698c319d96f9f7', 'request_id': 'req-a6d2a2e0-d856-42c5-bfd7-a9fdb602be45'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:43.832576 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a6d2a2e0-d856-42c5-bfd7-a9fdb602be45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b71c514f4984755bd698c319d96f9f7', 'request_id': 'req-a6d2a2e0-d856-42c5-bfd7-a9fdb602be45'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:43.925194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a6d2a2e0-d856-42c5-bfd7-a9fdb602be45 admin admin] The token cache is being invalidate because project 6b71c514f4984755bd698c319d96f9f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:06:43.925425 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a6d2a2e0-d856-42c5-bfd7-a9fdb602be45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:43.926043 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-a6d2a2e0-d856-42c5-bfd7-a9fdb602be45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:43.927591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1359/2684] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:06:43 2022] DELETE /identity/v3/projects/6b71c514f4984755bd698c319d96f9f7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:43.933595 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fec1d5-7c8c-42b4-8ee5-cf7c4ec060bd None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:43.934085 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fec1d5-7c8c-42b4-8ee5-cf7c4ec060bd None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:43.934190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fec1d5-7c8c-42b4-8ee5-cf7c4ec060bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:43.952736 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-90fec1d5-7c8c-42b4-8ee5-cf7c4ec060bd None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:43.956484 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-90fec1d5-7c8c-42b4-8ee5-cf7c4ec060bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:44.012909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1326/2685] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:44.022696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808678d1-eae6-4a31-9adb-50c55a5ab9a3 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:44.023117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808678d1-eae6-4a31-9adb-50c55a5ab9a3 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:44.023401 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808678d1-eae6-4a31-9adb-50c55a5ab9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:44.030736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:44.043427 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-808678d1-eae6-4a31-9adb-50c55a5ab9a3 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:44.044617 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-808678d1-eae6-4a31-9adb-50c55a5ab9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:44.052603 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1360/2686] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:44.056982 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fec1d5-7c8c-42b4-8ee5-cf7c4ec060bd None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:44.067207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fec1d5-7c8c-42b4-8ee5-cf7c4ec060bd None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:44.071798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75298055-6c58-4e23-8b8d-dcaef918c7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:44.072464 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75298055-6c58-4e23-8b8d-dcaef918c7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:44.072735 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75298055-6c58-4e23-8b8d-dcaef918c7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:44.073019 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75298055-6c58-4e23-8b8d-dcaef918c7c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:44.073779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75298055-6c58-4e23-8b8d-dcaef918c7c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:06:44.074094 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75298055-6c58-4e23-8b8d-dcaef918c7c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:44.075747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75298055-6c58-4e23-8b8d-dcaef918c7c2 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:44.087929 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1327/2687] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:06:44.097821 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808678d1-eae6-4a31-9adb-50c55a5ab9a3 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:44.107100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808678d1-eae6-4a31-9adb-50c55a5ab9a3 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:44.111868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacd79c-c71c-4ade-bfc3-ed83e7194060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:44.112522 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacd79c-c71c-4ade-bfc3-ed83e7194060 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:44.112857 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacd79c-c71c-4ade-bfc3-ed83e7194060 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:44.113150 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacd79c-c71c-4ade-bfc3-ed83e7194060 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:44.113884 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacd79c-c71c-4ade-bfc3-ed83e7194060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:44.115829 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacd79c-c71c-4ade-bfc3-ed83e7194060 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:44.193894 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1361/2688] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:06:44 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:06:44.194914 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75298055-6c58-4e23-8b8d-dcaef918c7c2 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:44.205733 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75298055-6c58-4e23-8b8d-dcaef918c7c2 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:44.267228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dfa54-1b96-4921-8956-3bf4c700705b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:44.267924 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dfa54-1b96-4921-8956-3bf4c700705b admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:44.268214 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dfa54-1b96-4921-8956-3bf4c700705b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:44.268499 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dfa54-1b96-4921-8956-3bf4c700705b admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:44.269212 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dfa54-1b96-4921-8956-3bf4c700705b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:44.271173 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dfa54-1b96-4921-8956-3bf4c700705b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:44.282212 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:44.375319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1328/2689] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:06:44 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:06:44.379538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacd79c-c71c-4ade-bfc3-ed83e7194060 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:44.390115 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacd79c-c71c-4ade-bfc3-ed83e7194060 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:44.395706 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66564db-8213-482f-84f0-47e8a8260bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:44.396367 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66564db-8213-482f-84f0-47e8a8260bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:44.396655 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66564db-8213-482f-84f0-47e8a8260bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:44.396933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66564db-8213-482f-84f0-47e8a8260bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:44.397656 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66564db-8213-482f-84f0-47e8a8260bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:44.399324 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66564db-8213-482f-84f0-47e8a8260bb2 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:44.410581 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1362/2690] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:44.414617 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dfa54-1b96-4921-8956-3bf4c700705b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:44.424851 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dfa54-1b96-4921-8956-3bf4c700705b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:44.429553 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93c9ff-8442-4027-b508-916f01207750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:44.431588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93c9ff-8442-4027-b508-916f01207750 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:44.431588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93c9ff-8442-4027-b508-916f01207750 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:44.431588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93c9ff-8442-4027-b508-916f01207750 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:44.431948 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93c9ff-8442-4027-b508-916f01207750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:44.433295 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93c9ff-8442-4027-b508-916f01207750 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:44.443804 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1329/2691] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:44.448080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66564db-8213-482f-84f0-47e8a8260bb2 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:44.459057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66564db-8213-482f-84f0-47e8a8260bb2 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:44.463629 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9b25e-a73a-45c8-b6da-13ac3f3500af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:44.468886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9b25e-a73a-45c8-b6da-13ac3f3500af admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:44.468886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9b25e-a73a-45c8-b6da-13ac3f3500af admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:44.468886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9b25e-a73a-45c8-b6da-13ac3f3500af admin admin] PATH_INFO: `/v3/projects/1abb8597bad4438cbc1dc45e1cf86768/users/b74c3c697f9c46b5ae8e844e9ccfbfd8/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:44.480352 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9b25e-a73a-45c8-b6da-13ac3f3500af admin admin] RBAC: Authorizing `identity:create_grant(project_id=1abb8597bad4438cbc1dc45e1cf86768, user_id=b74c3c697f9c46b5ae8e844e9ccfbfd8, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:44.483176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c9b25e-a73a-45c8-b6da-13ac3f3500af admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:44.555973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1363/2692] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:06:44 2022] PUT /identity/v3/projects/1abb8597bad4438cbc1dc45e1cf86768/users/b74c3c697f9c46b5ae8e844e9ccfbfd8/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:44.567881 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a22e22-e66f-4908-af7e-c963de9c5543 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:44.568176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a22e22-e66f-4908-af7e-c963de9c5543 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:44.568491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a22e22-e66f-4908-af7e-c963de9c5543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:44.596276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-16a22e22-e66f-4908-af7e-c963de9c5543 None None] MFA Rules not processed for user `b74c3c697f9c46b5ae8e844e9ccfbfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:44.597515 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-16a22e22-e66f-4908-af7e-c963de9c5543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:44.630302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9b25e-a73a-45c8-b6da-13ac3f3500af admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:44.632082 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-52c9b25e-a73a-45c8-b6da-13ac3f3500af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:44.663016 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1330/2693] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:44.674014 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a22e22-e66f-4908-af7e-c963de9c5543 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:44.675769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-16a22e22-e66f-4908-af7e-c963de9c5543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:44.691386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9b25e-a73a-45c8-b6da-13ac3f3500af admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:44.695229 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2521a4-b5e7-4310-836f-12b99ded60de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:44.695883 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2521a4-b5e7-4310-836f-12b99ded60de service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:44.696179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2521a4-b5e7-4310-836f-12b99ded60de service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:44.696460 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2521a4-b5e7-4310-836f-12b99ded60de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:44.698277 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-4b2521a4-b5e7-4310-836f-12b99ded60de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:44.732116 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a22e22-e66f-4908-af7e-c963de9c5543 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:44.735776 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a145f8-d482-4f8a-aea3-1dc251f12f32 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2b57ae83164912a4e23dda9dc239f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:44.736422 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a145f8-d482-4f8a-aea3-1dc251f12f32 service glance] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:44.736710 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a145f8-d482-4f8a-aea3-1dc251f12f32 service glance] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:44.736993 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a145f8-d482-4f8a-aea3-1dc251f12f32 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:44.745267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a145f8-d482-4f8a-aea3-1dc251f12f32 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:44.746741 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a145f8-d482-4f8a-aea3-1dc251f12f32 service glance] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:44.756100 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1331/2694] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:06:44.757857 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2521a4-b5e7-4310-836f-12b99ded60de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:44.759338 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2521a4-b5e7-4310-836f-12b99ded60de service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:44.769013 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1364/2695] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:06:47.687182 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a145f8-d482-4f8a-aea3-1dc251f12f32 service glance] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:47.697944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a145f8-d482-4f8a-aea3-1dc251f12f32 service glance] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:47.701946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95987b11-1fcd-4b85-a2a7-c455a7abc3fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:47.702649 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95987b11-1fcd-4b85-a2a7-c455a7abc3fb service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:47.702939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95987b11-1fcd-4b85-a2a7-c455a7abc3fb service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:47.703221 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95987b11-1fcd-4b85-a2a7-c455a7abc3fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:47.705786 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-95987b11-1fcd-4b85-a2a7-c455a7abc3fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:47.782925 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95987b11-1fcd-4b85-a2a7-c455a7abc3fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:47.784738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95987b11-1fcd-4b85-a2a7-c455a7abc3fb service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:47.808513 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1332/2696] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:06:49.803579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a15045-4b58-46a5-b454-8e6b3d212a5d None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:49.804591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a15045-4b58-46a5-b454-8e6b3d212a5d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:49.804591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a15045-4b58-46a5-b454-8e6b3d212a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:49.829598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c2a15045-4b58-46a5-b454-8e6b3d212a5d None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:49.829598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c2a15045-4b58-46a5-b454-8e6b3d212a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:49.879811 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:49.889002 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1365/2697] 10.222.0.15 () {58 vars in 967 bytes} [Fri May 27 20:06:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:49.902287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95987b11-1fcd-4b85-a2a7-c455a7abc3fb service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:49.903756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-95987b11-1fcd-4b85-a2a7-c455a7abc3fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:49.917325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:49.979377 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95987b11-1fcd-4b85-a2a7-c455a7abc3fb service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:49.984610 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3acc16c-c627-46b7-af91-d08b7a34b982 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:49.985296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acc16c-c627-46b7-af91-d08b7a34b982 service swift] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:50.004480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acc16c-c627-46b7-af91-d08b7a34b982 service swift] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:50.004480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3acc16c-c627-46b7-af91-d08b7a34b982 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:50.004480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acc16c-c627-46b7-af91-d08b7a34b982 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:50.004480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3acc16c-c627-46b7-af91-d08b7a34b982 service swift] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:50.005003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1333/2698] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:06:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 20:06:52.773814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a15045-4b58-46a5-b454-8e6b3d212a5d None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:52.775253 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c2a15045-4b58-46a5-b454-8e6b3d212a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:52.839942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a15045-4b58-46a5-b454-8e6b3d212a5d None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:52.844599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae747b-c53e-445f-b87c-e2e32e44cfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:52.846084 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae747b-c53e-445f-b87c-e2e32e44cfc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:52.846399 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae747b-c53e-445f-b87c-e2e32e44cfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:52.846676 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae747b-c53e-445f-b87c-e2e32e44cfc5 admin admin] PATH_INFO: `/v3/users/99c0e9157949440996b6763af800d13b` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:52.847864 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae747b-c53e-445f-b87c-e2e32e44cfc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c0e9157949440996b6763af800d13b)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:52.849803 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae747b-c53e-445f-b87c-e2e32e44cfc5 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:53.083217 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-17ae747b-c53e-445f-b87c-e2e32e44cfc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c0e9157949440996b6763af800d13b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:53.194549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-17ae747b-c53e-445f-b87c-e2e32e44cfc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c0e9157949440996b6763af800d13b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:53.195217 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-17ae747b-c53e-445f-b87c-e2e32e44cfc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c0e9157949440996b6763af800d13b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:53.202969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-17ae747b-c53e-445f-b87c-e2e32e44cfc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c0e9157949440996b6763af800d13b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:53.215559 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-17ae747b-c53e-445f-b87c-e2e32e44cfc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c0e9157949440996b6763af800d13b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:53.221712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1366/2699] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:06:52 2022] DELETE /identity/v3/users/99c0e9157949440996b6763af800d13b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:53.226216 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02371b-ea21-462e-9d8e-d7f3af45f64e None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:53.226830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02371b-ea21-462e-9d8e-d7f3af45f64e None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:53.226941 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02371b-ea21-462e-9d8e-d7f3af45f64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:53.244285 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-0c02371b-ea21-462e-9d8e-d7f3af45f64e None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:53.245481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-0c02371b-ea21-462e-9d8e-d7f3af45f64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:53.305808 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1334/2700] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:53.316550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae747b-c53e-445f-b87c-e2e32e44cfc5 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:53.317955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-17ae747b-c53e-445f-b87c-e2e32e44cfc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:53.379031 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae747b-c53e-445f-b87c-e2e32e44cfc5 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:53.382731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daf992-672a-4044-8617-66d86d129bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:53.383419 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daf992-672a-4044-8617-66d86d129bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:53.383712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daf992-672a-4044-8617-66d86d129bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:53.384102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08daf992-672a-4044-8617-66d86d129bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:53.393283 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daf992-672a-4044-8617-66d86d129bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:53.394898 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08daf992-672a-4044-8617-66d86d129bc1 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:53.405268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1367/2701] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:06:53.925074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02371b-ea21-462e-9d8e-d7f3af45f64e None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:53.926883 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-0c02371b-ea21-462e-9d8e-d7f3af45f64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:53.939926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c02371b-ea21-462e-9d8e-d7f3af45f64e None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:53.944691 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52e629-d3d9-4624-a6c5-12680d452245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:53.945662 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52e629-d3d9-4624-a6c5-12680d452245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:53.945956 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52e629-d3d9-4624-a6c5-12680d452245 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:53.946295 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52e629-d3d9-4624-a6c5-12680d452245 admin admin] PATH_INFO: `/v3/projects/1889f9038fe947e89bdb3968c0d2f97b` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:53.947731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52e629-d3d9-4624-a6c5-12680d452245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1889f9038fe947e89bdb3968c0d2f97b)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:53.950165 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52e629-d3d9-4624-a6c5-12680d452245 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:54.088197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cc52e629-d3d9-4624-a6c5-12680d452245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1889f9038fe947e89bdb3968c0d2f97b', 'request_id': 'req-cc52e629-d3d9-4624-a6c5-12680d452245'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:54.189506 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cc52e629-d3d9-4624-a6c5-12680d452245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1889f9038fe947e89bdb3968c0d2f97b', 'request_id': 'req-cc52e629-d3d9-4624-a6c5-12680d452245'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:54.196294 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cc52e629-d3d9-4624-a6c5-12680d452245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1889f9038fe947e89bdb3968c0d2f97b', 'request_id': 'req-cc52e629-d3d9-4624-a6c5-12680d452245'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:54.208305 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cc52e629-d3d9-4624-a6c5-12680d452245 admin admin] The token cache is being invalidate because project 1889f9038fe947e89bdb3968c0d2f97b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:06:54.208609 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cc52e629-d3d9-4624-a6c5-12680d452245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:54.209276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-cc52e629-d3d9-4624-a6c5-12680d452245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:54.210907 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1335/2702] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:06:53 2022] DELETE /identity/v3/projects/1889f9038fe947e89bdb3968c0d2f97b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:54.214968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daf992-672a-4044-8617-66d86d129bc1 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:54.224643 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08daf992-672a-4044-8617-66d86d129bc1 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:54.241531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:54.283361 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb21595-a274-48f9-aedc-153b64b6ebb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:54.284277 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb21595-a274-48f9-aedc-153b64b6ebb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:54.284566 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb21595-a274-48f9-aedc-153b64b6ebb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:54.284848 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb21595-a274-48f9-aedc-153b64b6ebb7 admin admin] PATH_INFO: `/v3/users/363845e90d034a1f869152be8eb1839b` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:54.286034 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb21595-a274-48f9-aedc-153b64b6ebb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=363845e90d034a1f869152be8eb1839b)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:54.288048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb21595-a274-48f9-aedc-153b64b6ebb7 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:54.539923 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6bb21595-a274-48f9-aedc-153b64b6ebb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '363845e90d034a1f869152be8eb1839b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:54.592121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6bb21595-a274-48f9-aedc-153b64b6ebb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '363845e90d034a1f869152be8eb1839b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:54.592739 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6bb21595-a274-48f9-aedc-153b64b6ebb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '363845e90d034a1f869152be8eb1839b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:54.600766 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6bb21595-a274-48f9-aedc-153b64b6ebb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '363845e90d034a1f869152be8eb1839b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:54.616690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6bb21595-a274-48f9-aedc-153b64b6ebb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '363845e90d034a1f869152be8eb1839b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:54.622925 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1368/2703] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:06:54 2022] DELETE /identity/v3/users/363845e90d034a1f869152be8eb1839b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:55.285575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52e629-d3d9-4624-a6c5-12680d452245 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:55.287085 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cc52e629-d3d9-4624-a6c5-12680d452245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:55.304118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52e629-d3d9-4624-a6c5-12680d452245 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:55.327454 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:55.365455 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30230597-b610-41f0-b9ef-62a9d0207fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:55.366317 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30230597-b610-41f0-b9ef-62a9d0207fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:55.366637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30230597-b610-41f0-b9ef-62a9d0207fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:55.366919 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30230597-b610-41f0-b9ef-62a9d0207fd2 admin admin] PATH_INFO: `/v3/projects/ae42f7d5c2db440bbf5d4a48f1e32500` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:55.368168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30230597-b610-41f0-b9ef-62a9d0207fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae42f7d5c2db440bbf5d4a48f1e32500)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:55.371003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30230597-b610-41f0-b9ef-62a9d0207fd2 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:55.464998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-30230597-b610-41f0-b9ef-62a9d0207fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae42f7d5c2db440bbf5d4a48f1e32500', 'request_id': 'req-30230597-b610-41f0-b9ef-62a9d0207fd2'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:55.535335 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-30230597-b610-41f0-b9ef-62a9d0207fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae42f7d5c2db440bbf5d4a48f1e32500', 'request_id': 'req-30230597-b610-41f0-b9ef-62a9d0207fd2'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:55.542205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-30230597-b610-41f0-b9ef-62a9d0207fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae42f7d5c2db440bbf5d4a48f1e32500', 'request_id': 'req-30230597-b610-41f0-b9ef-62a9d0207fd2'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:55.552878 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-30230597-b610-41f0-b9ef-62a9d0207fd2 admin admin] The token cache is being invalidate because project ae42f7d5c2db440bbf5d4a48f1e32500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:06:55.553171 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-30230597-b610-41f0-b9ef-62a9d0207fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:55.553816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-30230597-b610-41f0-b9ef-62a9d0207fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:55.555387 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1336/2704] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:06:55 2022] DELETE /identity/v3/projects/ae42f7d5c2db440bbf5d4a48f1e32500 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:55.559335 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb21595-a274-48f9-aedc-153b64b6ebb7 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:55.560733 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-6bb21595-a274-48f9-aedc-153b64b6ebb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:55.573358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb21595-a274-48f9-aedc-153b64b6ebb7 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:55.629667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82d79f-1faf-47d3-a6a9-2ab5cb39f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:55.630582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82d79f-1faf-47d3-a6a9-2ab5cb39f7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:55.630874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82d79f-1faf-47d3-a6a9-2ab5cb39f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:55.631160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82d79f-1faf-47d3-a6a9-2ab5cb39f7b8 admin admin] PATH_INFO: `/v3/users/8a293f9e6b3d4a478b1789e6fde3ea78` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:55.632358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82d79f-1faf-47d3-a6a9-2ab5cb39f7b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a293f9e6b3d4a478b1789e6fde3ea78)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:55.634313 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82d79f-1faf-47d3-a6a9-2ab5cb39f7b8 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:55.814800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:55.819717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2a82d79f-1faf-47d3-a6a9-2ab5cb39f7b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a293f9e6b3d4a478b1789e6fde3ea78'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:55.881010 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2a82d79f-1faf-47d3-a6a9-2ab5cb39f7b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a293f9e6b3d4a478b1789e6fde3ea78'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:55.881926 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2a82d79f-1faf-47d3-a6a9-2ab5cb39f7b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a293f9e6b3d4a478b1789e6fde3ea78'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:55.889517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2a82d79f-1faf-47d3-a6a9-2ab5cb39f7b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a293f9e6b3d4a478b1789e6fde3ea78'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:55.902236 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2a82d79f-1faf-47d3-a6a9-2ab5cb39f7b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a293f9e6b3d4a478b1789e6fde3ea78'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:55.908137 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1369/2705] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:06:55 2022] DELETE /identity/v3/users/8a293f9e6b3d4a478b1789e6fde3ea78 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:56.302497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30230597-b610-41f0-b9ef-62a9d0207fd2 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:56.303923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-30230597-b610-41f0-b9ef-62a9d0207fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:56.318772 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30230597-b610-41f0-b9ef-62a9d0207fd2 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:56.377828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407be64-0d02-45c9-b427-21d48ec13d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:56.378659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407be64-0d02-45c9-b427-21d48ec13d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:56.378951 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407be64-0d02-45c9-b427-21d48ec13d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:56.379236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407be64-0d02-45c9-b427-21d48ec13d6b admin admin] PATH_INFO: `/v3/projects/893fe9a0026f42c1a28ce1f0fe9712d6` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:56.380417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407be64-0d02-45c9-b427-21d48ec13d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=893fe9a0026f42c1a28ce1f0fe9712d6)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:56.382386 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407be64-0d02-45c9-b427-21d48ec13d6b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:56.506852 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a407be64-0d02-45c9-b427-21d48ec13d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '893fe9a0026f42c1a28ce1f0fe9712d6', 'request_id': 'req-a407be64-0d02-45c9-b427-21d48ec13d6b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:56.646193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a407be64-0d02-45c9-b427-21d48ec13d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '893fe9a0026f42c1a28ce1f0fe9712d6', 'request_id': 'req-a407be64-0d02-45c9-b427-21d48ec13d6b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:56.647529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:56.653786 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a407be64-0d02-45c9-b427-21d48ec13d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '893fe9a0026f42c1a28ce1f0fe9712d6', 'request_id': 'req-a407be64-0d02-45c9-b427-21d48ec13d6b'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:56.664191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a407be64-0d02-45c9-b427-21d48ec13d6b admin admin] The token cache is being invalidate because project 893fe9a0026f42c1a28ce1f0fe9712d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:06:56.664480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a407be64-0d02-45c9-b427-21d48ec13d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:56.665108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-a407be64-0d02-45c9-b427-21d48ec13d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:06:56.666688 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1337/2706] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:06:56 2022] DELETE /identity/v3/projects/893fe9a0026f42c1a28ce1f0fe9712d6 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:56.671500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1462e-cd1f-43b1-93f3-5857964fb33f None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:56.671978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1462e-cd1f-43b1-93f3-5857964fb33f None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:56.672098 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1462e-cd1f-43b1-93f3-5857964fb33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:56.690231 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-ccf1462e-cd1f-43b1-93f3-5857964fb33f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:56.691446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ccf1462e-cd1f-43b1-93f3-5857964fb33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:56.748769 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1370/2707] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:56.757984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af0445-df79-4133-9864-d579bb8aa42c None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:56.758282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af0445-df79-4133-9864-d579bb8aa42c None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:56.758605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af0445-df79-4133-9864-d579bb8aa42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:56.777356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-81af0445-df79-4133-9864-d579bb8aa42c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:56.778606 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-81af0445-df79-4133-9864-d579bb8aa42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:56.786861 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1338/2708] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:06:56.790912 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1462e-cd1f-43b1-93f3-5857964fb33f None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:56.800510 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1462e-cd1f-43b1-93f3-5857964fb33f None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:56.805152 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddd5a7-d706-4272-b89b-d674a3cb8824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:56.809107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddd5a7-d706-4272-b89b-d674a3cb8824 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:56.809107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddd5a7-d706-4272-b89b-d674a3cb8824 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:56.809107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddd5a7-d706-4272-b89b-d674a3cb8824 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:56.809107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddd5a7-d706-4272-b89b-d674a3cb8824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:06:56.809107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddd5a7-d706-4272-b89b-d674a3cb8824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:56.809107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bddd5a7-d706-4272-b89b-d674a3cb8824 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:56.820919 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1371/2709] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:06:56.825039 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af0445-df79-4133-9864-d579bb8aa42c None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:56.834967 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af0445-df79-4133-9864-d579bb8aa42c None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:56.839901 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c6d3e-e7b3-4aac-9380-9b4d371d0656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:56.840820 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c6d3e-e7b3-4aac-9380-9b4d371d0656 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:56.841368 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c6d3e-e7b3-4aac-9380-9b4d371d0656 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:56.841651 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c6d3e-e7b3-4aac-9380-9b4d371d0656 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:56.842383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c6d3e-e7b3-4aac-9380-9b4d371d0656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:56.844279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c6d3e-e7b3-4aac-9380-9b4d371d0656 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:56.961923 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1339/2710] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:06:56 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:06:56.965992 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddd5a7-d706-4272-b89b-d674a3cb8824 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:56.976023 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddd5a7-d706-4272-b89b-d674a3cb8824 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:57.031280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d695f-8dae-4452-96f7-dad295a6f805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:57.031942 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d695f-8dae-4452-96f7-dad295a6f805 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:57.032226 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d695f-8dae-4452-96f7-dad295a6f805 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:57.032532 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d695f-8dae-4452-96f7-dad295a6f805 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:57.033220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d695f-8dae-4452-96f7-dad295a6f805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:57.035243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d695f-8dae-4452-96f7-dad295a6f805 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:57.132786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1372/2711] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:06:56 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:06:57.136945 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c6d3e-e7b3-4aac-9380-9b4d371d0656 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:57.147489 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c6d3e-e7b3-4aac-9380-9b4d371d0656 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:57.152575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542f5cb-0eb7-4063-9a6d-25dd548bca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:57.153232 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542f5cb-0eb7-4063-9a6d-25dd548bca4f admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:57.153521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542f5cb-0eb7-4063-9a6d-25dd548bca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:57.153802 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542f5cb-0eb7-4063-9a6d-25dd548bca4f admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:57.154559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542f5cb-0eb7-4063-9a6d-25dd548bca4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:57.156152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542f5cb-0eb7-4063-9a6d-25dd548bca4f admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:57.166456 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1340/2712] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:57.170302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d695f-8dae-4452-96f7-dad295a6f805 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:57.180740 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d695f-8dae-4452-96f7-dad295a6f805 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:57.185686 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1b1b9-2e5c-4afa-a816-fde0dedba003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:57.193221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1b1b9-2e5c-4afa-a816-fde0dedba003 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:57.193221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1b1b9-2e5c-4afa-a816-fde0dedba003 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:57.193221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1b1b9-2e5c-4afa-a816-fde0dedba003 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:57.193221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1b1b9-2e5c-4afa-a816-fde0dedba003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:57.193221 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1b1b9-2e5c-4afa-a816-fde0dedba003 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:57.201914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1373/2713] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:06:57.206052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542f5cb-0eb7-4063-9a6d-25dd548bca4f admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:57.216061 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542f5cb-0eb7-4063-9a6d-25dd548bca4f admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:57.220782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565c3d4-40d6-49c6-884e-177d70a32fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:57.221691 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c3d4-40d6-49c6-884e-177d70a32fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:57.222870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c3d4-40d6-49c6-884e-177d70a32fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:57.222870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c3d4-40d6-49c6-884e-177d70a32fd7 admin admin] PATH_INFO: `/v3/projects/b44b8690592c4c1c81aa6fb8471cd252/users/0a09f8c359ef476baf5a9c22ddeba155/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:57.237782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565c3d4-40d6-49c6-884e-177d70a32fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44b8690592c4c1c81aa6fb8471cd252, user_id=0a09f8c359ef476baf5a9c22ddeba155, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:57.240511 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565c3d4-40d6-49c6-884e-177d70a32fd7 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:57.321324 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1341/2714] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:06:57 2022] PUT /identity/v3/projects/b44b8690592c4c1c81aa6fb8471cd252/users/0a09f8c359ef476baf5a9c22ddeba155/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:06:57.332225 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be676c-2a0e-4162-9e89-800041a3d296 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:57.332621 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be676c-2a0e-4162-9e89-800041a3d296 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:57.333006 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be676c-2a0e-4162-9e89-800041a3d296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:57.359723 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-05be676c-2a0e-4162-9e89-800041a3d296 None None] MFA Rules not processed for user `0a09f8c359ef476baf5a9c22ddeba155`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:06:57.361564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-05be676c-2a0e-4162-9e89-800041a3d296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:57.373230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:06:57.425094 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1374/2715] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:06:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:06:57.436296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565c3d4-40d6-49c6-884e-177d70a32fd7 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:57.438036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-a565c3d4-40d6-49c6-884e-177d70a32fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:06:57.496265 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565c3d4-40d6-49c6-884e-177d70a32fd7 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:06:57.500009 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3a508-009f-48e8-8d58-e591b3abc851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:06:57.500658 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3a508-009f-48e8-8d58-e591b3abc851 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:06:57.500952 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3a508-009f-48e8-8d58-e591b3abc851 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:06:57.501239 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3a508-009f-48e8-8d58-e591b3abc851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:06:57.509618 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3a508-009f-48e8-8d58-e591b3abc851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:06:57.511078 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3a508-009f-48e8-8d58-e591b3abc851 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:06:57.519916 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1342/2716] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:06:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:06:59.953312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be676c-2a0e-4162-9e89-800041a3d296 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:06:59.955291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-05be676c-2a0e-4162-9e89-800041a3d296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:00.019438 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be676c-2a0e-4162-9e89-800041a3d296 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:00.023860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82865b83-c7cf-4adc-8883-410fd181afc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:00.024715 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82865b83-c7cf-4adc-8883-410fd181afc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:00.025002 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82865b83-c7cf-4adc-8883-410fd181afc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:00.025282 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82865b83-c7cf-4adc-8883-410fd181afc8 admin admin] PATH_INFO: `/v3/users/b74c3c697f9c46b5ae8e844e9ccfbfd8` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:00.026737 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82865b83-c7cf-4adc-8883-410fd181afc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b74c3c697f9c46b5ae8e844e9ccfbfd8)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:00.028772 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82865b83-c7cf-4adc-8883-410fd181afc8 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:00.234426 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-82865b83-c7cf-4adc-8883-410fd181afc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74c3c697f9c46b5ae8e844e9ccfbfd8'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:00.308346 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-82865b83-c7cf-4adc-8883-410fd181afc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74c3c697f9c46b5ae8e844e9ccfbfd8'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:00.308956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-82865b83-c7cf-4adc-8883-410fd181afc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74c3c697f9c46b5ae8e844e9ccfbfd8'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:00.316567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-82865b83-c7cf-4adc-8883-410fd181afc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74c3c697f9c46b5ae8e844e9ccfbfd8'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:00.328584 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-82865b83-c7cf-4adc-8883-410fd181afc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74c3c697f9c46b5ae8e844e9ccfbfd8'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:00.335075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1375/2717] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:06:59 2022] DELETE /identity/v3/users/b74c3c697f9c46b5ae8e844e9ccfbfd8 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:07:00.339639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fbd03-27e4-4aec-b1aa-f16e10720e5b None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:00.340131 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fbd03-27e4-4aec-b1aa-f16e10720e5b None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:00.340244 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fbd03-27e4-4aec-b1aa-f16e10720e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:00.357534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-e11fbd03-27e4-4aec-b1aa-f16e10720e5b None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:07:00.358719 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e11fbd03-27e4-4aec-b1aa-f16e10720e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:00.417046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1343/2718] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:07:00.426778 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82865b83-c7cf-4adc-8883-410fd181afc8 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:00.428379 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-82865b83-c7cf-4adc-8883-410fd181afc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:00.464276 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:00.491835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82865b83-c7cf-4adc-8883-410fd181afc8 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:00.493927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fbd03-27e4-4aec-b1aa-f16e10720e5b None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:00.495350 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e11fbd03-27e4-4aec-b1aa-f16e10720e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:00.495600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82abce-40a1-4c05-b984-021de9f5019d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:00.496373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82abce-40a1-4c05-b984-021de9f5019d service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:00.496868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82abce-40a1-4c05-b984-021de9f5019d service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:00.497411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82abce-40a1-4c05-b984-021de9f5019d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:00.508031 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fbd03-27e4-4aec-b1aa-f16e10720e5b None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:00.508381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82abce-40a1-4c05-b984-021de9f5019d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:00.509824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82abce-40a1-4c05-b984-021de9f5019d service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:00.513431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dd01e-b1c3-40df-9ee6-f9df29c182f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:00.514290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd01e-b1c3-40df-9ee6-f9df29c182f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:00.514614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd01e-b1c3-40df-9ee6-f9df29c182f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:00.514894 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dd01e-b1c3-40df-9ee6-f9df29c182f2 admin admin] PATH_INFO: `/v3/users/0a09f8c359ef476baf5a9c22ddeba155` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:00.516108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dd01e-b1c3-40df-9ee6-f9df29c182f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a09f8c359ef476baf5a9c22ddeba155)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:00.518745 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dd01e-b1c3-40df-9ee6-f9df29c182f2 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:00.519983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1376/2719] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:07:00.546521 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:00.760461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-528dd01e-b1c3-40df-9ee6-f9df29c182f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a09f8c359ef476baf5a9c22ddeba155'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:00.761125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-528dd01e-b1c3-40df-9ee6-f9df29c182f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a09f8c359ef476baf5a9c22ddeba155'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:00.832337 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-528dd01e-b1c3-40df-9ee6-f9df29c182f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a09f8c359ef476baf5a9c22ddeba155'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:00.845910 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-528dd01e-b1c3-40df-9ee6-f9df29c182f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a09f8c359ef476baf5a9c22ddeba155'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:00.852949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-528dd01e-b1c3-40df-9ee6-f9df29c182f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a09f8c359ef476baf5a9c22ddeba155'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:00.859085 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1344/2720] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:07:00 2022] DELETE /identity/v3/users/0a09f8c359ef476baf5a9c22ddeba155 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:07:00.867826 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babe24d-1cda-499c-adec-f9d6d919ea2c None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:00.868059 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babe24d-1cda-499c-adec-f9d6d919ea2c None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:00.868343 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babe24d-1cda-499c-adec-f9d6d919ea2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:00.885129 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-2babe24d-1cda-499c-adec-f9d6d919ea2c None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:07:00.886318 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2babe24d-1cda-499c-adec-f9d6d919ea2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:00.920306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dd01e-b1c3-40df-9ee6-f9df29c182f2 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:00.921747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-528dd01e-b1c3-40df-9ee6-f9df29c182f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:00.957579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1377/2721] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:07:00.967541 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babe24d-1cda-499c-adec-f9d6d919ea2c None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:00.968968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2babe24d-1cda-499c-adec-f9d6d919ea2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:00.991655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dd01e-b1c3-40df-9ee6-f9df29c182f2 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:00.997090 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379597df-c8d2-4488-8bfa-bf8784b5baee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:00.997972 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379597df-c8d2-4488-8bfa-bf8784b5baee admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:00.998267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379597df-c8d2-4488-8bfa-bf8784b5baee admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:00.998575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379597df-c8d2-4488-8bfa-bf8784b5baee admin admin] PATH_INFO: `/v3/projects/1abb8597bad4438cbc1dc45e1cf86768` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:00.999757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379597df-c8d2-4488-8bfa-bf8784b5baee admin admin] RBAC: Authorizing `identity:delete_project(project_id=1abb8597bad4438cbc1dc45e1cf86768)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:01.001665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379597df-c8d2-4488-8bfa-bf8784b5baee admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:01.028515 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babe24d-1cda-499c-adec-f9d6d919ea2c None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:01.032270 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c3893-fc30-4c08-94e1-be55a13be8c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:01.033510 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c3893-fc30-4c08-94e1-be55a13be8c5 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:01.033798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c3893-fc30-4c08-94e1-be55a13be8c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:01.034102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c3893-fc30-4c08-94e1-be55a13be8c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:01.043287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c3893-fc30-4c08-94e1-be55a13be8c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:01.044727 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c3893-fc30-4c08-94e1-be55a13be8c5 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:01.054352 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1378/2722] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:07:01.115924 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-379597df-c8d2-4488-8bfa-bf8784b5baee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1abb8597bad4438cbc1dc45e1cf86768', 'request_id': 'req-379597df-c8d2-4488-8bfa-bf8784b5baee'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:01.183176 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-379597df-c8d2-4488-8bfa-bf8784b5baee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1abb8597bad4438cbc1dc45e1cf86768', 'request_id': 'req-379597df-c8d2-4488-8bfa-bf8784b5baee'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:01.190457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-379597df-c8d2-4488-8bfa-bf8784b5baee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1abb8597bad4438cbc1dc45e1cf86768', 'request_id': 'req-379597df-c8d2-4488-8bfa-bf8784b5baee'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:01.201181 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-379597df-c8d2-4488-8bfa-bf8784b5baee admin admin] The token cache is being invalidate because project 1abb8597bad4438cbc1dc45e1cf86768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:07:01.201510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-379597df-c8d2-4488-8bfa-bf8784b5baee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:01.202172 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-379597df-c8d2-4488-8bfa-bf8784b5baee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:01.203775 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1345/2723] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:07:00 2022] DELETE /identity/v3/projects/1abb8597bad4438cbc1dc45e1cf86768 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:07:01.213830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee870e64-f12e-4e02-abf4-08fd1a4db16a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:01.213830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee870e64-f12e-4e02-abf4-08fd1a4db16a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:01.213830 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee870e64-f12e-4e02-abf4-08fd1a4db16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:01.229076 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-ee870e64-f12e-4e02-abf4-08fd1a4db16a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:07:01.230298 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ee870e64-f12e-4e02-abf4-08fd1a4db16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:01.294852 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1379/2724] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:07:01.302692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b21f3-6de7-48c8-bf21-47ef9959727f None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:01.302987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b21f3-6de7-48c8-bf21-47ef9959727f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:01.303267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b21f3-6de7-48c8-bf21-47ef9959727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:01.322630 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-606b21f3-6de7-48c8-bf21-47ef9959727f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:07:01.323882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-606b21f3-6de7-48c8-bf21-47ef9959727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:01.334303 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1346/2725] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:07:01.338490 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee870e64-f12e-4e02-abf4-08fd1a4db16a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:01.348441 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee870e64-f12e-4e02-abf4-08fd1a4db16a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:01.353266 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58d95c-7899-4942-a91d-4f84dc0d8136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:01.354018 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58d95c-7899-4942-a91d-4f84dc0d8136 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:01.354405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58d95c-7899-4942-a91d-4f84dc0d8136 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:01.354694 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58d95c-7899-4942-a91d-4f84dc0d8136 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:01.355431 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58d95c-7899-4942-a91d-4f84dc0d8136 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:07:01.355745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58d95c-7899-4942-a91d-4f84dc0d8136 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:01.357470 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58d95c-7899-4942-a91d-4f84dc0d8136 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:01.371848 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1380/2726] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:07:01.376959 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b21f3-6de7-48c8-bf21-47ef9959727f None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:01.386267 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b21f3-6de7-48c8-bf21-47ef9959727f None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:01.390985 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d01095-1dcc-417d-94b5-285215df1373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:01.391631 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d01095-1dcc-417d-94b5-285215df1373 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:01.396909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d01095-1dcc-417d-94b5-285215df1373 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:01.396909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d01095-1dcc-417d-94b5-285215df1373 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:01.396909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d01095-1dcc-417d-94b5-285215df1373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:01.396909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d01095-1dcc-417d-94b5-285215df1373 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:01.457418 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58d95c-7899-4942-a91d-4f84dc0d8136 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:01.459258 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8f58d95c-7899-4942-a91d-4f84dc0d8136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:01.474489 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58d95c-7899-4942-a91d-4f84dc0d8136 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:01.483349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca562f89-7c83-4c26-bc6d-779ccfa66b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:01.484160 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca562f89-7c83-4c26-bc6d-779ccfa66b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:01.484486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca562f89-7c83-4c26-bc6d-779ccfa66b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:01.484765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca562f89-7c83-4c26-bc6d-779ccfa66b4b admin admin] PATH_INFO: `/v3/projects/b44b8690592c4c1c81aa6fb8471cd252` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:01.486497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca562f89-7c83-4c26-bc6d-779ccfa66b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44b8690592c4c1c81aa6fb8471cd252)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:01.488416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca562f89-7c83-4c26-bc6d-779ccfa66b4b admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:01.490150 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=100 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:01.507231 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:01.520398 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1347/2727] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:07:01 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:07:01.521356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d01095-1dcc-417d-94b5-285215df1373 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:01.582147 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d01095-1dcc-417d-94b5-285215df1373 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:01.586949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f18a9-9b1a-48af-a15c-cb74dede3688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:01.587613 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f18a9-9b1a-48af-a15c-cb74dede3688 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:01.587902 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f18a9-9b1a-48af-a15c-cb74dede3688 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:01.588186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f18a9-9b1a-48af-a15c-cb74dede3688 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:01.588888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f18a9-9b1a-48af-a15c-cb74dede3688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:01.590895 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f18a9-9b1a-48af-a15c-cb74dede3688 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:01.618211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ca562f89-7c83-4c26-bc6d-779ccfa66b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44b8690592c4c1c81aa6fb8471cd252', 'request_id': 'req-ca562f89-7c83-4c26-bc6d-779ccfa66b4b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:01.624999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ca562f89-7c83-4c26-bc6d-779ccfa66b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44b8690592c4c1c81aa6fb8471cd252', 'request_id': 'req-ca562f89-7c83-4c26-bc6d-779ccfa66b4b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:01.630519 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ca562f89-7c83-4c26-bc6d-779ccfa66b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44b8690592c4c1c81aa6fb8471cd252', 'request_id': 'req-ca562f89-7c83-4c26-bc6d-779ccfa66b4b'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:01.680740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1348/2728] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:07:01 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:07:01.684771 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f18a9-9b1a-48af-a15c-cb74dede3688 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:01.694226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f18a9-9b1a-48af-a15c-cb74dede3688 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:01.702858 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ca562f89-7c83-4c26-bc6d-779ccfa66b4b admin admin] The token cache is being invalidate because project b44b8690592c4c1c81aa6fb8471cd252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:07:01.703157 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ca562f89-7c83-4c26-bc6d-779ccfa66b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:01.703812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ca562f89-7c83-4c26-bc6d-779ccfa66b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:01.705948 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1381/2729] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:07:01 2022] DELETE /identity/v3/projects/b44b8690592c4c1c81aa6fb8471cd252 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:07:01.710798 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602e3d8-f295-4994-9f79-0c38662f0663 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:01.711091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602e3d8-f295-4994-9f79-0c38662f0663 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:01.711373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602e3d8-f295-4994-9f79-0c38662f0663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:01.729342 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a602e3d8-f295-4994-9f79-0c38662f0663 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:07:01.730711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a602e3d8-f295-4994-9f79-0c38662f0663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:01.752058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cb5fa-5f19-4d80-9ff7-f5a3fe0b1c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:01.752740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cb5fa-5f19-4d80-9ff7-f5a3fe0b1c5f admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:01.753044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cb5fa-5f19-4d80-9ff7-f5a3fe0b1c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:01.753319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cb5fa-5f19-4d80-9ff7-f5a3fe0b1c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:01.754049 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cb5fa-5f19-4d80-9ff7-f5a3fe0b1c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:01.755708 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cb5fa-5f19-4d80-9ff7-f5a3fe0b1c5f admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:01.765535 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1349/2730] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:07:01.769874 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cb5fa-5f19-4d80-9ff7-f5a3fe0b1c5f admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:01.771551 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-462cb5fa-5f19-4d80-9ff7-f5a3fe0b1c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:01.784695 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cb5fa-5f19-4d80-9ff7-f5a3fe0b1c5f admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:01.789335 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efab488-0628-415e-bea5-732342d30407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:01.790009 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efab488-0628-415e-bea5-732342d30407 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:01.790300 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efab488-0628-415e-bea5-732342d30407 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:01.790619 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efab488-0628-415e-bea5-732342d30407 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:01.791338 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efab488-0628-415e-bea5-732342d30407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:01.792989 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efab488-0628-415e-bea5-732342d30407 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:01.793226 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1382/2731] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:07:01.801139 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1901535-6995-4f88-ae78-a6f41de3348d None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:01.801435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1901535-6995-4f88-ae78-a6f41de3348d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:01.801722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1901535-6995-4f88-ae78-a6f41de3348d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:01.806158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1350/2732] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:07:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:07:01.807226 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efab488-0628-415e-bea5-732342d30407 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:01.817128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efab488-0628-415e-bea5-732342d30407 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:01.819717 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-a1901535-6995-4f88-ae78-a6f41de3348d None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:07:01.820947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-a1901535-6995-4f88-ae78-a6f41de3348d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:01.821869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1861183-e333-413c-864d-1b428a0ca799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:01.822803 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1861183-e333-413c-864d-1b428a0ca799 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:01.823096 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1861183-e333-413c-864d-1b428a0ca799 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:01.823381 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1861183-e333-413c-864d-1b428a0ca799 admin admin] PATH_INFO: `/v3/projects/1280e7dafe2c4032b4d3e08752127ce1/users/3918088bb1de400eafd0e1c44200d4ba/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:01.829039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1383/2733] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:07:01.833719 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1901535-6995-4f88-ae78-a6f41de3348d None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:01.839170 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1861183-e333-413c-864d-1b428a0ca799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1280e7dafe2c4032b4d3e08752127ce1, user_id=3918088bb1de400eafd0e1c44200d4ba, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:01.841830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1861183-e333-413c-864d-1b428a0ca799 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:01.842560 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1901535-6995-4f88-ae78-a6f41de3348d None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:01.847817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395b4be-98c4-4ab7-96da-68a498dd1830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:01.848463 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395b4be-98c4-4ab7-96da-68a498dd1830 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:01.848760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395b4be-98c4-4ab7-96da-68a498dd1830 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:01.849038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395b4be-98c4-4ab7-96da-68a498dd1830 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:01.849762 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395b4be-98c4-4ab7-96da-68a498dd1830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:07:01.850074 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395b4be-98c4-4ab7-96da-68a498dd1830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:01.851704 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4395b4be-98c4-4ab7-96da-68a498dd1830 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:01.863382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1384/2734] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 20:07:01.867527 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395b4be-98c4-4ab7-96da-68a498dd1830 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:01.877427 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4395b4be-98c4-4ab7-96da-68a498dd1830 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:01.881933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f40fc3-fe55-463e-891e-db19a53f5a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:01.882569 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f40fc3-fe55-463e-891e-db19a53f5a63 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:01.882857 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f40fc3-fe55-463e-891e-db19a53f5a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:01.883140 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f40fc3-fe55-463e-891e-db19a53f5a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:01.883854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f40fc3-fe55-463e-891e-db19a53f5a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:01.885696 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f40fc3-fe55-463e-891e-db19a53f5a63 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:01.920729 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1351/2735] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:07:01 2022] PUT /identity/v3/projects/1280e7dafe2c4032b4d3e08752127ce1/users/3918088bb1de400eafd0e1c44200d4ba/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:07:01.925577 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22782c-f4d4-41af-b169-fd1590f4408a None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:01.925881 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22782c-f4d4-41af-b169-fd1590f4408a None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:01.926167 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22782c-f4d4-41af-b169-fd1590f4408a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:01.943456 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-9f22782c-f4d4-41af-b169-fd1590f4408a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:07:01.944593 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9f22782c-f4d4-41af-b169-fd1590f4408a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:01.978734 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1385/2736] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:07:01 2022] POST /identity/v3/projects => generated 397 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:07:01.983015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f40fc3-fe55-463e-891e-db19a53f5a63 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:01.989068 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:02.006722 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1352/2737] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:07:02.016620 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22782c-f4d4-41af-b169-fd1590f4408a None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:02.018659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9f22782c-f4d4-41af-b169-fd1590f4408a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:02.034677 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:02.049744 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f40fc3-fe55-463e-891e-db19a53f5a63 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:02.054668 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb76345-e099-456d-b069-bb99ff65a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:02.055368 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb76345-e099-456d-b069-bb99ff65a871 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:02.055652 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb76345-e099-456d-b069-bb99ff65a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:02.055933 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb76345-e099-456d-b069-bb99ff65a871 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:02.056674 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb76345-e099-456d-b069-bb99ff65a871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:02.058692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb76345-e099-456d-b069-bb99ff65a871 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:02.075924 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22782c-f4d4-41af-b169-fd1590f4408a None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:02.123207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f43b2-afb6-4257-907a-ee345e6df9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:02.123860 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f43b2-afb6-4257-907a-ee345e6df9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:02.124152 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f43b2-afb6-4257-907a-ee345e6df9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:02.124433 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f43b2-afb6-4257-907a-ee345e6df9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:02.135001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f43b2-afb6-4257-907a-ee345e6df9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:02.136491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f43b2-afb6-4257-907a-ee345e6df9e0 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:02.146572 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1353/2738] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:07:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:07:02.159705 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1386/2739] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:07:01 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:07:02.159843 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f43b2-afb6-4257-907a-ee345e6df9e0 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:02.169282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f43b2-afb6-4257-907a-ee345e6df9e0 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:02.174026 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adf281-f2b8-4c6c-992a-3f85a758bb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:02.174714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adf281-f2b8-4c6c-992a-3f85a758bb98 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:02.175002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adf281-f2b8-4c6c-992a-3f85a758bb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:02.175279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6adf281-f2b8-4c6c-992a-3f85a758bb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:02.176036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adf281-f2b8-4c6c-992a-3f85a758bb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:02.177651 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6adf281-f2b8-4c6c-992a-3f85a758bb98 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:02.187524 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1354/2740] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:07:02.192149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb76345-e099-456d-b069-bb99ff65a871 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:02.205615 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb76345-e099-456d-b069-bb99ff65a871 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:02.207435 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1812d-5743-43b5-8501-d0981c99bc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:02.208089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1812d-5743-43b5-8501-d0981c99bc10 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:02.208382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1812d-5743-43b5-8501-d0981c99bc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:02.208666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1812d-5743-43b5-8501-d0981c99bc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:02.209434 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1812d-5743-43b5-8501-d0981c99bc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:02.211176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1812d-5743-43b5-8501-d0981c99bc10 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:02.224306 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1387/2741] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:07:02.225471 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adf281-f2b8-4c6c-992a-3f85a758bb98 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:02.236383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6adf281-f2b8-4c6c-992a-3f85a758bb98 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:02.241052 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e712-1ab7-4343-85fc-f49c3892cb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:02.241936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e712-1ab7-4343-85fc-f49c3892cb73 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:02.242259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e712-1ab7-4343-85fc-f49c3892cb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:02.242569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456e712-1ab7-4343-85fc-f49c3892cb73 admin admin] PATH_INFO: `/v3/projects/c3da4ec5602847df92704bd5dfc45223/users/ed6abb6bb9d640fdb1284e2a7bc41218/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:02.258839 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456e712-1ab7-4343-85fc-f49c3892cb73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3da4ec5602847df92704bd5dfc45223, user_id=ed6abb6bb9d640fdb1284e2a7bc41218, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:02.261817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456e712-1ab7-4343-85fc-f49c3892cb73 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:02.347367 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1355/2742] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:07:02 2022] PUT /identity/v3/projects/c3da4ec5602847df92704bd5dfc45223/users/ed6abb6bb9d640fdb1284e2a7bc41218/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:07:02.358252 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11019a-c122-4b97-9a82-9865253d6096 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:02.358580 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11019a-c122-4b97-9a82-9865253d6096 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:02.358869 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11019a-c122-4b97-9a82-9865253d6096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:02.387268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-cc11019a-c122-4b97-9a82-9865253d6096 None None] MFA Rules not processed for user `ed6abb6bb9d640fdb1284e2a7bc41218`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:07:02.388089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-cc11019a-c122-4b97-9a82-9865253d6096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:02.460712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1388/2743] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:07:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:07:02.473283 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e712-1ab7-4343-85fc-f49c3892cb73 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:02.474793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-0456e712-1ab7-4343-85fc-f49c3892cb73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:02.533668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456e712-1ab7-4343-85fc-f49c3892cb73 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:02.537431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b17b9-f532-43d4-a04c-6b124979f3f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:02.538077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b17b9-f532-43d4-a04c-6b124979f3f2 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:02.538450 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b17b9-f532-43d4-a04c-6b124979f3f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:02.538741 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b17b9-f532-43d4-a04c-6b124979f3f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:02.547321 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b17b9-f532-43d4-a04c-6b124979f3f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:02.549281 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b17b9-f532-43d4-a04c-6b124979f3f2 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:02.559208 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1356/2744] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:07:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:07:07.854515 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3178555-994a-4016-8f37-705887ebcc2b None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:07.855071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3178555-994a-4016-8f37-705887ebcc2b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:07.855208 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3178555-994a-4016-8f37-705887ebcc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:07.882721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c3178555-994a-4016-8f37-705887ebcc2b None None] MFA Rules not processed for user `3918088bb1de400eafd0e1c44200d4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:07:07.884057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c3178555-994a-4016-8f37-705887ebcc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:07.949381 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1389/2745] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:07:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:07:07.953705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b17b9-f532-43d4-a04c-6b124979f3f2 service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:07.971765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:08.016634 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b17b9-f532-43d4-a04c-6b124979f3f2 service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:08.021858 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86471f-9fdb-41d6-a6ce-b5744de81d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:08.022568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86471f-9fdb-41d6-a6ce-b5744de81d6d admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:08.022845 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86471f-9fdb-41d6-a6ce-b5744de81d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:08.023129 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86471f-9fdb-41d6-a6ce-b5744de81d6d admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:08.023830 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86471f-9fdb-41d6-a6ce-b5744de81d6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:08.025747 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86471f-9fdb-41d6-a6ce-b5744de81d6d admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:08.111971 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1357/2746] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:07:07 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:07:08.115700 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3178555-994a-4016-8f37-705887ebcc2b None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:08.130107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3178555-994a-4016-8f37-705887ebcc2b None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:08.176619 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:08.189966 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77115ac-a952-4814-b2c7-410004249ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:08.190855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77115ac-a952-4814-b2c7-410004249ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:08.191142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77115ac-a952-4814-b2c7-410004249ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:08.191420 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77115ac-a952-4814-b2c7-410004249ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:08.192140 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77115ac-a952-4814-b2c7-410004249ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:08.196508 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77115ac-a952-4814-b2c7-410004249ed2 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:08.367496 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1390/2747] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:07:08 2022] POST /identity/v3/users => generated 292 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:07:08.371470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86471f-9fdb-41d6-a6ce-b5744de81d6d admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:08.382111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86471f-9fdb-41d6-a6ce-b5744de81d6d admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:08.387637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1918f-7feb-468d-a592-98d3fa824e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:08.388319 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1918f-7feb-468d-a592-98d3fa824e87 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:08.388621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1918f-7feb-468d-a592-98d3fa824e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:08.388934 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1918f-7feb-468d-a592-98d3fa824e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:08.389617 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1918f-7feb-468d-a592-98d3fa824e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:08.391309 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1918f-7feb-468d-a592-98d3fa824e87 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:08.404962 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1358/2748] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:07:08.410062 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77115ac-a952-4814-b2c7-410004249ed2 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:08.420612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77115ac-a952-4814-b2c7-410004249ed2 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:08.425393 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6eb04a-2556-4a79-8448-5c16c7410860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:08.429548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6eb04a-2556-4a79-8448-5c16c7410860 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:08.429548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6eb04a-2556-4a79-8448-5c16c7410860 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:08.429548 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6eb04a-2556-4a79-8448-5c16c7410860 admin admin] PATH_INFO: `/v3/projects/7f2a0d2231674d9cb6c634787b61f659/users/30e32540eb6d45ebb54b8f835f9ef944/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:08.441814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6eb04a-2556-4a79-8448-5c16c7410860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2a0d2231674d9cb6c634787b61f659, user_id=30e32540eb6d45ebb54b8f835f9ef944, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:08.444530 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6eb04a-2556-4a79-8448-5c16c7410860 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:08.542671 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1391/2749] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:07:08 2022] PUT /identity/v3/projects/7f2a0d2231674d9cb6c634787b61f659/users/30e32540eb6d45ebb54b8f835f9ef944/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:07:08.546822 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1918f-7feb-468d-a592-98d3fa824e87 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:08.557933 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1918f-7feb-468d-a592-98d3fa824e87 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:08.615001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88b0e9-7ff6-4b00-8778-79c2a06384a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:08.615700 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88b0e9-7ff6-4b00-8778-79c2a06384a8 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:08.615984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88b0e9-7ff6-4b00-8778-79c2a06384a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:08.616261 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff88b0e9-7ff6-4b00-8778-79c2a06384a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:08.616980 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88b0e9-7ff6-4b00-8778-79c2a06384a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:08.618660 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff88b0e9-7ff6-4b00-8778-79c2a06384a8 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:08.629086 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1359/2750] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:07:08.633319 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6eb04a-2556-4a79-8448-5c16c7410860 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:08.644538 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6eb04a-2556-4a79-8448-5c16c7410860 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:08.649291 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd70a1-f210-4a9f-8b41-9e9783cb15d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:08.650288 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd70a1-f210-4a9f-8b41-9e9783cb15d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:08.650684 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd70a1-f210-4a9f-8b41-9e9783cb15d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:08.650969 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd70a1-f210-4a9f-8b41-9e9783cb15d6 admin admin] PATH_INFO: `/v3/projects/7f2a0d2231674d9cb6c634787b61f659/users/30e32540eb6d45ebb54b8f835f9ef944/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:08.653345 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd70a1-f210-4a9f-8b41-9e9783cb15d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2a0d2231674d9cb6c634787b61f659, user_id=30e32540eb6d45ebb54b8f835f9ef944, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:08.656358 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd70a1-f210-4a9f-8b41-9e9783cb15d6 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:08.668826 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1392/2751] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:07:08 2022] PUT /identity/v3/projects/7f2a0d2231674d9cb6c634787b61f659/users/30e32540eb6d45ebb54b8f835f9ef944/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:07:08.691647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88b0e9-7ff6-4b00-8778-79c2a06384a8 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:08.701952 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff88b0e9-7ff6-4b00-8778-79c2a06384a8 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:08.758759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec12f4-8501-4970-8327-574c0b4bec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:08.759647 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec12f4-8501-4970-8327-574c0b4bec90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:08.759941 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec12f4-8501-4970-8327-574c0b4bec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:08.760227 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec12f4-8501-4970-8327-574c0b4bec90 admin admin] PATH_INFO: `/v3/users/ed6abb6bb9d640fdb1284e2a7bc41218` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:08.761446 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec12f4-8501-4970-8327-574c0b4bec90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6abb6bb9d640fdb1284e2a7bc41218)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:08.763399 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec12f4-8501-4970-8327-574c0b4bec90 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:08.882910 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:08.994910 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-4cec12f4-8501-4970-8327-574c0b4bec90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6abb6bb9d640fdb1284e2a7bc41218'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:08.995927 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-4cec12f4-8501-4970-8327-574c0b4bec90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6abb6bb9d640fdb1284e2a7bc41218'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:09.066989 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-4cec12f4-8501-4970-8327-574c0b4bec90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6abb6bb9d640fdb1284e2a7bc41218'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:09.081270 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-4cec12f4-8501-4970-8327-574c0b4bec90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6abb6bb9d640fdb1284e2a7bc41218'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:09.088259 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-4cec12f4-8501-4970-8327-574c0b4bec90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6abb6bb9d640fdb1284e2a7bc41218'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:09.094429 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1360/2752] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:07:08 2022] DELETE /identity/v3/users/ed6abb6bb9d640fdb1284e2a7bc41218 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:07:09.099602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d4e88-768c-4c25-bf4c-7444a6b38c40 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:09.100076 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d4e88-768c-4c25-bf4c-7444a6b38c40 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:09.100194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d4e88-768c-4c25-bf4c-7444a6b38c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:09.117771 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-5c4d4e88-768c-4c25-bf4c-7444a6b38c40 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:07:09.119081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5c4d4e88-768c-4c25-bf4c-7444a6b38c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:09.187243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1393/2753] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:07:09.194636 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec12f4-8501-4970-8327-574c0b4bec90 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:09.196068 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4cec12f4-8501-4970-8327-574c0b4bec90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:09.259091 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec12f4-8501-4970-8327-574c0b4bec90 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:09.262908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4739ef4-ffa6-4443-a67b-58c09dae2e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:09.263637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4739ef4-ffa6-4443-a67b-58c09dae2e8a service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:09.263996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4739ef4-ffa6-4443-a67b-58c09dae2e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:09.264344 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4739ef4-ffa6-4443-a67b-58c09dae2e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:09.274328 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4739ef4-ffa6-4443-a67b-58c09dae2e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:09.275784 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4739ef4-ffa6-4443-a67b-58c09dae2e8a service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:09.291702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1361/2754] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:07:09.753106 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d4e88-768c-4c25-bf4c-7444a6b38c40 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:09.754619 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-5c4d4e88-768c-4c25-bf4c-7444a6b38c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:09.775654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d4e88-768c-4c25-bf4c-7444a6b38c40 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:09.781785 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:09.782833 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:09.783222 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:09.783612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301 admin admin] PATH_INFO: `/v3/projects/c3da4ec5602847df92704bd5dfc45223` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:09.785014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3da4ec5602847df92704bd5dfc45223)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:09.787234 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:09.945911 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3da4ec5602847df92704bd5dfc45223', 'request_id': 'req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:09.955596 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3da4ec5602847df92704bd5dfc45223', 'request_id': 'req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:09.962149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3da4ec5602847df92704bd5dfc45223', 'request_id': 'req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:10.121043 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301 admin admin] The token cache is being invalidate because project c3da4ec5602847df92704bd5dfc45223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:07:10.121043 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:10.121043 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:07:10.121043 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1394/2755] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:07:09 2022] DELETE /identity/v3/projects/c3da4ec5602847df92704bd5dfc45223 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:07:14.526199 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de55d1-e36e-4ffe-a958-8c4b68dc98a6 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:14.528067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de55d1-e36e-4ffe-a958-8c4b68dc98a6 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:14.528532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de55d1-e36e-4ffe-a958-8c4b68dc98a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:14.558220 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-f2de55d1-e36e-4ffe-a958-8c4b68dc98a6 None None] MFA Rules not processed for user `30e32540eb6d45ebb54b8f835f9ef944`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:07:14.559561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f2de55d1-e36e-4ffe-a958-8c4b68dc98a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:14.637144 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1362/2756] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:07:14 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:07:14.653626 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:14.654654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:14.683614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:14.732108 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8caf7-a7a8-4b4c-8c9b-4ca393f38301 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:14.738957 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c1daf-a939-4169-9ee0-4bf49cc4e34e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:14.739961 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c1daf-a939-4169-9ee0-4bf49cc4e34e service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:14.740192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c1daf-a939-4169-9ee0-4bf49cc4e34e service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:14.740556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c1daf-a939-4169-9ee0-4bf49cc4e34e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:14.742424 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-212c1daf-a939-4169-9ee0-4bf49cc4e34e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:14.804968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c1daf-a939-4169-9ee0-4bf49cc4e34e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:14.806728 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c1daf-a939-4169-9ee0-4bf49cc4e34e service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:14.817008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1395/2757] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:07:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:07:17.522370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7623d3-ac00-4fa7-b589-62f6f70d6ea3 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:17.525721 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7623d3-ac00-4fa7-b589-62f6f70d6ea3 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:17.525721 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7623d3-ac00-4fa7-b589-62f6f70d6ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:17.542192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-4b7623d3-ac00-4fa7-b589-62f6f70d6ea3 None None] MFA Rules not processed for user `3918088bb1de400eafd0e1c44200d4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:07:17.543512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4b7623d3-ac00-4fa7-b589-62f6f70d6ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:17.551514 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1363/2758] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:07:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:07:24.929855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=46 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:27.536219 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=82,keystone:DELETE=5,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:30.339498 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f659e-c53d-46c7-a6a7-b0c0e61771d1 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:30.342902 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f659e-c53d-46c7-a6a7-b0c0e61771d1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:30.342902 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f659e-c53d-46c7-a6a7-b0c0e61771d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:30.357695 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-910f659e-c53d-46c7-a6a7-b0c0e61771d1 None None] MFA Rules not processed for user `f120b0139dfe4f36a8ae97060a1c26e3`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:07:30.358929 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-910f659e-c53d-46c7-a6a7-b0c0e61771d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:30.413579 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1396/2759] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:07:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:07:40.406524 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=25 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:07:45.028489 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7623d3-ac00-4fa7-b589-62f6f70d6ea3 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:45.029985 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4b7623d3-ac00-4fa7-b589-62f6f70d6ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:45.088296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7623d3-ac00-4fa7-b589-62f6f70d6ea3 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:45.091960 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921e8d9-9e8c-4801-a36e-60ec29def566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:45.092615 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921e8d9-9e8c-4801-a36e-60ec29def566 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:45.092896 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921e8d9-9e8c-4801-a36e-60ec29def566 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:45.093183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921e8d9-9e8c-4801-a36e-60ec29def566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:45.104047 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921e8d9-9e8c-4801-a36e-60ec29def566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:45.108401 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921e8d9-9e8c-4801-a36e-60ec29def566 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:45.115225 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1364/2760] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:07:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:07:51.762391 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f659e-c53d-46c7-a6a7-b0c0e61771d1 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:07:51.763802 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-910f659e-c53d-46c7-a6a7-b0c0e61771d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:51.838654 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f659e-c53d-46c7-a6a7-b0c0e61771d1 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:07:51.843607 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1c681-234a-482f-914c-195fb70c0c43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394b43cef91f4990b4707cb7a6798068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:07:51.851294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1c681-234a-482f-914c-195fb70c0c43 service placement] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:07:51.851294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1c681-234a-482f-914c-195fb70c0c43 service placement] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:07:51.851294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1c681-234a-482f-914c-195fb70c0c43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:07:51.851294 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-99a1c681-234a-482f-914c-195fb70c0c43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:07:51.857968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1c681-234a-482f-914c-195fb70c0c43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:07:51.859575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1c681-234a-482f-914c-195fb70c0c43 service placement] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:07:51.869912 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1397/2761] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:07:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:07:55.110984 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=26 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:08:01.865756 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=32 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:08:40.768002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41af21-183d-442f-b067-6aa17a0ad696 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:08:40.768509 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41af21-183d-442f-b067-6aa17a0ad696 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:08:40.768614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41af21-183d-442f-b067-6aa17a0ad696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:08:40.787512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-bb41af21-183d-442f-b067-6aa17a0ad696 None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:08:40.788698 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-bb41af21-183d-442f-b067-6aa17a0ad696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:08:40.843661 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1365/2762] 10.222.0.15 () {58 vars in 1009 bytes} [Fri May 27 20:08:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:08:40.972863 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1c681-234a-482f-914c-195fb70c0c43 service placement] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:08:40.974267 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-99a1c681-234a-482f-914c-195fb70c0c43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:08:41.042484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1c681-234a-482f-914c-195fb70c0c43 service placement] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:08:41.047449 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791c73f-f0dd-4111-a135-8e80573d3ac5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:08:41.048097 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791c73f-f0dd-4111-a135-8e80573d3ac5 service swift] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:08:41.048386 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791c73f-f0dd-4111-a135-8e80573d3ac5 service swift] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:08:41.048667 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791c73f-f0dd-4111-a135-8e80573d3ac5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:08:41.056530 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791c73f-f0dd-4111-a135-8e80573d3ac5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:08:41.058113 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791c73f-f0dd-4111-a135-8e80573d3ac5 service swift] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:08:41.066546 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1398/2763] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:08:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 20:08:50.837013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=25 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:08:51.062822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=32 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:08:56.808576 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171ff88-df34-45a3-a383-217e2a7a0133 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:08:56.809108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171ff88-df34-45a3-a383-217e2a7a0133 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:08:56.809230 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e171ff88-df34-45a3-a383-217e2a7a0133 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:08:56.810852 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1366/2764] 10.222.0.15 () {54 vars in 921 bytes} [Fri May 27 20:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 20:08:56.817426 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd960e1-2515-46fa-bf0e-f891d107d45d None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:08:56.817889 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd960e1-2515-46fa-bf0e-f891d107d45d None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:08:56.818182 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd960e1-2515-46fa-bf0e-f891d107d45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:08:56.837499 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-2fd960e1-2515-46fa-bf0e-f891d107d45d None None] MFA Rules not processed for user `105353b6b1a941ac81df7ad35567ba7c`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:08:56.838833 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-2fd960e1-2515-46fa-bf0e-f891d107d45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:08:56.853623 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1399/2765] 10.222.0.15 () {58 vars in 1018 bytes} [Fri May 27 20:08:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:08:56.865106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171ff88-df34-45a3-a383-217e2a7a0133 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:08:56.866810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e171ff88-df34-45a3-a383-217e2a7a0133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:08:56.926032 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e171ff88-df34-45a3-a383-217e2a7a0133 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:08:56.929671 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d849b4f-36df-4590-810e-395def2cb618 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc2b57ae83164912a4e23dda9dc239f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:08:56.930305 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d849b4f-36df-4590-810e-395def2cb618 service glance] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:08:56.930632 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d849b4f-36df-4590-810e-395def2cb618 service glance] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:08:56.930912 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d849b4f-36df-4590-810e-395def2cb618 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:08:56.941314 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d849b4f-36df-4590-810e-395def2cb618 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:08:56.942790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d849b4f-36df-4590-810e-395def2cb618 service glance] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:08:56.953643 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1367/2766] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:08:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:08:57.131101 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf3211-5b5b-4fed-a3c0-27da831dbba1 None None] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:08:57.131397 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf3211-5b5b-4fed-a3c0-27da831dbba1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:08:57.131683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf3211-5b5b-4fed-a3c0-27da831dbba1 None None] PATH_INFO: `/` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:08:57.133084 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1400/2767] 10.222.0.15 () {54 vars in 921 bytes} [Fri May 27 20:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 20:08:57.137872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f1710-8629-4db4-bd5f-b96e6fb3b0c1 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:08:57.138169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f1710-8629-4db4-bd5f-b96e6fb3b0c1 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:08:57.138487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f1710-8629-4db4-bd5f-b96e6fb3b0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:08:57.160545 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-cd1f1710-8629-4db4-bd5f-b96e6fb3b0c1 None None] MFA Rules not processed for user `af7e51b89f4c4dcc9963061e6e509eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:08:57.161800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-cd1f1710-8629-4db4-bd5f-b96e6fb3b0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:08:57.168368 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1368/2768] 10.222.0.15 () {58 vars in 1018 bytes} [Fri May 27 20:08:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:08:57.179824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf3211-5b5b-4fed-a3c0-27da831dbba1 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:08:57.190737 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf3211-5b5b-4fed-a3c0-27da831dbba1 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:08:57.194509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7fe08-2260-42a8-8af6-23becd1df288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:08:57.196014 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7fe08-2260-42a8-8af6-23becd1df288 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:08:57.196307 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7fe08-2260-42a8-8af6-23becd1df288 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:08:57.196590 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7fe08-2260-42a8-8af6-23becd1df288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:08:57.203721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7fe08-2260-42a8-8af6-23becd1df288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:08:57.205642 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7fe08-2260-42a8-8af6-23becd1df288 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:08:57.213194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1401/2769] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:08:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:08:57.299313 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34b223-aaf3-42a7-827d-0e5d296f9f25 None None] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:08:57.299613 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34b223-aaf3-42a7-827d-0e5d296f9f25 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:08:57.299929 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34b223-aaf3-42a7-827d-0e5d296f9f25 None None] PATH_INFO: `/` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:08:57.301344 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1369/2770] 10.222.0.15 () {54 vars in 921 bytes} [Fri May 27 20:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 20:08:57.306593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79879c-8e64-4a1f-893c-ebd53856d3ba None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:08:57.306912 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79879c-8e64-4a1f-893c-ebd53856d3ba None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:08:57.307193 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79879c-8e64-4a1f-893c-ebd53856d3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:08:57.325672 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-fa79879c-8e64-4a1f-893c-ebd53856d3ba None None] MFA Rules not processed for user `105353b6b1a941ac81df7ad35567ba7c`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:08:57.326885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-fa79879c-8e64-4a1f-893c-ebd53856d3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:08:57.336500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1402/2771] 10.222.0.15 () {58 vars in 1018 bytes} [Fri May 27 20:08:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:08:57.347368 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34b223-aaf3-42a7-827d-0e5d296f9f25 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:08:57.358282 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34b223-aaf3-42a7-827d-0e5d296f9f25 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:08:57.362420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e293f-6b5d-4cd6-9842-11b6bd80c4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:08:57.363057 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e293f-6b5d-4cd6-9842-11b6bd80c4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:08:57.363349 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e293f-6b5d-4cd6-9842-11b6bd80c4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:08:57.363632 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e293f-6b5d-4cd6-9842-11b6bd80c4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:08:57.373560 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e293f-6b5d-4cd6-9842-11b6bd80c4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:08:57.375035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e293f-6b5d-4cd6-9842-11b6bd80c4c4 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:08:57.385694 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1370/2772] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:08:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:08:59.526089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855268b-806d-4135-ad9a-313c9fffd342 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:08:59.526587 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855268b-806d-4135-ad9a-313c9fffd342 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:08:59.526711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855268b-806d-4135-ad9a-313c9fffd342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:08:59.544497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-c855268b-806d-4135-ad9a-313c9fffd342 None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:08:59.545687 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-c855268b-806d-4135-ad9a-313c9fffd342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:08:59.553360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1403/2773] 10.222.0.15 () {58 vars in 1009 bytes} [Fri May 27 20:08:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:08:59.565497 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e293f-6b5d-4cd6-9842-11b6bd80c4c4 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:08:59.576568 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e293f-6b5d-4cd6-9842-11b6bd80c4c4 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:08:59.581491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a33db-f6ab-4665-9abd-ca478bf3587a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:08:59.582118 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a33db-f6ab-4665-9abd-ca478bf3587a service swift] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:08:59.582482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a33db-f6ab-4665-9abd-ca478bf3587a service swift] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:08:59.582764 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a33db-f6ab-4665-9abd-ca478bf3587a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:08:59.590659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a33db-f6ab-4665-9abd-ca478bf3587a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:08:59.592192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a33db-f6ab-4665-9abd-ca478bf3587a service swift] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:08:59.600542 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1371/2774] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:08:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 20:09:09.539259 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=15 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:09:09.597340 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=41 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:09:14.256951 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b17376-53ea-4c53-94cb-7cdea25d9f3e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:14.257426 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b17376-53ea-4c53-94cb-7cdea25d9f3e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:14.257572 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b17376-53ea-4c53-94cb-7cdea25d9f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:14.281425 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-f8b17376-53ea-4c53-94cb-7cdea25d9f3e None None] MFA Rules not processed for user `bffc7facb4ce4ab9967b0c8d88d0433b`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:09:14.282645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f8b17376-53ea-4c53-94cb-7cdea25d9f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:09:14.289773 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1404/2775] 10.222.0.15 () {58 vars in 967 bytes} [Fri May 27 20:09:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:09:14.302159 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a33db-f6ab-4665-9abd-ca478bf3587a service swift] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:14.312880 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a33db-f6ab-4665-9abd-ca478bf3587a service swift] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:14.318536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa836d4d-6874-4fcf-8848-581f0203ae20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '799058a415e44194a50697841b410062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:14.319234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa836d4d-6874-4fcf-8848-581f0203ae20 service swift] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:14.319523 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa836d4d-6874-4fcf-8848-581f0203ae20 service swift] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:14.319804 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa836d4d-6874-4fcf-8848-581f0203ae20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:14.327859 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa836d4d-6874-4fcf-8848-581f0203ae20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:14.329469 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa836d4d-6874-4fcf-8848-581f0203ae20 service swift] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:14.337940 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1372/2776] 10.222.0.15 () {60 vars in 1384 bytes} [Fri May 27 20:09:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 20:09:24.275895 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:09:24.334510 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=6 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:09:46.923983 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b17376-53ea-4c53-94cb-7cdea25d9f3e None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:46.926002 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f8b17376-53ea-4c53-94cb-7cdea25d9f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:09:46.937112 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b17376-53ea-4c53-94cb-7cdea25d9f3e None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:46.940661 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711319c-06a7-4680-93b9-0016e20ac3e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:46.941312 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711319c-06a7-4680-93b9-0016e20ac3e1 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:46.941597 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711319c-06a7-4680-93b9-0016e20ac3e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:46.941874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711319c-06a7-4680-93b9-0016e20ac3e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:46.943582 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8711319c-06a7-4680-93b9-0016e20ac3e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:09:46.956549 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711319c-06a7-4680-93b9-0016e20ac3e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:46.958068 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711319c-06a7-4680-93b9-0016e20ac3e1 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:46.968835 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1405/2777] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:09:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:09:49.305394 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa836d4d-6874-4fcf-8848-581f0203ae20 service swift] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:49.315664 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa836d4d-6874-4fcf-8848-581f0203ae20 service swift] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:49.319358 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366275a-7cf2-4161-a829-41c4453070e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:49.320017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366275a-7cf2-4161-a829-41c4453070e5 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:49.320309 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366275a-7cf2-4161-a829-41c4453070e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:49.320592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366275a-7cf2-4161-a829-41c4453070e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:49.322442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b366275a-7cf2-4161-a829-41c4453070e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:09:49.336416 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366275a-7cf2-4161-a829-41c4453070e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:49.337870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366275a-7cf2-4161-a829-41c4453070e5 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:49.350357 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1373/2778] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:09:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:09:49.913705 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711319c-06a7-4680-93b9-0016e20ac3e1 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:49.924968 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711319c-06a7-4680-93b9-0016e20ac3e1 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:49.931084 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b3622-2128-40a0-bd2e-3267a7cbbbbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:49.931721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b3622-2128-40a0-bd2e-3267a7cbbbbd service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:49.932011 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b3622-2128-40a0-bd2e-3267a7cbbbbd service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:49.932293 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b3622-2128-40a0-bd2e-3267a7cbbbbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:49.934044 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e61b3622-2128-40a0-bd2e-3267a7cbbbbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:09:49.944194 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b3622-2128-40a0-bd2e-3267a7cbbbbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:49.945771 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b3622-2128-40a0-bd2e-3267a7cbbbbd service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:49.954631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1406/2779] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:09:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:09:53.677416 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366275a-7cf2-4161-a829-41c4453070e5 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:53.686435 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366275a-7cf2-4161-a829-41c4453070e5 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:53.689988 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b70c0e-e720-4d69-99d2-782a124e48cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:53.691175 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b70c0e-e720-4d69-99d2-782a124e48cb service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:53.696246 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b70c0e-e720-4d69-99d2-782a124e48cb service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:53.696246 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b70c0e-e720-4d69-99d2-782a124e48cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:53.696246 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-96b70c0e-e720-4d69-99d2-782a124e48cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:09:53.755146 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b70c0e-e720-4d69-99d2-782a124e48cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:53.756612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b70c0e-e720-4d69-99d2-782a124e48cb service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:53.766108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1374/2780] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:09:57.505845 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b3622-2128-40a0-bd2e-3267a7cbbbbd service nova] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:57.507894 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e61b3622-2128-40a0-bd2e-3267a7cbbbbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:09:57.525676 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b3622-2128-40a0-bd2e-3267a7cbbbbd service nova] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:57.531455 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2a231-b18c-40c8-b979-bdb68d1fee62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394b43cef91f4990b4707cb7a6798068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:57.532206 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2a231-b18c-40c8-b979-bdb68d1fee62 service placement] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:57.532564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2a231-b18c-40c8-b979-bdb68d1fee62 service placement] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:57.532914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2a231-b18c-40c8-b979-bdb68d1fee62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:57.534845 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-fdd2a231-b18c-40c8-b979-bdb68d1fee62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:09:57.546878 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2a231-b18c-40c8-b979-bdb68d1fee62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:57.548472 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2a231-b18c-40c8-b979-bdb68d1fee62 service placement] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:57.561824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1407/2781] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:09:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:09:57.892461 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b70c0e-e720-4d69-99d2-782a124e48cb service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:57.894944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-96b70c0e-e720-4d69-99d2-782a124e48cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:09:57.910557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b70c0e-e720-4d69-99d2-782a124e48cb service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:57.915516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6c4f3-8bd3-4322-ba92-8e078c84d670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:57.916447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6c4f3-8bd3-4322-ba92-8e078c84d670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:57.917967 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6c4f3-8bd3-4322-ba92-8e078c84d670 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:57.917967 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6c4f3-8bd3-4322-ba92-8e078c84d670 admin admin] PATH_INFO: `/v3/users/f120b0139dfe4f36a8ae97060a1c26e3` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:57.918310 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6c4f3-8bd3-4322-ba92-8e078c84d670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f120b0139dfe4f36a8ae97060a1c26e3)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:57.920101 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6c4f3-8bd3-4322-ba92-8e078c84d670 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:58.123006 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-65a6c4f3-8bd3-4322-ba92-8e078c84d670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f120b0139dfe4f36a8ae97060a1c26e3'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:09:58.123674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-65a6c4f3-8bd3-4322-ba92-8e078c84d670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f120b0139dfe4f36a8ae97060a1c26e3'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:09:58.182399 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-65a6c4f3-8bd3-4322-ba92-8e078c84d670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f120b0139dfe4f36a8ae97060a1c26e3'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:09:58.196467 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-65a6c4f3-8bd3-4322-ba92-8e078c84d670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f120b0139dfe4f36a8ae97060a1c26e3'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:09:58.204768 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-65a6c4f3-8bd3-4322-ba92-8e078c84d670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f120b0139dfe4f36a8ae97060a1c26e3'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:09:58.210882 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1375/2782] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:09:57 2022] DELETE /identity/v3/users/f120b0139dfe4f36a8ae97060a1c26e3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:09:58.475241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2a231-b18c-40c8-b979-bdb68d1fee62 service placement] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:58.488309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2a231-b18c-40c8-b979-bdb68d1fee62 service placement] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:58.551285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c06c6-224a-41e6-b270-770f50166878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:58.554591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c06c6-224a-41e6-b270-770f50166878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:58.554591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c06c6-224a-41e6-b270-770f50166878 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:58.554591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c06c6-224a-41e6-b270-770f50166878 admin admin] PATH_INFO: `/v3/projects/8f431374c2944da3a0fd5b8bda45f9a2` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:58.554591 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c06c6-224a-41e6-b270-770f50166878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f431374c2944da3a0fd5b8bda45f9a2)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:58.555614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c06c6-224a-41e6-b270-770f50166878 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:58.688472 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-228c06c6-224a-41e6-b270-770f50166878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f431374c2944da3a0fd5b8bda45f9a2', 'request_id': 'req-228c06c6-224a-41e6-b270-770f50166878'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:09:58.695564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-228c06c6-224a-41e6-b270-770f50166878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f431374c2944da3a0fd5b8bda45f9a2', 'request_id': 'req-228c06c6-224a-41e6-b270-770f50166878'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:09:58.701271 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-228c06c6-224a-41e6-b270-770f50166878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f431374c2944da3a0fd5b8bda45f9a2', 'request_id': 'req-228c06c6-224a-41e6-b270-770f50166878'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:09:58.791333 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-228c06c6-224a-41e6-b270-770f50166878 admin admin] The token cache is being invalidate because project 8f431374c2944da3a0fd5b8bda45f9a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:09:58.791741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-228c06c6-224a-41e6-b270-770f50166878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:09:58.792483 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-228c06c6-224a-41e6-b270-770f50166878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:09:58.794214 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1408/2783] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:09:58 2022] DELETE /identity/v3/projects/8f431374c2944da3a0fd5b8bda45f9a2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:09:58.799765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a1556-65bd-42ef-82c8-06e417332d6f None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:58.800089 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a1556-65bd-42ef-82c8-06e417332d6f None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:58.800383 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a1556-65bd-42ef-82c8-06e417332d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:58.819848 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-039a1556-65bd-42ef-82c8-06e417332d6f None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:09:58.821228 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-039a1556-65bd-42ef-82c8-06e417332d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:09:58.867804 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:09:58.880200 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1376/2784] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:09:58.892631 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c0711-5f52-4afe-b02a-41c33cf0e8ff None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:58.892928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c0711-5f52-4afe-b02a-41c33cf0e8ff None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:58.893219 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c0711-5f52-4afe-b02a-41c33cf0e8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:58.912608 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-8b6c0711-5f52-4afe-b02a-41c33cf0e8ff None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:09:58.913816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-8b6c0711-5f52-4afe-b02a-41c33cf0e8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:09:58.923309 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1409/2785] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:09:58.927674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a1556-65bd-42ef-82c8-06e417332d6f None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:58.937407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a1556-65bd-42ef-82c8-06e417332d6f None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:58.942753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe4446-73e0-42e0-b305-6a715c489142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:58.943417 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4446-73e0-42e0-b305-6a715c489142 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:58.943700 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4446-73e0-42e0-b305-6a715c489142 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:58.944013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4446-73e0-42e0-b305-6a715c489142 admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:58.944741 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe4446-73e0-42e0-b305-6a715c489142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:09:58.945048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe4446-73e0-42e0-b305-6a715c489142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:58.946714 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe4446-73e0-42e0-b305-6a715c489142 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:58.959113 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1377/2786] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:09:58.969375 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c0711-5f52-4afe-b02a-41c33cf0e8ff None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:58.979090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c0711-5f52-4afe-b02a-41c33cf0e8ff None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:58.983838 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3cfc3-9d20-41dd-a1e8-00d6c5e2204c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:58.984424 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3cfc3-9d20-41dd-a1e8-00d6c5e2204c admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:58.984726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3cfc3-9d20-41dd-a1e8-00d6c5e2204c admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:58.985026 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3cfc3-9d20-41dd-a1e8-00d6c5e2204c admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:58.985719 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3cfc3-9d20-41dd-a1e8-00d6c5e2204c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:58.987659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3cfc3-9d20-41dd-a1e8-00d6c5e2204c admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:59.090486 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1410/2787] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:09:58 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:09:59.094847 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe4446-73e0-42e0-b305-6a715c489142 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:59.105109 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe4446-73e0-42e0-b305-6a715c489142 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:59.169074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11484dbb-c53e-4b6c-95ee-28909ee422b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:59.169782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11484dbb-c53e-4b6c-95ee-28909ee422b3 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:59.170068 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11484dbb-c53e-4b6c-95ee-28909ee422b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:59.170366 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11484dbb-c53e-4b6c-95ee-28909ee422b3 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:59.171099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11484dbb-c53e-4b6c-95ee-28909ee422b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:59.173041 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11484dbb-c53e-4b6c-95ee-28909ee422b3 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:59.294391 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1378/2788] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:09:59 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:09:59.298487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3cfc3-9d20-41dd-a1e8-00d6c5e2204c admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:59.309338 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3cfc3-9d20-41dd-a1e8-00d6c5e2204c admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:59.313935 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e565e72-167b-4846-acc0-f9d815cb4731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:59.314649 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e565e72-167b-4846-acc0-f9d815cb4731 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:59.314937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e565e72-167b-4846-acc0-f9d815cb4731 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:59.320776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e565e72-167b-4846-acc0-f9d815cb4731 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:59.320776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e565e72-167b-4846-acc0-f9d815cb4731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:59.320776 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e565e72-167b-4846-acc0-f9d815cb4731 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:59.329959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1411/2789] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:09:59.333857 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11484dbb-c53e-4b6c-95ee-28909ee422b3 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:59.344365 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11484dbb-c53e-4b6c-95ee-28909ee422b3 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:59.349084 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbe672-8304-4aa0-98bc-e7e8315537b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:59.353832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbe672-8304-4aa0-98bc-e7e8315537b4 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:59.353832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbe672-8304-4aa0-98bc-e7e8315537b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:59.353832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbe672-8304-4aa0-98bc-e7e8315537b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:59.353832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbe672-8304-4aa0-98bc-e7e8315537b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:59.353832 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfbe672-8304-4aa0-98bc-e7e8315537b4 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:59.363029 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1379/2790] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:09:59.367771 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e565e72-167b-4846-acc0-f9d815cb4731 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:59.379490 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e565e72-167b-4846-acc0-f9d815cb4731 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:59.385000 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25a5e5-800c-4643-ac95-738006967a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:59.385887 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25a5e5-800c-4643-ac95-738006967a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:59.386176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25a5e5-800c-4643-ac95-738006967a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:59.386495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25a5e5-800c-4643-ac95-738006967a59 admin admin] PATH_INFO: `/v3/projects/c116c6cf80d4411088e82465b18e0d95/users/f1fdd2ee1f044727b7fca8c0d10ff7c0/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:59.395588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:09:59.404290 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25a5e5-800c-4643-ac95-738006967a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c116c6cf80d4411088e82465b18e0d95, user_id=f1fdd2ee1f044727b7fca8c0d10ff7c0, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:59.407073 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25a5e5-800c-4643-ac95-738006967a59 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:59.522904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1412/2791] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:09:59 2022] PUT /identity/v3/projects/c116c6cf80d4411088e82465b18e0d95/users/f1fdd2ee1f044727b7fca8c0d10ff7c0/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:09:59.533909 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec8be7-776a-481b-8491-4410ada417ea None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:59.534117 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec8be7-776a-481b-8491-4410ada417ea None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:59.534457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec8be7-776a-481b-8491-4410ada417ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:59.561566 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-57ec8be7-776a-481b-8491-4410ada417ea None None] MFA Rules not processed for user `f1fdd2ee1f044727b7fca8c0d10ff7c0`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:09:59.562827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-57ec8be7-776a-481b-8491-4410ada417ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:09:59.626125 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1380/2792] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:09:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:09:59.630554 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25a5e5-800c-4643-ac95-738006967a59 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:59.691220 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25a5e5-800c-4643-ac95-738006967a59 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:59.695868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12a1fe-7c20-43fa-8195-69ab6983d806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:59.696526 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12a1fe-7c20-43fa-8195-69ab6983d806 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:59.696814 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12a1fe-7c20-43fa-8195-69ab6983d806 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:59.697099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e12a1fe-7c20-43fa-8195-69ab6983d806 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:59.697804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12a1fe-7c20-43fa-8195-69ab6983d806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:59.699754 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e12a1fe-7c20-43fa-8195-69ab6983d806 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:59.801501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1413/2793] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:09:59 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:09:59.806380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec8be7-776a-481b-8491-4410ada417ea None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:59.818810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec8be7-776a-481b-8491-4410ada417ea None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:59.864532 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:09:59.877058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25077648-3105-427f-b493-7deb3addafd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:59.877816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25077648-3105-427f-b493-7deb3addafd3 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:59.878066 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25077648-3105-427f-b493-7deb3addafd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:59.878364 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25077648-3105-427f-b493-7deb3addafd3 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:59.879659 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25077648-3105-427f-b493-7deb3addafd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:59.881655 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25077648-3105-427f-b493-7deb3addafd3 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:09:59.965237 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1381/2794] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:09:59 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:09:59.971287 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12a1fe-7c20-43fa-8195-69ab6983d806 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:09:59.981914 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e12a1fe-7c20-43fa-8195-69ab6983d806 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:09:59.986705 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7137e9b-a888-46b3-9139-0594bb78434e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:09:59.987370 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7137e9b-a888-46b3-9139-0594bb78434e admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:09:59.987659 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7137e9b-a888-46b3-9139-0594bb78434e admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:09:59.987981 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7137e9b-a888-46b3-9139-0594bb78434e admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:09:59.989259 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7137e9b-a888-46b3-9139-0594bb78434e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:09:59.990888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7137e9b-a888-46b3-9139-0594bb78434e admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:00.005956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1414/2795] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:10:00.007215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25077648-3105-427f-b493-7deb3addafd3 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:00.017544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25077648-3105-427f-b493-7deb3addafd3 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:00.022237 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906c15-4645-43af-ba03-aa9eae76e340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:00.023163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906c15-4645-43af-ba03-aa9eae76e340 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:00.023456 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906c15-4645-43af-ba03-aa9eae76e340 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:00.023740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906c15-4645-43af-ba03-aa9eae76e340 admin admin] PATH_INFO: `/v3/projects/b1894d87ed5e492c89dead6cd78ac665/users/41d60125cfe64e8f8ffd6d9ab27ba236/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:00.039335 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07906c15-4645-43af-ba03-aa9eae76e340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1894d87ed5e492c89dead6cd78ac665, user_id=41d60125cfe64e8f8ffd6d9ab27ba236, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:00.042128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07906c15-4645-43af-ba03-aa9eae76e340 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:00.108746 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1382/2796] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:10:00 2022] PUT /identity/v3/projects/b1894d87ed5e492c89dead6cd78ac665/users/41d60125cfe64e8f8ffd6d9ab27ba236/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:00.112793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7137e9b-a888-46b3-9139-0594bb78434e admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:00.124627 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7137e9b-a888-46b3-9139-0594bb78434e admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:00.181910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc597d5-52e1-4520-97bf-59adcdf8f377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:00.182595 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc597d5-52e1-4520-97bf-59adcdf8f377 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:00.182886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc597d5-52e1-4520-97bf-59adcdf8f377 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:00.183168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc597d5-52e1-4520-97bf-59adcdf8f377 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:00.183900 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc597d5-52e1-4520-97bf-59adcdf8f377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:00.185508 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc597d5-52e1-4520-97bf-59adcdf8f377 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:00.195915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1415/2797] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:10:00.200249 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906c15-4645-43af-ba03-aa9eae76e340 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:00.210740 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906c15-4645-43af-ba03-aa9eae76e340 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:00.215431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd67b0-d512-4c51-bed4-09d36ac59fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:00.216317 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd67b0-d512-4c51-bed4-09d36ac59fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:00.216607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd67b0-d512-4c51-bed4-09d36ac59fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:00.216890 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd67b0-d512-4c51-bed4-09d36ac59fcb admin admin] PATH_INFO: `/v3/projects/b1894d87ed5e492c89dead6cd78ac665/users/41d60125cfe64e8f8ffd6d9ab27ba236/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:00.218922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd67b0-d512-4c51-bed4-09d36ac59fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1894d87ed5e492c89dead6cd78ac665, user_id=41d60125cfe64e8f8ffd6d9ab27ba236, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:00.221577 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd67b0-d512-4c51-bed4-09d36ac59fcb admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:00.233351 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1383/2798] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:10:00 2022] PUT /identity/v3/projects/b1894d87ed5e492c89dead6cd78ac665/users/41d60125cfe64e8f8ffd6d9ab27ba236/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:10:00.246731 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aac264-3dad-4e9d-8798-7f6f69cb4779 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:00.247113 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aac264-3dad-4e9d-8798-7f6f69cb4779 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:00.247469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aac264-3dad-4e9d-8798-7f6f69cb4779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:00.275854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-15aac264-3dad-4e9d-8798-7f6f69cb4779 None None] MFA Rules not processed for user `41d60125cfe64e8f8ffd6d9ab27ba236`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:00.286450 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-15aac264-3dad-4e9d-8798-7f6f69cb4779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:00.323763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:00.348881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1416/2799] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:00.360104 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd67b0-d512-4c51-bed4-09d36ac59fcb admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:00.361862 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-9fcd67b0-d512-4c51-bed4-09d36ac59fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:00.420142 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd67b0-d512-4c51-bed4-09d36ac59fcb admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:00.423795 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ec721-69a4-4ba3-a689-a51835c10a47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:00.424440 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ec721-69a4-4ba3-a689-a51835c10a47 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:00.424732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ec721-69a4-4ba3-a689-a51835c10a47 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:00.425014 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ec721-69a4-4ba3-a689-a51835c10a47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:00.434393 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ec721-69a4-4ba3-a689-a51835c10a47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:00.435825 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ec721-69a4-4ba3-a689-a51835c10a47 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:00.445777 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1384/2800] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:10:00 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:10:00.680038 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aac264-3dad-4e9d-8798-7f6f69cb4779 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:00.689600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aac264-3dad-4e9d-8798-7f6f69cb4779 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:00.693168 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba25097-c8dc-403c-a8ba-0d0f8e043deb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:00.693804 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba25097-c8dc-403c-a8ba-0d0f8e043deb service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:00.694096 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba25097-c8dc-403c-a8ba-0d0f8e043deb service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:00.694405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba25097-c8dc-403c-a8ba-0d0f8e043deb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:00.750017 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba25097-c8dc-403c-a8ba-0d0f8e043deb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:00.751494 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba25097-c8dc-403c-a8ba-0d0f8e043deb service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:00.760433 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1417/2801] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:10:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:10:05.020247 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ec721-69a4-4ba3-a689-a51835c10a47 service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:05.021731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-467ec721-69a4-4ba3-a689-a51835c10a47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:05.079469 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ec721-69a4-4ba3-a689-a51835c10a47 service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:05.083767 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b32a2e-5a7c-4311-973f-5096d76910b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:05.084419 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b32a2e-5a7c-4311-973f-5096d76910b9 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:05.084707 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b32a2e-5a7c-4311-973f-5096d76910b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:05.084987 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b32a2e-5a7c-4311-973f-5096d76910b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:05.086801 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-11b32a2e-5a7c-4311-973f-5096d76910b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:05.096326 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b32a2e-5a7c-4311-973f-5096d76910b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:05.097773 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b32a2e-5a7c-4311-973f-5096d76910b9 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:05.105973 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1385/2802] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:10:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:10:10.756359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=36 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:15.102236 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=74,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:35.116871 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba25097-c8dc-403c-a8ba-0d0f8e043deb service cinder] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:35.177481 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba25097-c8dc-403c-a8ba-0d0f8e043deb service cinder] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:35.182007 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf83f9-4680-4777-9220-5bdf04915fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:35.182904 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf83f9-4680-4777-9220-5bdf04915fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:35.183192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf83f9-4680-4777-9220-5bdf04915fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:35.183469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf83f9-4680-4777-9220-5bdf04915fc2 admin admin] PATH_INFO: `/v3/users/f1fdd2ee1f044727b7fca8c0d10ff7c0` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:35.184636 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf83f9-4680-4777-9220-5bdf04915fc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1fdd2ee1f044727b7fca8c0d10ff7c0)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:35.186578 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf83f9-4680-4777-9220-5bdf04915fc2 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:35.386614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fecf83f9-4680-4777-9220-5bdf04915fc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1fdd2ee1f044727b7fca8c0d10ff7c0'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:35.464228 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fecf83f9-4680-4777-9220-5bdf04915fc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1fdd2ee1f044727b7fca8c0d10ff7c0'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:35.464873 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fecf83f9-4680-4777-9220-5bdf04915fc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1fdd2ee1f044727b7fca8c0d10ff7c0'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:35.474799 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fecf83f9-4680-4777-9220-5bdf04915fc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1fdd2ee1f044727b7fca8c0d10ff7c0'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:35.487091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-fecf83f9-4680-4777-9220-5bdf04915fc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1fdd2ee1f044727b7fca8c0d10ff7c0'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:35.493920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1418/2803] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:10:35 2022] DELETE /identity/v3/users/f1fdd2ee1f044727b7fca8c0d10ff7c0 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:35.498769 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cd769-6007-4368-9bad-4be2555ec5a0 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:35.499783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cd769-6007-4368-9bad-4be2555ec5a0 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:35.499783 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cd769-6007-4368-9bad-4be2555ec5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:35.516757 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-2e4cd769-6007-4368-9bad-4be2555ec5a0 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:35.517950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2e4cd769-6007-4368-9bad-4be2555ec5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:35.577204 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1386/2804] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:35.586881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf83f9-4680-4777-9220-5bdf04915fc2 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:35.588341 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-fecf83f9-4680-4777-9220-5bdf04915fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:35.645071 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf83f9-4680-4777-9220-5bdf04915fc2 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:35.648564 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a16c7-7cd8-4d21-9acd-c21bda7df333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:35.649204 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a16c7-7cd8-4d21-9acd-c21bda7df333 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:35.649489 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a16c7-7cd8-4d21-9acd-c21bda7df333 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:35.649769 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a16c7-7cd8-4d21-9acd-c21bda7df333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:35.658905 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a16c7-7cd8-4d21-9acd-c21bda7df333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:35.660334 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a16c7-7cd8-4d21-9acd-c21bda7df333 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:35.670142 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1419/2805] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:10:36.080198 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cd769-6007-4368-9bad-4be2555ec5a0 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:36.081782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2e4cd769-6007-4368-9bad-4be2555ec5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:36.100243 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cd769-6007-4368-9bad-4be2555ec5a0 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:36.105104 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa8dc3-75e7-400c-84e5-ff504218a14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:36.105975 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa8dc3-75e7-400c-84e5-ff504218a14c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:36.106380 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa8dc3-75e7-400c-84e5-ff504218a14c admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:36.106555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa8dc3-75e7-400c-84e5-ff504218a14c admin admin] PATH_INFO: `/v3/projects/c116c6cf80d4411088e82465b18e0d95` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:36.107800 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa8dc3-75e7-400c-84e5-ff504218a14c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c116c6cf80d4411088e82465b18e0d95)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:36.109774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aa8dc3-75e7-400c-84e5-ff504218a14c admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:36.236541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-50aa8dc3-75e7-400c-84e5-ff504218a14c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c116c6cf80d4411088e82465b18e0d95', 'request_id': 'req-50aa8dc3-75e7-400c-84e5-ff504218a14c'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:36.316119 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-50aa8dc3-75e7-400c-84e5-ff504218a14c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c116c6cf80d4411088e82465b18e0d95', 'request_id': 'req-50aa8dc3-75e7-400c-84e5-ff504218a14c'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:36.323035 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-50aa8dc3-75e7-400c-84e5-ff504218a14c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c116c6cf80d4411088e82465b18e0d95', 'request_id': 'req-50aa8dc3-75e7-400c-84e5-ff504218a14c'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:36.333881 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-50aa8dc3-75e7-400c-84e5-ff504218a14c admin admin] The token cache is being invalidate because project c116c6cf80d4411088e82465b18e0d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:10:36.334171 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-50aa8dc3-75e7-400c-84e5-ff504218a14c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:36.334844 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-50aa8dc3-75e7-400c-84e5-ff504218a14c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:36.336387 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1387/2806] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:10:36 2022] DELETE /identity/v3/projects/c116c6cf80d4411088e82465b18e0d95 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:36.340458 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a16c7-7cd8-4d21-9acd-c21bda7df333 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:36.350124 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a16c7-7cd8-4d21-9acd-c21bda7df333 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:36.368216 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:36.407199 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227dce2-be4e-4e9e-b94b-6cd5d198c065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:36.408079 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227dce2-be4e-4e9e-b94b-6cd5d198c065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:36.408390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227dce2-be4e-4e9e-b94b-6cd5d198c065 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:36.408733 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227dce2-be4e-4e9e-b94b-6cd5d198c065 admin admin] PATH_INFO: `/v3/users/41d60125cfe64e8f8ffd6d9ab27ba236` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:36.409984 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227dce2-be4e-4e9e-b94b-6cd5d198c065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d60125cfe64e8f8ffd6d9ab27ba236)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:36.411960 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227dce2-be4e-4e9e-b94b-6cd5d198c065 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:36.610912 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6227dce2-be4e-4e9e-b94b-6cd5d198c065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d60125cfe64e8f8ffd6d9ab27ba236'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:36.704019 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6227dce2-be4e-4e9e-b94b-6cd5d198c065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d60125cfe64e8f8ffd6d9ab27ba236'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:36.704646 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6227dce2-be4e-4e9e-b94b-6cd5d198c065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d60125cfe64e8f8ffd6d9ab27ba236'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:36.711726 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6227dce2-be4e-4e9e-b94b-6cd5d198c065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d60125cfe64e8f8ffd6d9ab27ba236'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:36.723505 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-6227dce2-be4e-4e9e-b94b-6cd5d198c065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d60125cfe64e8f8ffd6d9ab27ba236'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:36.729568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1420/2807] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:10:36 2022] DELETE /identity/v3/users/41d60125cfe64e8f8ffd6d9ab27ba236 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:37.111690 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa8dc3-75e7-400c-84e5-ff504218a14c admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:37.113133 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-50aa8dc3-75e7-400c-84e5-ff504218a14c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:37.126779 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa8dc3-75e7-400c-84e5-ff504218a14c admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:37.184199 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e0849-4475-4ebd-be18-0c893757cfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:37.185065 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e0849-4475-4ebd-be18-0c893757cfac admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:37.185353 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e0849-4475-4ebd-be18-0c893757cfac admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:37.185633 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e0849-4475-4ebd-be18-0c893757cfac admin admin] PATH_INFO: `/v3/projects/b1894d87ed5e492c89dead6cd78ac665` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:37.186848 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e0849-4475-4ebd-be18-0c893757cfac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1894d87ed5e492c89dead6cd78ac665)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:37.188751 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e0849-4475-4ebd-be18-0c893757cfac admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:37.300536 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:37.317023 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-757e0849-4475-4ebd-be18-0c893757cfac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1894d87ed5e492c89dead6cd78ac665', 'request_id': 'req-757e0849-4475-4ebd-be18-0c893757cfac'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:37.398512 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-757e0849-4475-4ebd-be18-0c893757cfac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1894d87ed5e492c89dead6cd78ac665', 'request_id': 'req-757e0849-4475-4ebd-be18-0c893757cfac'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:37.405268 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-757e0849-4475-4ebd-be18-0c893757cfac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1894d87ed5e492c89dead6cd78ac665', 'request_id': 'req-757e0849-4475-4ebd-be18-0c893757cfac'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:37.416873 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-757e0849-4475-4ebd-be18-0c893757cfac admin admin] The token cache is being invalidate because project b1894d87ed5e492c89dead6cd78ac665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:10:37.417169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-757e0849-4475-4ebd-be18-0c893757cfac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:37.417810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-757e0849-4475-4ebd-be18-0c893757cfac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:37.419396 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1388/2808] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:10:37 2022] DELETE /identity/v3/projects/b1894d87ed5e492c89dead6cd78ac665 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:37.424399 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecc890-151b-4079-95a4-137ccdebb8b3 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:37.424874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecc890-151b-4079-95a4-137ccdebb8b3 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:37.424973 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecc890-151b-4079-95a4-137ccdebb8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:37.442599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-aeecc890-151b-4079-95a4-137ccdebb8b3 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:37.443820 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-aeecc890-151b-4079-95a4-137ccdebb8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:37.504075 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1421/2809] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:37.512763 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a98c8-a3d1-42ba-80cc-a7570ab7b1ed None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:37.513087 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a98c8-a3d1-42ba-80cc-a7570ab7b1ed None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:37.513376 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a98c8-a3d1-42ba-80cc-a7570ab7b1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:37.532188 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-762a98c8-a3d1-42ba-80cc-a7570ab7b1ed None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:37.533397 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-762a98c8-a3d1-42ba-80cc-a7570ab7b1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:37.541881 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1389/2810] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:37.545916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecc890-151b-4079-95a4-137ccdebb8b3 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:37.555962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecc890-151b-4079-95a4-137ccdebb8b3 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:37.560529 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ae0a6-1115-4de8-8056-394dd33ab56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:37.561180 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ae0a6-1115-4de8-8056-394dd33ab56d admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:37.561469 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ae0a6-1115-4de8-8056-394dd33ab56d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:37.561749 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ae0a6-1115-4de8-8056-394dd33ab56d admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:37.562511 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ae0a6-1115-4de8-8056-394dd33ab56d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:10:37.562822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ae0a6-1115-4de8-8056-394dd33ab56d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:37.564416 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ae0a6-1115-4de8-8056-394dd33ab56d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:37.575675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1422/2811] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:10:37.579730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a98c8-a3d1-42ba-80cc-a7570ab7b1ed None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:37.589418 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a98c8-a3d1-42ba-80cc-a7570ab7b1ed None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:37.594190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110f4e0-729b-4e7a-a339-4be4617598c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:37.594873 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110f4e0-729b-4e7a-a339-4be4617598c4 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:37.595163 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110f4e0-729b-4e7a-a339-4be4617598c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:37.595444 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110f4e0-729b-4e7a-a339-4be4617598c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:37.596132 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110f4e0-729b-4e7a-a339-4be4617598c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:37.598105 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110f4e0-729b-4e7a-a339-4be4617598c4 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:37.746407 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1390/2812] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:10:37 2022] POST /identity/v3/projects => generated 389 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:10:37.750630 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ae0a6-1115-4de8-8056-394dd33ab56d admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:37.760521 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ae0a6-1115-4de8-8056-394dd33ab56d admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:37.787146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:37.817567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a27166-471e-4992-ae4d-82ac874a1841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:37.818178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a27166-471e-4992-ae4d-82ac874a1841 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:37.818505 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a27166-471e-4992-ae4d-82ac874a1841 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:37.818790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a27166-471e-4992-ae4d-82ac874a1841 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:37.819501 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a27166-471e-4992-ae4d-82ac874a1841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:37.821466 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a27166-471e-4992-ae4d-82ac874a1841 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:37.904087 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1423/2813] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:10:37 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 20:10:37.908423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110f4e0-729b-4e7a-a339-4be4617598c4 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:37.919352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110f4e0-729b-4e7a-a339-4be4617598c4 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:37.923952 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cbfe8-5403-42cc-912a-6503753aa9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:37.924607 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cbfe8-5403-42cc-912a-6503753aa9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:37.924897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cbfe8-5403-42cc-912a-6503753aa9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:37.925182 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cbfe8-5403-42cc-912a-6503753aa9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:37.925963 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cbfe8-5403-42cc-912a-6503753aa9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:37.930082 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cbfe8-5403-42cc-912a-6503753aa9d5 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:37.938763 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1391/2814] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:10:37.942688 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a27166-471e-4992-ae4d-82ac874a1841 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:37.952563 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a27166-471e-4992-ae4d-82ac874a1841 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:37.957199 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465d16f-5d74-49a9-ad7a-f8733dab2c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:37.957888 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465d16f-5d74-49a9-ad7a-f8733dab2c0b admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:37.958796 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465d16f-5d74-49a9-ad7a-f8733dab2c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:37.958796 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465d16f-5d74-49a9-ad7a-f8733dab2c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:37.959208 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465d16f-5d74-49a9-ad7a-f8733dab2c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:37.960856 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e465d16f-5d74-49a9-ad7a-f8733dab2c0b admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:37.970775 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1424/2815] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:10:37.975128 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cbfe8-5403-42cc-912a-6503753aa9d5 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:37.984890 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cbfe8-5403-42cc-912a-6503753aa9d5 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:37.990409 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad3aef-1ca6-4f31-9491-1c9b259d389e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:37.991901 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad3aef-1ca6-4f31-9491-1c9b259d389e admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:37.992191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad3aef-1ca6-4f31-9491-1c9b259d389e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:37.992468 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad3aef-1ca6-4f31-9491-1c9b259d389e admin admin] PATH_INFO: `/v3/projects/2c3b45b9ecb84d859f08fb09b5552636/users/6974e130927f47449e6c933a5f1f6ac5/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:38.006997 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad3aef-1ca6-4f31-9491-1c9b259d389e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3b45b9ecb84d859f08fb09b5552636, user_id=6974e130927f47449e6c933a5f1f6ac5, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:38.009732 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad3aef-1ca6-4f31-9491-1c9b259d389e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:38.109888 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1392/2816] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:10:37 2022] PUT /identity/v3/projects/2c3b45b9ecb84d859f08fb09b5552636/users/6974e130927f47449e6c933a5f1f6ac5/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:10:38.120111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee5ba5-c2c7-4646-9ce4-a63a57ec3f5e None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:38.120404 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee5ba5-c2c7-4646-9ce4-a63a57ec3f5e None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:38.120685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee5ba5-c2c7-4646-9ce4-a63a57ec3f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:38.146515 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-e0ee5ba5-c2c7-4646-9ce4-a63a57ec3f5e None None] MFA Rules not processed for user `6974e130927f47449e6c933a5f1f6ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:38.147701 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-e0ee5ba5-c2c7-4646-9ce4-a63a57ec3f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:38.211040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1425/2817] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:38.215420 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad3aef-1ca6-4f31-9491-1c9b259d389e admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:38.276175 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad3aef-1ca6-4f31-9491-1c9b259d389e admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:38.280699 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3255f23-7e32-4de6-b2c2-cbc283656664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:38.281349 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3255f23-7e32-4de6-b2c2-cbc283656664 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:38.281630 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3255f23-7e32-4de6-b2c2-cbc283656664 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:38.281905 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3255f23-7e32-4de6-b2c2-cbc283656664 admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:38.282700 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3255f23-7e32-4de6-b2c2-cbc283656664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:38.284686 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3255f23-7e32-4de6-b2c2-cbc283656664 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:38.479207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1393/2818] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:10:38 2022] POST /identity/v3/projects => generated 389 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:10:38.481721 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee5ba5-c2c7-4646-9ce4-a63a57ec3f5e None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:38.492441 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee5ba5-c2c7-4646-9ce4-a63a57ec3f5e None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:38.548127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fa06d-f841-4a32-909c-773644b49bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:38.548800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fa06d-f841-4a32-909c-773644b49bac admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:38.549089 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fa06d-f841-4a32-909c-773644b49bac admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:38.549371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897fa06d-f841-4a32-909c-773644b49bac admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:38.550056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fa06d-f841-4a32-909c-773644b49bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:38.552053 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897fa06d-f841-4a32-909c-773644b49bac admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:38.621692 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1426/2819] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:10:38 2022] POST /identity/v3/users => generated 301 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:10:38.625705 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3255f23-7e32-4de6-b2c2-cbc283656664 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:38.636547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3255f23-7e32-4de6-b2c2-cbc283656664 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:38.641291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf1f7b-e8ca-457e-b3d9-f782b49f886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:38.641944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf1f7b-e8ca-457e-b3d9-f782b49f886c admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:38.642233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf1f7b-e8ca-457e-b3d9-f782b49f886c admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:38.642547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf1f7b-e8ca-457e-b3d9-f782b49f886c admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:38.643270 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf1f7b-e8ca-457e-b3d9-f782b49f886c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:38.645479 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf1f7b-e8ca-457e-b3d9-f782b49f886c admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:38.657555 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1394/2820] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:10:38.661742 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fa06d-f841-4a32-909c-773644b49bac admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:38.671618 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897fa06d-f841-4a32-909c-773644b49bac admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:38.676213 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160c6ce-d0ad-43d9-ac35-56810ec28835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:38.677084 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160c6ce-d0ad-43d9-ac35-56810ec28835 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:38.677375 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160c6ce-d0ad-43d9-ac35-56810ec28835 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:38.677653 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160c6ce-d0ad-43d9-ac35-56810ec28835 admin admin] PATH_INFO: `/v3/projects/350d464bbe0a4be88808e892ade2b63a/users/72082690d72f44148553ca9b96c6caab/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:38.692594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160c6ce-d0ad-43d9-ac35-56810ec28835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350d464bbe0a4be88808e892ade2b63a, user_id=72082690d72f44148553ca9b96c6caab, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:38.695305 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c160c6ce-d0ad-43d9-ac35-56810ec28835 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:38.762211 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1427/2821] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:10:38 2022] PUT /identity/v3/projects/350d464bbe0a4be88808e892ade2b63a/users/72082690d72f44148553ca9b96c6caab/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:38.766156 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf1f7b-e8ca-457e-b3d9-f782b49f886c admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:38.777199 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf1f7b-e8ca-457e-b3d9-f782b49f886c admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:38.796760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:38.832306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d285f-9fed-4422-bcd3-79b94d9ae37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:38.833530 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d285f-9fed-4422-bcd3-79b94d9ae37b admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:38.833823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d285f-9fed-4422-bcd3-79b94d9ae37b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:38.834108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d285f-9fed-4422-bcd3-79b94d9ae37b admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:38.834876 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d285f-9fed-4422-bcd3-79b94d9ae37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:38.836936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719d285f-9fed-4422-bcd3-79b94d9ae37b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:38.846870 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1395/2822] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:10:38.851015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160c6ce-d0ad-43d9-ac35-56810ec28835 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:38.856472 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:38.861775 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160c6ce-d0ad-43d9-ac35-56810ec28835 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:38.867079 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94151d03-43b7-47a1-bc8c-58f2b11256b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:38.867972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94151d03-43b7-47a1-bc8c-58f2b11256b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:38.868251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94151d03-43b7-47a1-bc8c-58f2b11256b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:38.868530 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94151d03-43b7-47a1-bc8c-58f2b11256b3 admin admin] PATH_INFO: `/v3/projects/350d464bbe0a4be88808e892ade2b63a/users/72082690d72f44148553ca9b96c6caab/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:38.870534 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94151d03-43b7-47a1-bc8c-58f2b11256b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=350d464bbe0a4be88808e892ade2b63a, user_id=72082690d72f44148553ca9b96c6caab, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:38.874260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94151d03-43b7-47a1-bc8c-58f2b11256b3 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:38.883725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1428/2823] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:10:38 2022] PUT /identity/v3/projects/350d464bbe0a4be88808e892ade2b63a/users/72082690d72f44148553ca9b96c6caab/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:38.894961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b694150-3bc0-4cd6-8b70-e2dc2716cc89 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:38.895260 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b694150-3bc0-4cd6-8b70-e2dc2716cc89 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:38.895544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b694150-3bc0-4cd6-8b70-e2dc2716cc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:38.922334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-2b694150-3bc0-4cd6-8b70-e2dc2716cc89 None None] MFA Rules not processed for user `72082690d72f44148553ca9b96c6caab`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:38.923884 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2b694150-3bc0-4cd6-8b70-e2dc2716cc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:38.991287 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1396/2824] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:39.001958 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94151d03-43b7-47a1-bc8c-58f2b11256b3 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:39.003722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-94151d03-43b7-47a1-bc8c-58f2b11256b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:39.060100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94151d03-43b7-47a1-bc8c-58f2b11256b3 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:39.063765 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e311f-3638-4832-93f2-d442fcfb25a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:39.064407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e311f-3638-4832-93f2-d442fcfb25a3 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:39.064698 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e311f-3638-4832-93f2-d442fcfb25a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:39.064988 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e311f-3638-4832-93f2-d442fcfb25a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:39.074567 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e311f-3638-4832-93f2-d442fcfb25a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:39.076015 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e311f-3638-4832-93f2-d442fcfb25a3 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:39.085336 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1429/2825] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:10:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:10:39.207548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b694150-3bc0-4cd6-8b70-e2dc2716cc89 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:39.269085 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b694150-3bc0-4cd6-8b70-e2dc2716cc89 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:39.273548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d5f9d-6a59-49c4-839c-e668a713188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:39.274434 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d5f9d-6a59-49c4-839c-e668a713188a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:39.274748 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d5f9d-6a59-49c4-839c-e668a713188a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:39.274998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d5f9d-6a59-49c4-839c-e668a713188a admin admin] PATH_INFO: `/v3/users/6974e130927f47449e6c933a5f1f6ac5` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:39.276499 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d5f9d-6a59-49c4-839c-e668a713188a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6974e130927f47449e6c933a5f1f6ac5)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:39.278431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d5f9d-6a59-49c4-839c-e668a713188a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:39.506971 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-466d5f9d-6a59-49c4-839c-e668a713188a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6974e130927f47449e6c933a5f1f6ac5'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:39.507635 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-466d5f9d-6a59-49c4-839c-e668a713188a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6974e130927f47449e6c933a5f1f6ac5'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:39.509425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:39.575121 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-466d5f9d-6a59-49c4-839c-e668a713188a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6974e130927f47449e6c933a5f1f6ac5'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:39.587810 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-466d5f9d-6a59-49c4-839c-e668a713188a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6974e130927f47449e6c933a5f1f6ac5'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:39.594584 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-466d5f9d-6a59-49c4-839c-e668a713188a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6974e130927f47449e6c933a5f1f6ac5'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:39.600478 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1397/2826] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:10:39 2022] DELETE /identity/v3/users/6974e130927f47449e6c933a5f1f6ac5 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:39.605159 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623f329-1eb6-4dce-8922-0edac1e1379a None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:39.605666 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623f329-1eb6-4dce-8922-0edac1e1379a None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:39.605767 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623f329-1eb6-4dce-8922-0edac1e1379a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:39.623436 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-0623f329-1eb6-4dce-8922-0edac1e1379a None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:39.624628 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-0623f329-1eb6-4dce-8922-0edac1e1379a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:39.681586 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1430/2827] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:39.691204 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d5f9d-6a59-49c4-839c-e668a713188a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:39.693190 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-466d5f9d-6a59-49c4-839c-e668a713188a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:39.749313 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d5f9d-6a59-49c4-839c-e668a713188a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:39.752845 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a6383-9bba-4360-9d29-7cf69c4d4205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:39.753487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a6383-9bba-4360-9d29-7cf69c4d4205 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:39.753782 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a6383-9bba-4360-9d29-7cf69c4d4205 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:39.754660 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a6383-9bba-4360-9d29-7cf69c4d4205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:39.764013 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a6383-9bba-4360-9d29-7cf69c4d4205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:39.765511 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a6383-9bba-4360-9d29-7cf69c4d4205 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:39.775387 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1398/2828] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:10:40.145575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623f329-1eb6-4dce-8922-0edac1e1379a None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:40.147024 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-0623f329-1eb6-4dce-8922-0edac1e1379a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:40.160946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623f329-1eb6-4dce-8922-0edac1e1379a None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:40.165513 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:40.166429 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:40.166722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:40.167088 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584 admin admin] PATH_INFO: `/v3/projects/2c3b45b9ecb84d859f08fb09b5552636` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:40.168292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c3b45b9ecb84d859f08fb09b5552636)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:40.170218 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:40.270633 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c3b45b9ecb84d859f08fb09b5552636', 'request_id': 'req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:40.276972 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c3b45b9ecb84d859f08fb09b5552636', 'request_id': 'req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:40.282571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c3b45b9ecb84d859f08fb09b5552636', 'request_id': 'req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:40.377895 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584 admin admin] The token cache is being invalidate because project 2c3b45b9ecb84d859f08fb09b5552636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:10:40.378183 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:40.378833 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:40.380390 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1431/2829] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:10:40 2022] DELETE /identity/v3/projects/2c3b45b9ecb84d859f08fb09b5552636 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:40.384390 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a6383-9bba-4360-9d29-7cf69c4d4205 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:40.393949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a6383-9bba-4360-9d29-7cf69c4d4205 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:40.450990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fed5a7-ca8e-4bc2-9be7-3afbe4df73ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:40.451862 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fed5a7-ca8e-4bc2-9be7-3afbe4df73ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:40.452150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fed5a7-ca8e-4bc2-9be7-3afbe4df73ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:40.452427 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fed5a7-ca8e-4bc2-9be7-3afbe4df73ff admin admin] PATH_INFO: `/v3/users/72082690d72f44148553ca9b96c6caab` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:40.453790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fed5a7-ca8e-4bc2-9be7-3afbe4df73ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=72082690d72f44148553ca9b96c6caab)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:40.455760 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fed5a7-ca8e-4bc2-9be7-3afbe4df73ff admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:40.620463 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-10fed5a7-ca8e-4bc2-9be7-3afbe4df73ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72082690d72f44148553ca9b96c6caab'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:40.621145 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-10fed5a7-ca8e-4bc2-9be7-3afbe4df73ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72082690d72f44148553ca9b96c6caab'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:40.681276 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-10fed5a7-ca8e-4bc2-9be7-3afbe4df73ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72082690d72f44148553ca9b96c6caab'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:40.693486 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:40.694946 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-10fed5a7-ca8e-4bc2-9be7-3afbe4df73ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72082690d72f44148553ca9b96c6caab'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:40.702077 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-10fed5a7-ca8e-4bc2-9be7-3afbe4df73ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72082690d72f44148553ca9b96c6caab'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:40.708859 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1399/2830] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:10:40 2022] DELETE /identity/v3/users/72082690d72f44148553ca9b96c6caab => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:41.137991 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:41.139509 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:41.153300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd15cad8-a9a6-42e5-a2fe-4abcfa69b584 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:41.168865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:41.214116 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a410d-3c97-4e21-9214-175e12ba072e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:41.215024 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a410d-3c97-4e21-9214-175e12ba072e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:41.215350 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a410d-3c97-4e21-9214-175e12ba072e admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:41.215630 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a410d-3c97-4e21-9214-175e12ba072e admin admin] PATH_INFO: `/v3/projects/350d464bbe0a4be88808e892ade2b63a` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:41.216806 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a410d-3c97-4e21-9214-175e12ba072e admin admin] RBAC: Authorizing `identity:delete_project(project_id=350d464bbe0a4be88808e892ade2b63a)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:41.218766 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a410d-3c97-4e21-9214-175e12ba072e admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:41.346817 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ea7a410d-3c97-4e21-9214-175e12ba072e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '350d464bbe0a4be88808e892ade2b63a', 'request_id': 'req-ea7a410d-3c97-4e21-9214-175e12ba072e'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:41.352865 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ea7a410d-3c97-4e21-9214-175e12ba072e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '350d464bbe0a4be88808e892ade2b63a', 'request_id': 'req-ea7a410d-3c97-4e21-9214-175e12ba072e'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:41.358395 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ea7a410d-3c97-4e21-9214-175e12ba072e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '350d464bbe0a4be88808e892ade2b63a', 'request_id': 'req-ea7a410d-3c97-4e21-9214-175e12ba072e'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:41.446615 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ea7a410d-3c97-4e21-9214-175e12ba072e admin admin] The token cache is being invalidate because project 350d464bbe0a4be88808e892ade2b63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:10:41.446836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ea7a410d-3c97-4e21-9214-175e12ba072e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:41.447451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-ea7a410d-3c97-4e21-9214-175e12ba072e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:41.449009 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1432/2831] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:10:41 2022] DELETE /identity/v3/projects/350d464bbe0a4be88808e892ade2b63a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:41.453975 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ad35d-c6c1-4129-941e-963711dba237 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:41.454482 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ad35d-c6c1-4129-941e-963711dba237 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:41.454615 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ad35d-c6c1-4129-941e-963711dba237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:41.472913 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-524ad35d-c6c1-4129-941e-963711dba237 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:41.474169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-524ad35d-c6c1-4129-941e-963711dba237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:41.533505 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1400/2832] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:41.541885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b512fd-bc5a-48cb-86d0-29078d4c7bf3 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:41.542177 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b512fd-bc5a-48cb-86d0-29078d4c7bf3 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:41.542562 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b512fd-bc5a-48cb-86d0-29078d4c7bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:41.562473 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-21b512fd-bc5a-48cb-86d0-29078d4c7bf3 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:41.563920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-21b512fd-bc5a-48cb-86d0-29078d4c7bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:41.572598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1433/2833] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:41.576721 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ad35d-c6c1-4129-941e-963711dba237 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:41.586279 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ad35d-c6c1-4129-941e-963711dba237 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:41.590893 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41f53a-00ce-4a2d-b7a5-88251b09ab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:41.591541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41f53a-00ce-4a2d-b7a5-88251b09ab1b admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:41.591827 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41f53a-00ce-4a2d-b7a5-88251b09ab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:41.592108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41f53a-00ce-4a2d-b7a5-88251b09ab1b admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:41.592829 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41f53a-00ce-4a2d-b7a5-88251b09ab1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:10:41.593137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41f53a-00ce-4a2d-b7a5-88251b09ab1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:41.594749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41f53a-00ce-4a2d-b7a5-88251b09ab1b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:41.606548 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1401/2834] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:10:41.610590 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b512fd-bc5a-48cb-86d0-29078d4c7bf3 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:41.620277 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b512fd-bc5a-48cb-86d0-29078d4c7bf3 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:41.624954 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eca11-424c-4745-802b-a6f229793e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:41.625600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eca11-424c-4745-802b-a6f229793e6d admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:41.625889 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eca11-424c-4745-802b-a6f229793e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:41.626172 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eca11-424c-4745-802b-a6f229793e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:41.626915 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5eca11-424c-4745-802b-a6f229793e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:41.628813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5eca11-424c-4745-802b-a6f229793e6d admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:41.722490 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1434/2835] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:10:41 2022] POST /identity/v3/projects => generated 409 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:10:41.726908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41f53a-00ce-4a2d-b7a5-88251b09ab1b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:41.736790 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41f53a-00ce-4a2d-b7a5-88251b09ab1b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:41.793333 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c21e8-8340-4c1e-aee4-aaab104abede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:41.794003 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c21e8-8340-4c1e-aee4-aaab104abede admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:41.794291 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c21e8-8340-4c1e-aee4-aaab104abede admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:41.794605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c21e8-8340-4c1e-aee4-aaab104abede admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:41.795306 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c21e8-8340-4c1e-aee4-aaab104abede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:41.797220 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c21e8-8340-4c1e-aee4-aaab104abede admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:41.927180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1402/2836] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:10:41 2022] POST /identity/v3/users => generated 305 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:10:41.931215 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eca11-424c-4745-802b-a6f229793e6d admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:41.941409 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eca11-424c-4745-802b-a6f229793e6d admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:41.946186 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151ae89-ca1f-4307-be5a-a30ce77a2fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:41.946886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151ae89-ca1f-4307-be5a-a30ce77a2fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:41.947171 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151ae89-ca1f-4307-be5a-a30ce77a2fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:41.947447 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151ae89-ca1f-4307-be5a-a30ce77a2fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:41.948178 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151ae89-ca1f-4307-be5a-a30ce77a2fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:41.949822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151ae89-ca1f-4307-be5a-a30ce77a2fc5 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:41.960874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1435/2837] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:10:41.964719 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c21e8-8340-4c1e-aee4-aaab104abede admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:41.974506 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c21e8-8340-4c1e-aee4-aaab104abede admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:41.979866 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a1b84-357a-4d3c-b857-7d85917ade91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:41.980513 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a1b84-357a-4d3c-b857-7d85917ade91 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:41.980799 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a1b84-357a-4d3c-b857-7d85917ade91 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:41.981080 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a1b84-357a-4d3c-b857-7d85917ade91 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:41.981797 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a1b84-357a-4d3c-b857-7d85917ade91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:41.983400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a1b84-357a-4d3c-b857-7d85917ade91 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:41.993202 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1403/2838] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:10:41.997125 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151ae89-ca1f-4307-be5a-a30ce77a2fc5 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:42.006934 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151ae89-ca1f-4307-be5a-a30ce77a2fc5 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:42.011468 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84cd32-ba35-486d-af87-09141eeb1fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:42.012371 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84cd32-ba35-486d-af87-09141eeb1fec admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:42.012657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84cd32-ba35-486d-af87-09141eeb1fec admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:42.012937 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84cd32-ba35-486d-af87-09141eeb1fec admin admin] PATH_INFO: `/v3/projects/6b91d43244974655bdfabdaa406b0cca/users/eeaacefa6dec43b683c6faee0478209c/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:42.028640 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84cd32-ba35-486d-af87-09141eeb1fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b91d43244974655bdfabdaa406b0cca, user_id=eeaacefa6dec43b683c6faee0478209c, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:42.031353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84cd32-ba35-486d-af87-09141eeb1fec admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:42.112657 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1436/2839] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:10:41 2022] PUT /identity/v3/projects/6b91d43244974655bdfabdaa406b0cca/users/eeaacefa6dec43b683c6faee0478209c/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:42.122964 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68199c7-1f67-4894-b93c-ae945f3cecd3 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:42.123262 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68199c7-1f67-4894-b93c-ae945f3cecd3 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:42.123547 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68199c7-1f67-4894-b93c-ae945f3cecd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:42.151367 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-e68199c7-1f67-4894-b93c-ae945f3cecd3 None None] MFA Rules not processed for user `eeaacefa6dec43b683c6faee0478209c`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:42.152569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-e68199c7-1f67-4894-b93c-ae945f3cecd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:42.192961 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:42.215697 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1404/2840] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:42.220176 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84cd32-ba35-486d-af87-09141eeb1fec admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:42.267480 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:42.284622 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84cd32-ba35-486d-af87-09141eeb1fec admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:42.289231 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1446d-45c0-4b6b-a4b5-de488b5516da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:42.289885 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1446d-45c0-4b6b-a4b5-de488b5516da admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:42.290171 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1446d-45c0-4b6b-a4b5-de488b5516da admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:42.290495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1446d-45c0-4b6b-a4b5-de488b5516da admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:42.291196 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1446d-45c0-4b6b-a4b5-de488b5516da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:42.293090 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1446d-45c0-4b6b-a4b5-de488b5516da admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:42.425813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1437/2841] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:10:42 2022] POST /identity/v3/projects => generated 409 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:10:42.430012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68199c7-1f67-4894-b93c-ae945f3cecd3 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:42.440612 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68199c7-1f67-4894-b93c-ae945f3cecd3 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:42.497968 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b0130-6811-4fa3-ae1d-cd760d27cc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:42.498679 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b0130-6811-4fa3-ae1d-cd760d27cc7e admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:42.498970 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b0130-6811-4fa3-ae1d-cd760d27cc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:42.499254 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b0130-6811-4fa3-ae1d-cd760d27cc7e admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:42.499975 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b0130-6811-4fa3-ae1d-cd760d27cc7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:42.501897 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b0130-6811-4fa3-ae1d-cd760d27cc7e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:42.604828 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1405/2842] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:10:42 2022] POST /identity/v3/users => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:10:42.608593 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1446d-45c0-4b6b-a4b5-de488b5516da admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:42.619391 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1446d-45c0-4b6b-a4b5-de488b5516da admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:42.624285 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b680f-c2ff-41c1-b02c-e13d21cb10b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:42.624956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b680f-c2ff-41c1-b02c-e13d21cb10b2 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:42.625250 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b680f-c2ff-41c1-b02c-e13d21cb10b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:42.625568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b680f-c2ff-41c1-b02c-e13d21cb10b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:42.626310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b680f-c2ff-41c1-b02c-e13d21cb10b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:42.627995 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b680f-c2ff-41c1-b02c-e13d21cb10b2 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:42.639192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1438/2843] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:10:42.643233 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b0130-6811-4fa3-ae1d-cd760d27cc7e admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:42.653325 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b0130-6811-4fa3-ae1d-cd760d27cc7e admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:42.657842 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214bcc7-db9a-457e-9268-9d019b33dfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:42.658746 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214bcc7-db9a-457e-9268-9d019b33dfbc admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:42.659033 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214bcc7-db9a-457e-9268-9d019b33dfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:42.659314 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214bcc7-db9a-457e-9268-9d019b33dfbc admin admin] PATH_INFO: `/v3/projects/fc8b5e423bcf4df19a4868438ea33f8b/users/e5ee2cb5b08245dea3848a4ab0ef0e4f/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:42.673667 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214bcc7-db9a-457e-9268-9d019b33dfbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc8b5e423bcf4df19a4868438ea33f8b, user_id=e5ee2cb5b08245dea3848a4ab0ef0e4f, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:42.676336 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214bcc7-db9a-457e-9268-9d019b33dfbc admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:42.752595 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1406/2844] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:10:42 2022] PUT /identity/v3/projects/fc8b5e423bcf4df19a4868438ea33f8b/users/e5ee2cb5b08245dea3848a4ab0ef0e4f/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:10:42.757050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b680f-c2ff-41c1-b02c-e13d21cb10b2 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:42.767158 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b680f-c2ff-41c1-b02c-e13d21cb10b2 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:42.823879 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755468c-0c9e-4580-9d18-26b6bc860889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:42.824556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755468c-0c9e-4580-9d18-26b6bc860889 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:42.824844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755468c-0c9e-4580-9d18-26b6bc860889 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:42.825127 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755468c-0c9e-4580-9d18-26b6bc860889 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:42.825854 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755468c-0c9e-4580-9d18-26b6bc860889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:42.827495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755468c-0c9e-4580-9d18-26b6bc860889 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:42.837091 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1439/2845] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:10:42.841466 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214bcc7-db9a-457e-9268-9d019b33dfbc admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:42.851686 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214bcc7-db9a-457e-9268-9d019b33dfbc admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:42.856296 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bc1d2-c331-4787-a78d-e988dc25e6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:42.857162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bc1d2-c331-4787-a78d-e988dc25e6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:42.857447 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bc1d2-c331-4787-a78d-e988dc25e6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:42.857731 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4bc1d2-c331-4787-a78d-e988dc25e6c4 admin admin] PATH_INFO: `/v3/projects/fc8b5e423bcf4df19a4868438ea33f8b/users/e5ee2cb5b08245dea3848a4ab0ef0e4f/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:42.859696 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bc1d2-c331-4787-a78d-e988dc25e6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc8b5e423bcf4df19a4868438ea33f8b, user_id=e5ee2cb5b08245dea3848a4ab0ef0e4f, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:42.862330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4bc1d2-c331-4787-a78d-e988dc25e6c4 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:42.872753 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1407/2846] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:10:42 2022] PUT /identity/v3/projects/fc8b5e423bcf4df19a4868438ea33f8b/users/e5ee2cb5b08245dea3848a4ab0ef0e4f/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:42.884107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0645b-8ee5-4aa1-9c99-93f5f1385f0b None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:42.884400 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0645b-8ee5-4aa1-9c99-93f5f1385f0b None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:42.884690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0645b-8ee5-4aa1-9c99-93f5f1385f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:42.910244 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-fde0645b-8ee5-4aa1-9c99-93f5f1385f0b None None] MFA Rules not processed for user `e5ee2cb5b08245dea3848a4ab0ef0e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:42.911472 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-fde0645b-8ee5-4aa1-9c99-93f5f1385f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:42.978151 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1440/2847] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:42 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:42.990186 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bc1d2-c331-4787-a78d-e988dc25e6c4 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:42.992569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-eb4bc1d2-c331-4787-a78d-e988dc25e6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:43.050993 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4bc1d2-c331-4787-a78d-e988dc25e6c4 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:43.055269 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a72cd-0b01-4b5f-9488-f4d191f42b32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:43.055911 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a72cd-0b01-4b5f-9488-f4d191f42b32 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:43.056193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a72cd-0b01-4b5f-9488-f4d191f42b32 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:43.056470 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a72cd-0b01-4b5f-9488-f4d191f42b32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:43.065490 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a72cd-0b01-4b5f-9488-f4d191f42b32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:43.066950 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a72cd-0b01-4b5f-9488-f4d191f42b32 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:43.076191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1408/2848] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:10:42 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:10:43.392630 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0645b-8ee5-4aa1-9c99-93f5f1385f0b None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:43.402188 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0645b-8ee5-4aa1-9c99-93f5f1385f0b None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:43.405841 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc924e-8ec5-4195-9efa-6813d56dce80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:43.406505 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc924e-8ec5-4195-9efa-6813d56dce80 service cinder] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:43.406800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc924e-8ec5-4195-9efa-6813d56dce80 service cinder] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:43.407080 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc924e-8ec5-4195-9efa-6813d56dce80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:43.441342 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:43.471598 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc924e-8ec5-4195-9efa-6813d56dce80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:43.471892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc924e-8ec5-4195-9efa-6813d56dce80 service cinder] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:43.484248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1441/2849] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:10:43 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:10:50.065926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a72cd-0b01-4b5f-9488-f4d191f42b32 service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:50.107036 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:50.128005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a72cd-0b01-4b5f-9488-f4d191f42b32 service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:50.132605 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bcb10-16c5-413e-bb32-bf7fbdd1c650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:50.133466 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bcb10-16c5-413e-bb32-bf7fbdd1c650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:50.133749 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bcb10-16c5-413e-bb32-bf7fbdd1c650 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:50.134029 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bcb10-16c5-413e-bb32-bf7fbdd1c650 admin admin] PATH_INFO: `/v3/users/eeaacefa6dec43b683c6faee0478209c` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:50.135241 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bcb10-16c5-413e-bb32-bf7fbdd1c650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeaacefa6dec43b683c6faee0478209c)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:50.137166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bcb10-16c5-413e-bb32-bf7fbdd1c650 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:50.289626 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-4b5bcb10-16c5-413e-bb32-bf7fbdd1c650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeaacefa6dec43b683c6faee0478209c'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:50.290288 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-4b5bcb10-16c5-413e-bb32-bf7fbdd1c650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeaacefa6dec43b683c6faee0478209c'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:50.360931 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-4b5bcb10-16c5-413e-bb32-bf7fbdd1c650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeaacefa6dec43b683c6faee0478209c'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:50.372982 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-4b5bcb10-16c5-413e-bb32-bf7fbdd1c650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeaacefa6dec43b683c6faee0478209c'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:50.379846 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-4b5bcb10-16c5-413e-bb32-bf7fbdd1c650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeaacefa6dec43b683c6faee0478209c'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:50.387425 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1409/2850] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:10:50 2022] DELETE /identity/v3/users/eeaacefa6dec43b683c6faee0478209c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:50.392017 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23092082-7f26-4e95-bf95-3af2e11158be None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:50.392508 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23092082-7f26-4e95-bf95-3af2e11158be None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:50.392641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23092082-7f26-4e95-bf95-3af2e11158be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:50.410203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-23092082-7f26-4e95-bf95-3af2e11158be None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:50.411561 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-23092082-7f26-4e95-bf95-3af2e11158be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:50.473203 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1442/2851] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:50.480983 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bcb10-16c5-413e-bb32-bf7fbdd1c650 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:50.482385 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4b5bcb10-16c5-413e-bb32-bf7fbdd1c650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:50.539812 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bcb10-16c5-413e-bb32-bf7fbdd1c650 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:50.544942 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d00d3-81de-47fd-9738-837294820bfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:50.545586 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d00d3-81de-47fd-9738-837294820bfc service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:50.545908 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d00d3-81de-47fd-9738-837294820bfc service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:50.546189 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d00d3-81de-47fd-9738-837294820bfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:50.555725 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d00d3-81de-47fd-9738-837294820bfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:50.557147 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d00d3-81de-47fd-9738-837294820bfc service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:50.567012 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1410/2852] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:10:50.991164 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23092082-7f26-4e95-bf95-3af2e11158be None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:50.993134 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-23092082-7f26-4e95-bf95-3af2e11158be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:51.004339 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23092082-7f26-4e95-bf95-3af2e11158be None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:51.009050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edf3ca-2098-429d-9e43-8aff331bd08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:51.009907 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edf3ca-2098-429d-9e43-8aff331bd08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:51.010192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edf3ca-2098-429d-9e43-8aff331bd08c admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:51.010507 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edf3ca-2098-429d-9e43-8aff331bd08c admin admin] PATH_INFO: `/v3/projects/6b91d43244974655bdfabdaa406b0cca` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:51.011892 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edf3ca-2098-429d-9e43-8aff331bd08c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b91d43244974655bdfabdaa406b0cca)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:51.013931 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edf3ca-2098-429d-9e43-8aff331bd08c admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:51.144500 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d8edf3ca-2098-429d-9e43-8aff331bd08c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b91d43244974655bdfabdaa406b0cca', 'request_id': 'req-d8edf3ca-2098-429d-9e43-8aff331bd08c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:51.151474 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d8edf3ca-2098-429d-9e43-8aff331bd08c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b91d43244974655bdfabdaa406b0cca', 'request_id': 'req-d8edf3ca-2098-429d-9e43-8aff331bd08c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:51.159175 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d8edf3ca-2098-429d-9e43-8aff331bd08c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b91d43244974655bdfabdaa406b0cca', 'request_id': 'req-d8edf3ca-2098-429d-9e43-8aff331bd08c'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:51.254877 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d8edf3ca-2098-429d-9e43-8aff331bd08c admin admin] The token cache is being invalidate because project 6b91d43244974655bdfabdaa406b0cca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:10:51.255099 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d8edf3ca-2098-429d-9e43-8aff331bd08c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:51.255771 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d8edf3ca-2098-429d-9e43-8aff331bd08c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:51.257844 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1443/2853] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:10:50 2022] DELETE /identity/v3/projects/6b91d43244974655bdfabdaa406b0cca => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:51.261940 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d00d3-81de-47fd-9738-837294820bfc service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:51.271667 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d00d3-81de-47fd-9738-837294820bfc service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:51.327169 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291d543-17bd-446d-8a9a-81f529571db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:51.328046 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291d543-17bd-446d-8a9a-81f529571db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:51.328335 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291d543-17bd-446d-8a9a-81f529571db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:51.328614 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291d543-17bd-446d-8a9a-81f529571db2 admin admin] PATH_INFO: `/v3/users/e5ee2cb5b08245dea3848a4ab0ef0e4f` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:51.329791 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291d543-17bd-446d-8a9a-81f529571db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ee2cb5b08245dea3848a4ab0ef0e4f)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:51.331738 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291d543-17bd-446d-8a9a-81f529571db2 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:51.333214 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:51.555155 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-3291d543-17bd-446d-8a9a-81f529571db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ee2cb5b08245dea3848a4ab0ef0e4f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:51.556353 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-3291d543-17bd-446d-8a9a-81f529571db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ee2cb5b08245dea3848a4ab0ef0e4f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:51.637759 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-3291d543-17bd-446d-8a9a-81f529571db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ee2cb5b08245dea3848a4ab0ef0e4f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:51.650103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-3291d543-17bd-446d-8a9a-81f529571db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ee2cb5b08245dea3848a4ab0ef0e4f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:51.657211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-3291d543-17bd-446d-8a9a-81f529571db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ee2cb5b08245dea3848a4ab0ef0e4f'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:51.663130 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1411/2854] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:10:51 2022] DELETE /identity/v3/users/e5ee2cb5b08245dea3848a4ab0ef0e4f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:52.094212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edf3ca-2098-429d-9e43-8aff331bd08c admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:52.095641 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d8edf3ca-2098-429d-9e43-8aff331bd08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:52.109405 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edf3ca-2098-429d-9e43-8aff331bd08c admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:52.166031 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d11bad-f920-4ce8-85ec-c4ce994a9994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:52.166941 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d11bad-f920-4ce8-85ec-c4ce994a9994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:52.167230 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d11bad-f920-4ce8-85ec-c4ce994a9994 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:52.167510 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d11bad-f920-4ce8-85ec-c4ce994a9994 admin admin] PATH_INFO: `/v3/projects/fc8b5e423bcf4df19a4868438ea33f8b` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:52.168683 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d11bad-f920-4ce8-85ec-c4ce994a9994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc8b5e423bcf4df19a4868438ea33f8b)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:52.170691 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d11bad-f920-4ce8-85ec-c4ce994a9994 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:52.172258 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:52.287280 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-86d11bad-f920-4ce8-85ec-c4ce994a9994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc8b5e423bcf4df19a4868438ea33f8b', 'request_id': 'req-86d11bad-f920-4ce8-85ec-c4ce994a9994'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:52.293954 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-86d11bad-f920-4ce8-85ec-c4ce994a9994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc8b5e423bcf4df19a4868438ea33f8b', 'request_id': 'req-86d11bad-f920-4ce8-85ec-c4ce994a9994'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:52.299310 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-86d11bad-f920-4ce8-85ec-c4ce994a9994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc8b5e423bcf4df19a4868438ea33f8b', 'request_id': 'req-86d11bad-f920-4ce8-85ec-c4ce994a9994'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:52.368454 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-86d11bad-f920-4ce8-85ec-c4ce994a9994 admin admin] The token cache is being invalidate because project fc8b5e423bcf4df19a4868438ea33f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:10:52.368712 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-86d11bad-f920-4ce8-85ec-c4ce994a9994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:52.369916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-86d11bad-f920-4ce8-85ec-c4ce994a9994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:52.371550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1444/2855] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:10:52 2022] DELETE /identity/v3/projects/fc8b5e423bcf4df19a4868438ea33f8b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:52.376349 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65443fc-123e-44f4-80f1-7596cb6e7aae None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:52.376819 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65443fc-123e-44f4-80f1-7596cb6e7aae None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:52.376922 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65443fc-123e-44f4-80f1-7596cb6e7aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:52.394392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-b65443fc-123e-44f4-80f1-7596cb6e7aae None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:52.400346 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-b65443fc-123e-44f4-80f1-7596cb6e7aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:52.455044 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1412/2856] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:52.463243 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f4eb9-4371-4443-81e0-a59b89f39a17 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:52.463537 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f4eb9-4371-4443-81e0-a59b89f39a17 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:52.463824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f4eb9-4371-4443-81e0-a59b89f39a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:52.482846 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-301f4eb9-4371-4443-81e0-a59b89f39a17 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:52.484048 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-301f4eb9-4371-4443-81e0-a59b89f39a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:52.492008 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1445/2857] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:52.496157 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65443fc-123e-44f4-80f1-7596cb6e7aae None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:52.505926 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65443fc-123e-44f4-80f1-7596cb6e7aae None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:52.510541 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d4b41-3f20-4742-8879-195fa0a433bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:52.511193 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d4b41-3f20-4742-8879-195fa0a433bd admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:52.511483 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d4b41-3f20-4742-8879-195fa0a433bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:52.511765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d4b41-3f20-4742-8879-195fa0a433bd admin admin] PATH_INFO: `/v3/domains` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:52.512487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d4b41-3f20-4742-8879-195fa0a433bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:10:52.512799 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d4b41-3f20-4742-8879-195fa0a433bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:52.514413 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d4b41-3f20-4742-8879-195fa0a433bd admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:52.526575 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1413/2858] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:10:52.530642 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f4eb9-4371-4443-81e0-a59b89f39a17 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:52.540383 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f4eb9-4371-4443-81e0-a59b89f39a17 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:52.545044 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb488287-5e49-4b0b-bceb-8d846dbb90a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:52.545690 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb488287-5e49-4b0b-bceb-8d846dbb90a5 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:52.545978 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb488287-5e49-4b0b-bceb-8d846dbb90a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:52.546268 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb488287-5e49-4b0b-bceb-8d846dbb90a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:52.547023 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb488287-5e49-4b0b-bceb-8d846dbb90a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:52.548928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb488287-5e49-4b0b-bceb-8d846dbb90a5 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:52.633947 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1446/2859] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:10:52 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:10:52.637939 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d4b41-3f20-4742-8879-195fa0a433bd admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:52.648639 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d4b41-3f20-4742-8879-195fa0a433bd admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:52.703209 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c52f7e-0f02-4f96-9cfe-1cf6c316481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:52.703873 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c52f7e-0f02-4f96-9cfe-1cf6c316481d admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:52.704162 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c52f7e-0f02-4f96-9cfe-1cf6c316481d admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:52.704445 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c52f7e-0f02-4f96-9cfe-1cf6c316481d admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:52.705137 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c52f7e-0f02-4f96-9cfe-1cf6c316481d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:52.707073 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c52f7e-0f02-4f96-9cfe-1cf6c316481d admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:52.717045 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:52.775807 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1414/2860] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:10:52 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:10:52.779748 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb488287-5e49-4b0b-bceb-8d846dbb90a5 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:52.789824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb488287-5e49-4b0b-bceb-8d846dbb90a5 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:52.794430 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771c5dd-400c-4b64-9a1d-e0102701ea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:52.795093 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771c5dd-400c-4b64-9a1d-e0102701ea14 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:52.795382 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771c5dd-400c-4b64-9a1d-e0102701ea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:52.795663 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0771c5dd-400c-4b64-9a1d-e0102701ea14 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:52.796396 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771c5dd-400c-4b64-9a1d-e0102701ea14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:52.797994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0771c5dd-400c-4b64-9a1d-e0102701ea14 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:52.808144 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1447/2861] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:10:52.812065 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c52f7e-0f02-4f96-9cfe-1cf6c316481d admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:52.825304 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c52f7e-0f02-4f96-9cfe-1cf6c316481d admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:52.830106 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c7722-1515-416b-8d0c-90cf74ea7747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:52.830792 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c7722-1515-416b-8d0c-90cf74ea7747 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:52.831079 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c7722-1515-416b-8d0c-90cf74ea7747 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:52.831356 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c7722-1515-416b-8d0c-90cf74ea7747 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:52.832072 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c7722-1515-416b-8d0c-90cf74ea7747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:52.833682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c7722-1515-416b-8d0c-90cf74ea7747 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:52.845048 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1415/2862] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:10:52.849304 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771c5dd-400c-4b64-9a1d-e0102701ea14 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:52.859300 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0771c5dd-400c-4b64-9a1d-e0102701ea14 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:52.863836 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547d610-3529-4b67-a168-445dc16eebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:52.864709 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547d610-3529-4b67-a168-445dc16eebcb admin admin] REQUEST_METHOD: `PUT` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:52.864994 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547d610-3529-4b67-a168-445dc16eebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:52.865271 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547d610-3529-4b67-a168-445dc16eebcb admin admin] PATH_INFO: `/v3/projects/73a40e14adc54a7c83cbbc9ed80a5999/users/f8553e448ad543e19b672cfddd264267/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:52.879563 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547d610-3529-4b67-a168-445dc16eebcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=73a40e14adc54a7c83cbbc9ed80a5999, user_id=f8553e448ad543e19b672cfddd264267, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:52.882746 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547d610-3529-4b67-a168-445dc16eebcb admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:52.943851 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1448/2863] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:10:52 2022] PUT /identity/v3/projects/73a40e14adc54a7c83cbbc9ed80a5999/users/f8553e448ad543e19b672cfddd264267/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:52.954643 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabda87-7c57-485a-ae0d-981eba470ce7 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:52.954934 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabda87-7c57-485a-ae0d-981eba470ce7 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:52.955211 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabda87-7c57-485a-ae0d-981eba470ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:52.981663 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-aeabda87-7c57-485a-ae0d-981eba470ce7 None None] MFA Rules not processed for user `f8553e448ad543e19b672cfddd264267`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:52.983261 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-aeabda87-7c57-485a-ae0d-981eba470ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:53.048295 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1416/2864] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:53.052735 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547d610-3529-4b67-a168-445dc16eebcb admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:53.115415 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547d610-3529-4b67-a168-445dc16eebcb admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:53.120138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef1a71-f756-4c10-a42c-9bb9b5711172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:53.120799 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef1a71-f756-4c10-a42c-9bb9b5711172 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:53.121092 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef1a71-f756-4c10-a42c-9bb9b5711172 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:53.121407 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef1a71-f756-4c10-a42c-9bb9b5711172 admin admin] PATH_INFO: `/v3/projects` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:53.122113 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef1a71-f756-4c10-a42c-9bb9b5711172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:53.124066 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef1a71-f756-4c10-a42c-9bb9b5711172 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:53.226049 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1449/2865] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:10:53 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:10:53.229775 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabda87-7c57-485a-ae0d-981eba470ce7 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:53.240452 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeabda87-7c57-485a-ae0d-981eba470ce7 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:53.296008 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d7d6b-bd99-44e4-821b-21c2264dd402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:53.300290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d7d6b-bd99-44e4-821b-21c2264dd402 admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:53.300290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d7d6b-bd99-44e4-821b-21c2264dd402 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:53.300290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d7d6b-bd99-44e4-821b-21c2264dd402 admin admin] PATH_INFO: `/v3/users` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:53.300290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d7d6b-bd99-44e4-821b-21c2264dd402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:53.300290 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d7d6b-bd99-44e4-821b-21c2264dd402 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:53.399095 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1417/2866] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:10:53 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:10:53.403322 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef1a71-f756-4c10-a42c-9bb9b5711172 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:53.413701 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef1a71-f756-4c10-a42c-9bb9b5711172 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:53.418413 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20612a3a-598b-445c-bbf6-990e70ff6634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:53.419040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20612a3a-598b-445c-bbf6-990e70ff6634 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:53.419328 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20612a3a-598b-445c-bbf6-990e70ff6634 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:53.419610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20612a3a-598b-445c-bbf6-990e70ff6634 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:53.420343 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20612a3a-598b-445c-bbf6-990e70ff6634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:53.421946 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20612a3a-598b-445c-bbf6-990e70ff6634 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:53.427185 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:53.433119 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1450/2867] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:10:53.437180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d7d6b-bd99-44e4-821b-21c2264dd402 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:53.447646 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d7d6b-bd99-44e4-821b-21c2264dd402 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:53.452370 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b55fa8-1e35-48af-8b53-d491616db8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:53.453238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b55fa8-1e35-48af-8b53-d491616db8ca admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:53.453527 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b55fa8-1e35-48af-8b53-d491616db8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:53.453811 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b55fa8-1e35-48af-8b53-d491616db8ca admin admin] PATH_INFO: `/v3/projects/84b692a338a94c63bce107ef3c6f2f3d/users/11c009e195ec48569513662e22f125ec/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:53.470953 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b55fa8-1e35-48af-8b53-d491616db8ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b692a338a94c63bce107ef3c6f2f3d, user_id=11c009e195ec48569513662e22f125ec, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:53.473692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b55fa8-1e35-48af-8b53-d491616db8ca admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:53.574215 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1418/2868] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:10:53 2022] PUT /identity/v3/projects/84b692a338a94c63bce107ef3c6f2f3d/users/11c009e195ec48569513662e22f125ec/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:10:53.578138 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20612a3a-598b-445c-bbf6-990e70ff6634 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:53.588301 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20612a3a-598b-445c-bbf6-990e70ff6634 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:53.643974 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29e8c0-a5a1-4906-8970-428e685db798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:53.644644 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29e8c0-a5a1-4906-8970-428e685db798 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:53.644932 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29e8c0-a5a1-4906-8970-428e685db798 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:53.645215 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29e8c0-a5a1-4906-8970-428e685db798 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:53.645943 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29e8c0-a5a1-4906-8970-428e685db798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:53.647594 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb29e8c0-a5a1-4906-8970-428e685db798 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:53.657445 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1451/2869] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 20:10:53.661561 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b55fa8-1e35-48af-8b53-d491616db8ca admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:53.672373 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b55fa8-1e35-48af-8b53-d491616db8ca admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:53.677093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5aa1a-97b5-4f7f-ae1f-f1a6395c7fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:53.678004 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5aa1a-97b5-4f7f-ae1f-f1a6395c7fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:53.678330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5aa1a-97b5-4f7f-ae1f-f1a6395c7fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:53.679183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5aa1a-97b5-4f7f-ae1f-f1a6395c7fb7 admin admin] PATH_INFO: `/v3/projects/84b692a338a94c63bce107ef3c6f2f3d/users/11c009e195ec48569513662e22f125ec/roles/f84a80003ff94ef98290ceaeb0ef7c65` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:53.681185 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5aa1a-97b5-4f7f-ae1f-f1a6395c7fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84b692a338a94c63bce107ef3c6f2f3d, user_id=11c009e195ec48569513662e22f125ec, role_id=f84a80003ff94ef98290ceaeb0ef7c65)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:53.683859 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5aa1a-97b5-4f7f-ae1f-f1a6395c7fb7 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:53.694037 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1419/2870] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:10:53 2022] PUT /identity/v3/projects/84b692a338a94c63bce107ef3c6f2f3d/users/11c009e195ec48569513662e22f125ec/roles/f84a80003ff94ef98290ceaeb0ef7c65 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:53.753849 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936acae3-6bab-490a-af53-b6d04171a5a7 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:53.754081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936acae3-6bab-490a-af53-b6d04171a5a7 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:53.754360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936acae3-6bab-490a-af53-b6d04171a5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:53.781201 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-936acae3-6bab-490a-af53-b6d04171a5a7 None None] MFA Rules not processed for user `11c009e195ec48569513662e22f125ec`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:53.782462 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-936acae3-6bab-490a-af53-b6d04171a5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:53.848647 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1452/2871] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:53.859878 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5aa1a-97b5-4f7f-ae1f-f1a6395c7fb7 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:53.861569 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-0ce5aa1a-97b5-4f7f-ae1f-f1a6395c7fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:53.891702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:53.918516 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5aa1a-97b5-4f7f-ae1f-f1a6395c7fb7 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:53.922785 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18718b2-10c2-446b-ac2e-b6cc5bb1b766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:53.923433 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18718b2-10c2-446b-ac2e-b6cc5bb1b766 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:53.923723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18718b2-10c2-446b-ac2e-b6cc5bb1b766 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:53.924005 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18718b2-10c2-446b-ac2e-b6cc5bb1b766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:53.932910 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18718b2-10c2-446b-ac2e-b6cc5bb1b766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:53.934335 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18718b2-10c2-446b-ac2e-b6cc5bb1b766 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:53.943702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1420/2872] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:10:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:10:54.891980 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936acae3-6bab-490a-af53-b6d04171a5a7 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:54.954550 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936acae3-6bab-490a-af53-b6d04171a5a7 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:54.959020 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b46e2-b1d9-46f7-9d64-987bdc516b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:54.962246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b46e2-b1d9-46f7-9d64-987bdc516b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:54.962246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b46e2-b1d9-46f7-9d64-987bdc516b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:54.962246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b46e2-b1d9-46f7-9d64-987bdc516b89 admin admin] PATH_INFO: `/v3/users/f8553e448ad543e19b672cfddd264267` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:54.962246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b46e2-b1d9-46f7-9d64-987bdc516b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8553e448ad543e19b672cfddd264267)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:54.964110 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b46e2-b1d9-46f7-9d64-987bdc516b89 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:54.985628 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:55.148764 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-806b46e2-b1d9-46f7-9d64-987bdc516b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8553e448ad543e19b672cfddd264267'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:55.209140 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-806b46e2-b1d9-46f7-9d64-987bdc516b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8553e448ad543e19b672cfddd264267'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:55.209812 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-806b46e2-b1d9-46f7-9d64-987bdc516b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8553e448ad543e19b672cfddd264267'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:55.216871 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-806b46e2-b1d9-46f7-9d64-987bdc516b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8553e448ad543e19b672cfddd264267'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:55.229078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-806b46e2-b1d9-46f7-9d64-987bdc516b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8553e448ad543e19b672cfddd264267'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:55.235039 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1453/2873] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:10:54 2022] DELETE /identity/v3/users/f8553e448ad543e19b672cfddd264267 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:55.239578 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506feeba-a4f9-4957-b074-802de16a45a8 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:55.240058 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506feeba-a4f9-4957-b074-802de16a45a8 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:55.240164 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506feeba-a4f9-4957-b074-802de16a45a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:55.258096 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-506feeba-a4f9-4957-b074-802de16a45a8 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:55.259372 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-506feeba-a4f9-4957-b074-802de16a45a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:55.317192 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1421/2874] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:55.326902 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b46e2-b1d9-46f7-9d64-987bdc516b89 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:55.328351 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-806b46e2-b1d9-46f7-9d64-987bdc516b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:55.387181 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b46e2-b1d9-46f7-9d64-987bdc516b89 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:55.390870 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab10bef-9f8e-4d4d-bfd8-082dc7bf2bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:55.391511 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab10bef-9f8e-4d4d-bfd8-082dc7bf2bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:55.391800 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab10bef-9f8e-4d4d-bfd8-082dc7bf2bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:55.392081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab10bef-9f8e-4d4d-bfd8-082dc7bf2bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:55.401843 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab10bef-9f8e-4d4d-bfd8-082dc7bf2bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:55.403260 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab10bef-9f8e-4d4d-bfd8-082dc7bf2bc5 service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:55.412440 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1454/2875] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 20:10:55.964045 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506feeba-a4f9-4957-b074-802de16a45a8 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:55.968002 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-506feeba-a4f9-4957-b074-802de16a45a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:55.978150 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506feeba-a4f9-4957-b074-802de16a45a8 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:55.983168 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4d82c-3579-49b2-b30d-61619bc44741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:55.984043 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4d82c-3579-49b2-b30d-61619bc44741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:55.984330 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4d82c-3579-49b2-b30d-61619bc44741 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:55.984615 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4d82c-3579-49b2-b30d-61619bc44741 admin admin] PATH_INFO: `/v3/projects/73a40e14adc54a7c83cbbc9ed80a5999` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:55.985847 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4d82c-3579-49b2-b30d-61619bc44741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73a40e14adc54a7c83cbbc9ed80a5999)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:55.987871 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4d82c-3579-49b2-b30d-61619bc44741 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:56.099788 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-bbd4d82c-3579-49b2-b30d-61619bc44741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73a40e14adc54a7c83cbbc9ed80a5999', 'request_id': 'req-bbd4d82c-3579-49b2-b30d-61619bc44741'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:56.161147 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-bbd4d82c-3579-49b2-b30d-61619bc44741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73a40e14adc54a7c83cbbc9ed80a5999', 'request_id': 'req-bbd4d82c-3579-49b2-b30d-61619bc44741'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:56.168660 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-bbd4d82c-3579-49b2-b30d-61619bc44741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73a40e14adc54a7c83cbbc9ed80a5999', 'request_id': 'req-bbd4d82c-3579-49b2-b30d-61619bc44741'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:56.179029 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-bbd4d82c-3579-49b2-b30d-61619bc44741 admin admin] The token cache is being invalidate because project 73a40e14adc54a7c83cbbc9ed80a5999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:10:56.179323 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-bbd4d82c-3579-49b2-b30d-61619bc44741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:56.179955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-bbd4d82c-3579-49b2-b30d-61619bc44741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:56.181487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1422/2876] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:10:55 2022] DELETE /identity/v3/projects/73a40e14adc54a7c83cbbc9ed80a5999 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:56.185497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab10bef-9f8e-4d4d-bfd8-082dc7bf2bc5 service neutron] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:56.195051 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab10bef-9f8e-4d4d-bfd8-082dc7bf2bc5 service neutron] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:56.251005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374098e2-d618-4536-a583-d538190fc832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:56.251999 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374098e2-d618-4536-a583-d538190fc832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:56.252284 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374098e2-d618-4536-a583-d538190fc832 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:56.252565 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374098e2-d618-4536-a583-d538190fc832 admin admin] PATH_INFO: `/v3/users/11c009e195ec48569513662e22f125ec` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:56.253763 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374098e2-d618-4536-a583-d538190fc832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11c009e195ec48569513662e22f125ec)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:56.255760 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374098e2-d618-4536-a583-d538190fc832 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:56.430612 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:56.432289 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-374098e2-d618-4536-a583-d538190fc832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11c009e195ec48569513662e22f125ec'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:56.523857 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-374098e2-d618-4536-a583-d538190fc832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11c009e195ec48569513662e22f125ec'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:56.524517 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-374098e2-d618-4536-a583-d538190fc832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11c009e195ec48569513662e22f125ec'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:56.532102 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-374098e2-d618-4536-a583-d538190fc832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11c009e195ec48569513662e22f125ec'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:56.544192 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-374098e2-d618-4536-a583-d538190fc832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11c009e195ec48569513662e22f125ec'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:56.549912 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1455/2877] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:10:56 2022] DELETE /identity/v3/users/11c009e195ec48569513662e22f125ec => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:56.971021 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4d82c-3579-49b2-b30d-61619bc44741 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:56.972500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-bbd4d82c-3579-49b2-b30d-61619bc44741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:56.985563 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4d82c-3579-49b2-b30d-61619bc44741 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:57.035500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:57.044062 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb34bd13-302c-47c3-94a2-fc6afb8549f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:57.046623 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34bd13-302c-47c3-94a2-fc6afb8549f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:57.046623 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34bd13-302c-47c3-94a2-fc6afb8549f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:57.046623 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb34bd13-302c-47c3-94a2-fc6afb8549f6 admin admin] PATH_INFO: `/v3/projects/84b692a338a94c63bce107ef3c6f2f3d` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:57.047074 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34bd13-302c-47c3-94a2-fc6afb8549f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84b692a338a94c63bce107ef3c6f2f3d)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:57.048559 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb34bd13-302c-47c3-94a2-fc6afb8549f6 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:57.156205 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-eb34bd13-302c-47c3-94a2-fc6afb8549f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84b692a338a94c63bce107ef3c6f2f3d', 'request_id': 'req-eb34bd13-302c-47c3-94a2-fc6afb8549f6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:57.226702 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-eb34bd13-302c-47c3-94a2-fc6afb8549f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84b692a338a94c63bce107ef3c6f2f3d', 'request_id': 'req-eb34bd13-302c-47c3-94a2-fc6afb8549f6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:57.233099 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-eb34bd13-302c-47c3-94a2-fc6afb8549f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84b692a338a94c63bce107ef3c6f2f3d', 'request_id': 'req-eb34bd13-302c-47c3-94a2-fc6afb8549f6'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:57.243936 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-eb34bd13-302c-47c3-94a2-fc6afb8549f6 admin admin] The token cache is being invalidate because project 84b692a338a94c63bce107ef3c6f2f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:10:57.252588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-eb34bd13-302c-47c3-94a2-fc6afb8549f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:57.252588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-eb34bd13-302c-47c3-94a2-fc6afb8549f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:10:57.252588 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1423/2878] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:10:56 2022] DELETE /identity/v3/projects/84b692a338a94c63bce107ef3c6f2f3d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:10:57.252955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c6303-9380-4e65-8549-2039edce07a6 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:57.252955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c6303-9380-4e65-8549-2039edce07a6 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:57.252955 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c6303-9380-4e65-8549-2039edce07a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:57.269702 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-f52c6303-9380-4e65-8549-2039edce07a6 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:57.270922 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f52c6303-9380-4e65-8549-2039edce07a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:57.330957 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1456/2879] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:57.338944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48c8aa-0b64-441c-81df-1c118d743f65 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:57.339240 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48c8aa-0b64-441c-81df-1c118d743f65 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:57.339522 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48c8aa-0b64-441c-81df-1c118d743f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:57.358064 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-4a48c8aa-0b64-441c-81df-1c118d743f65 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:57.359270 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-4a48c8aa-0b64-441c-81df-1c118d743f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:57.367637 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1424/2880] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:57.371939 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c6303-9380-4e65-8549-2039edce07a6 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:57.381918 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c6303-9380-4e65-8549-2039edce07a6 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:57.386722 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a2bc4-265b-41cf-9f1c-2e50efff6afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:57.388232 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a2bc4-265b-41cf-9f1c-2e50efff6afe admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:57.388531 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a2bc4-265b-41cf-9f1c-2e50efff6afe admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:57.388815 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a2bc4-265b-41cf-9f1c-2e50efff6afe admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:57.389551 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a2bc4-265b-41cf-9f1c-2e50efff6afe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:10:57.389868 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a2bc4-265b-41cf-9f1c-2e50efff6afe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:57.391602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a2bc4-265b-41cf-9f1c-2e50efff6afe admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:57.403411 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1457/2881] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:10:57.407526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48c8aa-0b64-441c-81df-1c118d743f65 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:57.417320 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48c8aa-0b64-441c-81df-1c118d743f65 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:57.421895 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ac5fd-68c8-4427-b0cb-3c321662a26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:57.422562 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ac5fd-68c8-4427-b0cb-3c321662a26f admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:57.422873 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ac5fd-68c8-4427-b0cb-3c321662a26f admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:57.423124 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ac5fd-68c8-4427-b0cb-3c321662a26f admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:57.423817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ac5fd-68c8-4427-b0cb-3c321662a26f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:57.425692 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ac5fd-68c8-4427-b0cb-3c321662a26f admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:57.531711 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1425/2882] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:10:57 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:10:57.535790 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a2bc4-265b-41cf-9f1c-2e50efff6afe admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:57.546645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a2bc4-265b-41cf-9f1c-2e50efff6afe admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:57.603057 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be10104-83b5-454d-ae18-b63fa97d0115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:57.603663 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10104-83b5-454d-ae18-b63fa97d0115 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:57.603956 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10104-83b5-454d-ae18-b63fa97d0115 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:57.604241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be10104-83b5-454d-ae18-b63fa97d0115 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:57.604939 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be10104-83b5-454d-ae18-b63fa97d0115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:57.606910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be10104-83b5-454d-ae18-b63fa97d0115 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:57.735296 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1458/2883] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:10:57 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:10:57.739183 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ac5fd-68c8-4427-b0cb-3c321662a26f admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:57.749410 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ac5fd-68c8-4427-b0cb-3c321662a26f admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:57.754057 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35c3b1-b85f-49a3-834a-318f93221f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:57.754756 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35c3b1-b85f-49a3-834a-318f93221f8a admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:57.755050 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35c3b1-b85f-49a3-834a-318f93221f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:57.755338 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35c3b1-b85f-49a3-834a-318f93221f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:57.756071 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35c3b1-b85f-49a3-834a-318f93221f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:57.757706 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b35c3b1-b85f-49a3-834a-318f93221f8a admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:57.768314 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1426/2884] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:10:57.772920 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be10104-83b5-454d-ae18-b63fa97d0115 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:57.783251 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be10104-83b5-454d-ae18-b63fa97d0115 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:57.788620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ff4b3-214a-467d-bf78-4875219172c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:57.789353 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ff4b3-214a-467d-bf78-4875219172c0 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:57.789644 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ff4b3-214a-467d-bf78-4875219172c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:57.789928 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ff4b3-214a-467d-bf78-4875219172c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:57.790711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ff4b3-214a-467d-bf78-4875219172c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:57.792419 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ff4b3-214a-467d-bf78-4875219172c0 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:57.802327 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1459/2885] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:10:57.806375 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35c3b1-b85f-49a3-834a-318f93221f8a admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:57.816374 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35c3b1-b85f-49a3-834a-318f93221f8a admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:57.821136 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917bf11-7a77-470c-835a-77b63fb24dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:57.822017 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917bf11-7a77-470c-835a-77b63fb24dab admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:57.822305 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917bf11-7a77-470c-835a-77b63fb24dab admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:57.822621 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917bf11-7a77-470c-835a-77b63fb24dab admin admin] PATH_INFO: `/v3/projects/75b591a1456a49cb8bf2de63de8cba01/users/7826e23ec1b84ef8bc1f8892f2ae6803/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:57.837794 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917bf11-7a77-470c-835a-77b63fb24dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b591a1456a49cb8bf2de63de8cba01, user_id=7826e23ec1b84ef8bc1f8892f2ae6803, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:57.840544 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917bf11-7a77-470c-835a-77b63fb24dab admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:57.923998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1427/2886] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:10:57 2022] PUT /identity/v3/projects/75b591a1456a49cb8bf2de63de8cba01/users/7826e23ec1b84ef8bc1f8892f2ae6803/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 20:10:57.934143 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa9a2d-9040-4566-b397-256ee21a16d8 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:57.934558 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa9a2d-9040-4566-b397-256ee21a16d8 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:57.934855 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa9a2d-9040-4566-b397-256ee21a16d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:57.962170 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-23fa9a2d-9040-4566-b397-256ee21a16d8 None None] MFA Rules not processed for user `7826e23ec1b84ef8bc1f8892f2ae6803`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:10:57.963422 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-23fa9a2d-9040-4566-b397-256ee21a16d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:57.979745 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:10:58.026793 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1460/2887] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:10:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:10:58.037798 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917bf11-7a77-470c-835a-77b63fb24dab admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:10:58.039620 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-f917bf11-7a77-470c-835a-77b63fb24dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:10:58.096974 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917bf11-7a77-470c-835a-77b63fb24dab admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:10:58.100625 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf8497-3d55-4ce8-bc3f-daa85098955e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:10:58.101270 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf8497-3d55-4ce8-bc3f-daa85098955e service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:10:58.101557 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf8497-3d55-4ce8-bc3f-daa85098955e service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:10:58.101836 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf8497-3d55-4ce8-bc3f-daa85098955e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:10:58.110001 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf8497-3d55-4ce8-bc3f-daa85098955e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:10:58.111457 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf8497-3d55-4ce8-bc3f-daa85098955e service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:10:58.120198 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1428/2888] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:10:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:11:08.072297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=19 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:08.116197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:12.850913 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa9a2d-9040-4566-b397-256ee21a16d8 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:12.911586 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa9a2d-9040-4566-b397-256ee21a16d8 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:12.916050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d8fdc-7c0c-465a-ac60-97bfb9320e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:12.916916 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d8fdc-7c0c-465a-ac60-97bfb9320e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:12.917202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d8fdc-7c0c-465a-ac60-97bfb9320e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:12.917487 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d8fdc-7c0c-465a-ac60-97bfb9320e01 admin admin] PATH_INFO: `/v3/users/7826e23ec1b84ef8bc1f8892f2ae6803` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:12.918816 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d8fdc-7c0c-465a-ac60-97bfb9320e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7826e23ec1b84ef8bc1f8892f2ae6803)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:12.920748 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d8fdc-7c0c-465a-ac60-97bfb9320e01 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:13.085365 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-f73d8fdc-7c0c-465a-ac60-97bfb9320e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7826e23ec1b84ef8bc1f8892f2ae6803'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:13.134671 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-f73d8fdc-7c0c-465a-ac60-97bfb9320e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7826e23ec1b84ef8bc1f8892f2ae6803'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:13.135292 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-f73d8fdc-7c0c-465a-ac60-97bfb9320e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7826e23ec1b84ef8bc1f8892f2ae6803'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:13.142448 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-f73d8fdc-7c0c-465a-ac60-97bfb9320e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7826e23ec1b84ef8bc1f8892f2ae6803'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:13.155446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-f73d8fdc-7c0c-465a-ac60-97bfb9320e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7826e23ec1b84ef8bc1f8892f2ae6803'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:13.161297 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1461/2889] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:11:12 2022] DELETE /identity/v3/users/7826e23ec1b84ef8bc1f8892f2ae6803 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:11:13.165998 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651988f-6749-4337-a2ac-835d18c19ab8 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:13.166529 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651988f-6749-4337-a2ac-835d18c19ab8 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:13.166626 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651988f-6749-4337-a2ac-835d18c19ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:13.183817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-d651988f-6749-4337-a2ac-835d18c19ab8 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:11:13.193078 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d651988f-6749-4337-a2ac-835d18c19ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:13.243990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1429/2890] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:11:13.253378 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d8fdc-7c0c-465a-ac60-97bfb9320e01 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:13.254813 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-f73d8fdc-7c0c-465a-ac60-97bfb9320e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:13.312906 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d8fdc-7c0c-465a-ac60-97bfb9320e01 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:13.316556 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a36f9-2d59-44c0-8e36-0991906f79be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:13.317199 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a36f9-2d59-44c0-8e36-0991906f79be service neutron] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:13.317484 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a36f9-2d59-44c0-8e36-0991906f79be service neutron] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:13.317762 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a36f9-2d59-44c0-8e36-0991906f79be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:13.327464 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a36f9-2d59-44c0-8e36-0991906f79be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:13.328896 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a36f9-2d59-44c0-8e36-0991906f79be service neutron] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:13.338373 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1462/2891] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:11:13.742132 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651988f-6749-4337-a2ac-835d18c19ab8 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:13.743678 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-d651988f-6749-4337-a2ac-835d18c19ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:13.757166 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651988f-6749-4337-a2ac-835d18c19ab8 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:13.761859 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52265f40-7e6c-472e-a054-fff6abd26287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:13.765668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52265f40-7e6c-472e-a054-fff6abd26287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:13.765668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52265f40-7e6c-472e-a054-fff6abd26287 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:13.765668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52265f40-7e6c-472e-a054-fff6abd26287 admin admin] PATH_INFO: `/v3/projects/75b591a1456a49cb8bf2de63de8cba01` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:13.765668 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52265f40-7e6c-472e-a054-fff6abd26287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75b591a1456a49cb8bf2de63de8cba01)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:13.766553 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52265f40-7e6c-472e-a054-fff6abd26287 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:13.878273 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-52265f40-7e6c-472e-a054-fff6abd26287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75b591a1456a49cb8bf2de63de8cba01', 'request_id': 'req-52265f40-7e6c-472e-a054-fff6abd26287'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:13.946000 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-52265f40-7e6c-472e-a054-fff6abd26287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75b591a1456a49cb8bf2de63de8cba01', 'request_id': 'req-52265f40-7e6c-472e-a054-fff6abd26287'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:13.952332 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-52265f40-7e6c-472e-a054-fff6abd26287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75b591a1456a49cb8bf2de63de8cba01', 'request_id': 'req-52265f40-7e6c-472e-a054-fff6abd26287'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:13.962452 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-52265f40-7e6c-472e-a054-fff6abd26287 admin admin] The token cache is being invalidate because project 75b591a1456a49cb8bf2de63de8cba01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:11:13.962746 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-52265f40-7e6c-472e-a054-fff6abd26287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:13.963400 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-52265f40-7e6c-472e-a054-fff6abd26287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:13.964975 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1430/2892] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:11:13 2022] DELETE /identity/v3/projects/75b591a1456a49cb8bf2de63de8cba01 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:11:13.969958 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6437f6-5012-43ab-b640-6ff7605311b1 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:13.975387 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6437f6-5012-43ab-b640-6ff7605311b1 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:13.975387 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6437f6-5012-43ab-b640-6ff7605311b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:13.988349 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-ca6437f6-5012-43ab-b640-6ff7605311b1 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:11:13.989551 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-ca6437f6-5012-43ab-b640-6ff7605311b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:14.007508 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:14.049853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1463/2893] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:11:14.057816 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f0adc-125c-406b-a195-06458de96940 None None] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:14.058108 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f0adc-125c-406b-a195-06458de96940 None None] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:14.058421 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f0adc-125c-406b-a195-06458de96940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:14.076723 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.auth.core [None req-473f0adc-125c-406b-a195-06458de96940 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:11:14.077952 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-473f0adc-125c-406b-a195-06458de96940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:14.086481 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1431/2894] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:11:14.090695 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6437f6-5012-43ab-b640-6ff7605311b1 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:14.100360 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6437f6-5012-43ab-b640-6ff7605311b1 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:14.105470 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296dde1-15a1-4cc6-9866-28f686643e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:14.106121 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296dde1-15a1-4cc6-9866-28f686643e20 admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:14.106439 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296dde1-15a1-4cc6-9866-28f686643e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:14.106720 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296dde1-15a1-4cc6-9866-28f686643e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:14.107446 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296dde1-15a1-4cc6-9866-28f686643e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 20:11:14.107756 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296dde1-15a1-4cc6-9866-28f686643e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:14.109369 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296dde1-15a1-4cc6-9866-28f686643e20 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:14.121217 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1464/2895] 10.222.0.15 () {58 vars in 1152 bytes} [Fri May 27 20:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 20:11:14.125345 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f0adc-125c-406b-a195-06458de96940 None None] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:14.134592 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f0adc-125c-406b-a195-06458de96940 None None] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:14.139180 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c142f3b-4065-4aad-95d8-3b3918f4ee2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:14.139823 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c142f3b-4065-4aad-95d8-3b3918f4ee2e admin admin] REQUEST_METHOD: `POST` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:14.140112 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c142f3b-4065-4aad-95d8-3b3918f4ee2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:14.140394 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c142f3b-4065-4aad-95d8-3b3918f4ee2e admin admin] PATH_INFO: `/v3/projects` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:14.141096 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c142f3b-4065-4aad-95d8-3b3918f4ee2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:14.143022 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c142f3b-4065-4aad-95d8-3b3918f4ee2e admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:14.314059 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1432/2896] 10.222.0.15 () {60 vars in 1152 bytes} [Fri May 27 20:11:14 2022] POST /identity/v3/projects => generated 389 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:11:14.318005 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296dde1-15a1-4cc6-9866-28f686643e20 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:14.327998 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296dde1-15a1-4cc6-9866-28f686643e20 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:14.384711 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd8a2a-082b-4cc6-a12e-c49406066c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:14.385311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd8a2a-082b-4cc6-a12e-c49406066c29 admin admin] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:14.385600 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd8a2a-082b-4cc6-a12e-c49406066c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:14.385881 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd8a2a-082b-4cc6-a12e-c49406066c29 admin admin] PATH_INFO: `/v3/users` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:14.386620 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd8a2a-082b-4cc6-a12e-c49406066c29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:14.388614 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd8a2a-082b-4cc6-a12e-c49406066c29 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:14.481645 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1465/2897] 10.222.0.15 () {60 vars in 1143 bytes} [Fri May 27 20:11:14 2022] POST /identity/v3/users => generated 295 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 20:11:14.485670 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c142f3b-4065-4aad-95d8-3b3918f4ee2e admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:14.496403 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c142f3b-4065-4aad-95d8-3b3918f4ee2e admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:14.501188 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fb12b-72c0-4f15-8aa9-8d25d086db00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:14.501877 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fb12b-72c0-4f15-8aa9-8d25d086db00 admin admin] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:14.502170 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fb12b-72c0-4f15-8aa9-8d25d086db00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:14.502491 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72fb12b-72c0-4f15-8aa9-8d25d086db00 admin admin] PATH_INFO: `/v3/roles` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:14.503230 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fb12b-72c0-4f15-8aa9-8d25d086db00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:14.504876 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72fb12b-72c0-4f15-8aa9-8d25d086db00 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:14.516092 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1433/2898] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:11:14.520187 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd8a2a-082b-4cc6-a12e-c49406066c29 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:14.530959 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd8a2a-082b-4cc6-a12e-c49406066c29 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:14.535646 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267779df-b3ee-45c9-aaa6-687c1c1b68bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:14.536311 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267779df-b3ee-45c9-aaa6-687c1c1b68bc admin admin] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:14.536602 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267779df-b3ee-45c9-aaa6-687c1c1b68bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:14.536886 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267779df-b3ee-45c9-aaa6-687c1c1b68bc admin admin] PATH_INFO: `/v3/roles` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:14.537622 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267779df-b3ee-45c9-aaa6-687c1c1b68bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:14.539293 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267779df-b3ee-45c9-aaa6-687c1c1b68bc admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:14.549100 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1466/2899] 10.222.0.15 () {58 vars in 1121 bytes} [Fri May 27 20:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 20:11:14.553258 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fb12b-72c0-4f15-8aa9-8d25d086db00 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:14.563111 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72fb12b-72c0-4f15-8aa9-8d25d086db00 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:14.567682 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba1987-b0ac-4010-989e-7d6106f3abfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:14.569063 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba1987-b0ac-4010-989e-7d6106f3abfd admin admin] REQUEST_METHOD: `PUT` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:14.569347 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba1987-b0ac-4010-989e-7d6106f3abfd admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:14.569625 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba1987-b0ac-4010-989e-7d6106f3abfd admin admin] PATH_INFO: `/v3/projects/182409bc5daa435a82a1d6590f1e3b8e/users/9d56746ff369494b863e6be0f12e6ba3/roles/c638961e289c4d108d8c584cb350a509` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:14.584729 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba1987-b0ac-4010-989e-7d6106f3abfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=182409bc5daa435a82a1d6590f1e3b8e, user_id=9d56746ff369494b863e6be0f12e6ba3, role_id=c638961e289c4d108d8c584cb350a509)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:14.589857 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba1987-b0ac-4010-989e-7d6106f3abfd admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:14.671665 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1434/2900] 10.222.0.15 () {60 vars in 1482 bytes} [Fri May 27 20:11:14 2022] PUT /identity/v3/projects/182409bc5daa435a82a1d6590f1e3b8e/users/9d56746ff369494b863e6be0f12e6ba3/roles/c638961e289c4d108d8c584cb350a509 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:11:14.681853 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ec78f-51b6-4b9b-8009-095028941aa5 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:14.682184 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ec78f-51b6-4b9b-8009-095028941aa5 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:14.682511 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ec78f-51b6-4b9b-8009-095028941aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:14.708939 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-451ec78f-51b6-4b9b-8009-095028941aa5 None None] MFA Rules not processed for user `9d56746ff369494b863e6be0f12e6ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:11:14.710741 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-451ec78f-51b6-4b9b-8009-095028941aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:14.773599 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1467/2901] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:11:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 20:11:14.784334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba1987-b0ac-4010-989e-7d6106f3abfd admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:14.786018 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-5aba1987-b0ac-4010-989e-7d6106f3abfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:14.808207 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:14.843507 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba1987-b0ac-4010-989e-7d6106f3abfd admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:14.847314 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd2fcc-abef-411e-a3a0-402796119165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a892d3f80464f9e9ced137c5de8bd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:14.853069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd2fcc-abef-411e-a3a0-402796119165 service cinder] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:14.853069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd2fcc-abef-411e-a3a0-402796119165 service cinder] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:14.853069 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd2fcc-abef-411e-a3a0-402796119165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:14.856674 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd2fcc-abef-411e-a3a0-402796119165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:14.858093 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd2fcc-abef-411e-a3a0-402796119165 service cinder] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:14.867442 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1435/2902] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:11:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:11:20.371502 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ec78f-51b6-4b9b-8009-095028941aa5 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:20.374495 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-451ec78f-51b6-4b9b-8009-095028941aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:20.397081 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:20.512807 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ec78f-51b6-4b9b-8009-095028941aa5 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:20.518581 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff41a90-e9ac-4cb9-91b1-50cb6e1c0f4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '105353b6b1a941ac81df7ad35567ba7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:20.519241 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff41a90-e9ac-4cb9-91b1-50cb6e1c0f4d service nova] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:20.519539 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff41a90-e9ac-4cb9-91b1-50cb6e1c0f4d service nova] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:20.519824 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff41a90-e9ac-4cb9-91b1-50cb6e1c0f4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:20.522513 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-eff41a90-e9ac-4cb9-91b1-50cb6e1c0f4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:20.535596 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff41a90-e9ac-4cb9-91b1-50cb6e1c0f4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:20.537195 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff41a90-e9ac-4cb9-91b1-50cb6e1c0f4d service nova] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:20.548107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1468/2903] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:11:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:11:24.905362 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=17 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:26.559487 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd2fcc-abef-411e-a3a0-402796119165 service cinder] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:26.672127 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd2fcc-abef-411e-a3a0-402796119165 service cinder] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:26.677955 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093fcf6-d831-46ec-a7c9-3faecec60c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:26.678999 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093fcf6-d831-46ec-a7c9-3faecec60c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:26.679392 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093fcf6-d831-46ec-a7c9-3faecec60c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:26.679887 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093fcf6-d831-46ec-a7c9-3faecec60c74 admin admin] PATH_INFO: `/v3/users/9d56746ff369494b863e6be0f12e6ba3` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:26.681406 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093fcf6-d831-46ec-a7c9-3faecec60c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d56746ff369494b863e6be0f12e6ba3)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:26.684251 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093fcf6-d831-46ec-a7c9-3faecec60c74 admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:26.854774 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7093fcf6-d831-46ec-a7c9-3faecec60c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d56746ff369494b863e6be0f12e6ba3'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:26.855817 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7093fcf6-d831-46ec-a7c9-3faecec60c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d56746ff369494b863e6be0f12e6ba3'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:26.914630 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7093fcf6-d831-46ec-a7c9-3faecec60c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d56746ff369494b863e6be0f12e6ba3'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:26.927179 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7093fcf6-d831-46ec-a7c9-3faecec60c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d56746ff369494b863e6be0f12e6ba3'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:26.934672 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-7093fcf6-d831-46ec-a7c9-3faecec60c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d56746ff369494b863e6be0f12e6ba3'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:26.940724 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1436/2904] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:11:26 2022] DELETE /identity/v3/users/9d56746ff369494b863e6be0f12e6ba3 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:11:26.946111 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cccfc-5277-468b-abb8-13a356a2ea98 None None] REQUEST_METHOD: `POST` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:26.946601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cccfc-5277-468b-abb8-13a356a2ea98 None None] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:26.946601 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cccfc-5277-468b-abb8-13a356a2ea98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:26.989797 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.auth.core [None req-560cccfc-5277-468b-abb8-13a356a2ea98 None None] MFA Rules not processed for user `446effb9e1f24b71a4cffe88e4bce86a`. Rule list: `[]` (Enabled: `True`). {{(pid=92145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 20:11:26.991568 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-560cccfc-5277-468b-abb8-13a356a2ea98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:27.054707 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1469/2905] 10.222.0.15 () {58 vars in 957 bytes} [Fri May 27 20:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 20:11:27.064448 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093fcf6-d831-46ec-a7c9-3faecec60c74 admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:27.065869 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-7093fcf6-d831-46ec-a7c9-3faecec60c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:27.118651 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:27.154502 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093fcf6-d831-46ec-a7c9-3faecec60c74 admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:27.158466 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d79f0-3581-469f-9c75-2d42d482c020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af7e51b89f4c4dcc9963061e6e509eb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:27.159234 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d79f0-3581-469f-9c75-2d42d482c020 service neutron] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:27.159582 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d79f0-3581-469f-9c75-2d42d482c020 service neutron] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:27.159935 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d79f0-3581-469f-9c75-2d42d482c020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:27.171581 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d79f0-3581-469f-9c75-2d42d482c020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:27.172996 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d79f0-3581-469f-9c75-2d42d482c020 service neutron] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:27.184300 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1437/2906] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:11:27.674253 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cccfc-5277-468b-abb8-13a356a2ea98 None None] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:27.676078 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-560cccfc-5277-468b-abb8-13a356a2ea98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:27.688202 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cccfc-5277-468b-abb8-13a356a2ea98 None None] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:27.693182 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6ced0-4348-4974-b685-2196d0388d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:27.694246 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6ced0-4348-4974-b685-2196d0388d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:27.694571 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6ced0-4348-4974-b685-2196d0388d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:27.694852 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6ced0-4348-4974-b685-2196d0388d59 admin admin] PATH_INFO: `/v3/projects/182409bc5daa435a82a1d6590f1e3b8e` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:27.696040 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6ced0-4348-4974-b685-2196d0388d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=182409bc5daa435a82a1d6590f1e3b8e)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:27.697962 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6ced0-4348-4974-b685-2196d0388d59 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:27.867736 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:27.881082 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-80a6ced0-4348-4974-b685-2196d0388d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '182409bc5daa435a82a1d6590f1e3b8e', 'request_id': 'req-80a6ced0-4348-4974-b685-2196d0388d59'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:27.889107 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-80a6ced0-4348-4974-b685-2196d0388d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '182409bc5daa435a82a1d6590f1e3b8e', 'request_id': 'req-80a6ced0-4348-4974-b685-2196d0388d59'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:27.898302 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-80a6ced0-4348-4974-b685-2196d0388d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '182409bc5daa435a82a1d6590f1e3b8e', 'request_id': 'req-80a6ced0-4348-4974-b685-2196d0388d59'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:27.980822 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-80a6ced0-4348-4974-b685-2196d0388d59 admin admin] The token cache is being invalidate because project 182409bc5daa435a82a1d6590f1e3b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:11:27.981542 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-80a6ced0-4348-4974-b685-2196d0388d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:27.982050 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-80a6ced0-4348-4974-b685-2196d0388d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:27.984056 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1470/2907] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:11:27 2022] DELETE /identity/v3/projects/182409bc5daa435a82a1d6590f1e3b8e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:11:28.337334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d79f0-3581-469f-9c75-2d42d482c020 service neutron] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:28.337334 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-7f7d79f0-3581-469f-9c75-2d42d482c020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:28.424120 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d79f0-3581-469f-9c75-2d42d482c020 service neutron] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:28.491949 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d444f63-3b33-4732-9bcd-7ff77e22d359 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394b43cef91f4990b4707cb7a6798068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:28.492622 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d444f63-3b33-4732-9bcd-7ff77e22d359 service placement] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:28.492924 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d444f63-3b33-4732-9bcd-7ff77e22d359 service placement] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:28.493238 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d444f63-3b33-4732-9bcd-7ff77e22d359 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:28.495793 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2d444f63-3b33-4732-9bcd-7ff77e22d359 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:28.507500 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d444f63-3b33-4732-9bcd-7ff77e22d359 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:28.511872 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d444f63-3b33-4732-9bcd-7ff77e22d359 service placement] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:28.519875 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1438/2908] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:11:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:11:31.918725 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6ced0-4348-4974-b685-2196d0388d59 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:31.920212 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-80a6ced0-4348-4974-b685-2196d0388d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:31.935773 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6ced0-4348-4974-b685-2196d0388d59 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:31.940684 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e350c-0216-43c2-adc4-c81f1d8a9d2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394b43cef91f4990b4707cb7a6798068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:31.941325 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e350c-0216-43c2-adc4-c81f1d8a9d2a service placement] REQUEST_METHOD: `GET` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:31.941610 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e350c-0216-43c2-adc4-c81f1d8a9d2a service placement] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:31.941889 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e350c-0216-43c2-adc4-c81f1d8a9d2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:31.943679 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-274e350c-0216-43c2-adc4-c81f1d8a9d2a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:31.955359 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e350c-0216-43c2-adc4-c81f1d8a9d2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:31.956957 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e350c-0216-43c2-adc4-c81f1d8a9d2a service placement] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:31.966980 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1471/2909] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:11:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:11:32.048027 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d444f63-3b33-4732-9bcd-7ff77e22d359 service placement] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:32.049852 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-2d444f63-3b33-4732-9bcd-7ff77e22d359 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:32.115431 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d444f63-3b33-4732-9bcd-7ff77e22d359 service placement] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:32.120158 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6401b-8a09-4b0e-897f-f5915394123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:32.124613 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6401b-8a09-4b0e-897f-f5915394123b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:32.124613 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6401b-8a09-4b0e-897f-f5915394123b admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:32.124613 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6401b-8a09-4b0e-897f-f5915394123b admin admin] PATH_INFO: `/v3/users/3918088bb1de400eafd0e1c44200d4ba` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:32.124613 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6401b-8a09-4b0e-897f-f5915394123b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3918088bb1de400eafd0e1c44200d4ba)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:32.124990 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6401b-8a09-4b0e-897f-f5915394123b admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:32.126264 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=100 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:32.341533 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-64d6401b-8a09-4b0e-897f-f5915394123b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3918088bb1de400eafd0e1c44200d4ba'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:32.342411 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-64d6401b-8a09-4b0e-897f-f5915394123b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3918088bb1de400eafd0e1c44200d4ba'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:32.471352 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-64d6401b-8a09-4b0e-897f-f5915394123b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3918088bb1de400eafd0e1c44200d4ba'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:32.484720 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-64d6401b-8a09-4b0e-897f-f5915394123b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3918088bb1de400eafd0e1c44200d4ba'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:32.491765 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-64d6401b-8a09-4b0e-897f-f5915394123b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3918088bb1de400eafd0e1c44200d4ba'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:32.498034 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1439/2910] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:11:32 2022] DELETE /identity/v3/users/3918088bb1de400eafd0e1c44200d4ba => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:11:32.738497 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e350c-0216-43c2-adc4-c81f1d8a9d2a service placement] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:32.752117 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e350c-0216-43c2-adc4-c81f1d8a9d2a service placement] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:32.808149 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b6d4d-ac1a-4618-b080-dd02164515f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:32.809207 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b6d4d-ac1a-4618-b080-dd02164515f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:32.809344 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b6d4d-ac1a-4618-b080-dd02164515f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:32.809619 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b6d4d-ac1a-4618-b080-dd02164515f2 admin admin] PATH_INFO: `/v3/projects/1280e7dafe2c4032b4d3e08752127ce1` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:32.810860 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b6d4d-ac1a-4618-b080-dd02164515f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1280e7dafe2c4032b4d3e08752127ce1)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:32.812786 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b6d4d-ac1a-4618-b080-dd02164515f2 admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:32.914146 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d34b6d4d-ac1a-4618-b080-dd02164515f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1280e7dafe2c4032b4d3e08752127ce1', 'request_id': 'req-d34b6d4d-ac1a-4618-b080-dd02164515f2'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:32.920195 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d34b6d4d-ac1a-4618-b080-dd02164515f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1280e7dafe2c4032b4d3e08752127ce1', 'request_id': 'req-d34b6d4d-ac1a-4618-b080-dd02164515f2'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:32.925675 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d34b6d4d-ac1a-4618-b080-dd02164515f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1280e7dafe2c4032b4d3e08752127ce1', 'request_id': 'req-d34b6d4d-ac1a-4618-b080-dd02164515f2'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:33.007771 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d34b6d4d-ac1a-4618-b080-dd02164515f2 admin admin] The token cache is being invalidate because project 1280e7dafe2c4032b4d3e08752127ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:11:33.008063 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d34b6d4d-ac1a-4618-b080-dd02164515f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:33.008685 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-d34b6d4d-ac1a-4618-b080-dd02164515f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:33.010238 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1472/2911] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:11:32 2022] DELETE /identity/v3/projects/1280e7dafe2c4032b4d3e08752127ce1 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:11:33.014224 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6401b-8a09-4b0e-897f-f5915394123b admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:33.015730 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-64d6401b-8a09-4b0e-897f-f5915394123b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:33.028944 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6401b-8a09-4b0e-897f-f5915394123b admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:33.085219 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bf264-bb99-4e3f-b447-7ee0cc8c78ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:33.086103 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bf264-bb99-4e3f-b447-7ee0cc8c78ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:33.086423 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bf264-bb99-4e3f-b447-7ee0cc8c78ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:33.086712 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bf264-bb99-4e3f-b447-7ee0cc8c78ae admin admin] PATH_INFO: `/v3/users/30e32540eb6d45ebb54b8f835f9ef944` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:33.087941 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bf264-bb99-4e3f-b447-7ee0cc8c78ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e32540eb6d45ebb54b8f835f9ef944)` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:33.090030 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605bf264-bb99-4e3f-b447-7ee0cc8c78ae admin admin] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:33.272836 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-605bf264-bb99-4e3f-b447-7ee0cc8c78ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e32540eb6d45ebb54b8f835f9ef944'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:33.273446 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-605bf264-bb99-4e3f-b447-7ee0cc8c78ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e32540eb6d45ebb54b8f835f9ef944'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:33.333663 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-605bf264-bb99-4e3f-b447-7ee0cc8c78ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e32540eb6d45ebb54b8f835f9ef944'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:33.346095 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-605bf264-bb99-4e3f-b447-7ee0cc8c78ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e32540eb6d45ebb54b8f835f9ef944'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:33.353526 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.notifications [None req-605bf264-bb99-4e3f-b447-7ee0cc8c78ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e32540eb6d45ebb54b8f835f9ef944'} {{(pid=92146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:33.355067 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:33.360197 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1440/2912] 10.222.0.15 () {58 vars in 1223 bytes} [Fri May 27 20:11:33 2022] DELETE /identity/v3/users/30e32540eb6d45ebb54b8f835f9ef944 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:11:33.625150 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b6d4d-ac1a-4618-b080-dd02164515f2 admin admin] Authenticating user token {{(pid=92145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:11:33.626964 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.fernet_utils [None req-d34b6d4d-ac1a-4618-b080-dd02164515f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:11:33.641520 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b6d4d-ac1a-4618-b080-dd02164515f2 admin admin] Validating token access rules against request {{(pid=92145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:11:33.681575 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:33.705179 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98bcd5-d447-46ec-9c0a-2d8e9f824f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '446effb9e1f24b71a4cffe88e4bce86a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b60b3b1e79a5473da57ed66a39a9281a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:11:33.706140 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98bcd5-d447-46ec-9c0a-2d8e9f824f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:11:33.706451 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98bcd5-d447-46ec-9c0a-2d8e9f824f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:11:33.706732 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98bcd5-d447-46ec-9c0a-2d8e9f824f1e admin admin] PATH_INFO: `/v3/projects/7f2a0d2231674d9cb6c634787b61f659` {{(pid=92145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:11:33.707910 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98bcd5-d447-46ec-9c0a-2d8e9f824f1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2a0d2231674d9cb6c634787b61f659)` {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:11:33.710588 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98bcd5-d447-46ec-9c0a-2d8e9f824f1e admin admin] RBAC: Authorization granted {{(pid=92145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:11:33.820668 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2a98bcd5-d447-46ec-9c0a-2d8e9f824f1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2a0d2231674d9cb6c634787b61f659', 'request_id': 'req-2a98bcd5-d447-46ec-9c0a-2d8e9f824f1e'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:33.826867 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2a98bcd5-d447-46ec-9c0a-2d8e9f824f1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2a0d2231674d9cb6c634787b61f659', 'request_id': 'req-2a98bcd5-d447-46ec-9c0a-2d8e9f824f1e'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:33.832283 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2a98bcd5-d447-46ec-9c0a-2d8e9f824f1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2a0d2231674d9cb6c634787b61f659', 'request_id': 'req-2a98bcd5-d447-46ec-9c0a-2d8e9f824f1e'} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:33.905248 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2a98bcd5-d447-46ec-9c0a-2d8e9f824f1e admin admin] The token cache is being invalidate because project 7f2a0d2231674d9cb6c634787b61f659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 20:11:33.905437 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2a98bcd5-d447-46ec-9c0a-2d8e9f824f1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:33.906144 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG keystone.notifications [None req-2a98bcd5-d447-46ec-9c0a-2d8e9f824f1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 20:11:33.907783 dv-cinder-839793-12-smb devstack@keystone.service[92145]: [pid: 92145|app: 0|req: 1473/2913] 10.222.0.15 () {58 vars in 1232 bytes} [Fri May 27 20:11:33 2022] DELETE /identity/v3/projects/7f2a0d2231674d9cb6c634787b61f659 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 20:11:43.491766 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=1 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:11:43.901874 dv-cinder-839793-12-smb devstack@keystone.service[92145]: DEBUG dbcounter [-] [92145] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 20:12:58.702480 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bf264-bb99-4e3f-b447-7ee0cc8c78ae admin admin] Authenticating user token {{(pid=92146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 20:12:58.703981 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-605bf264-bb99-4e3f-b447-7ee0cc8c78ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:12:58.793498 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bf264-bb99-4e3f-b447-7ee0cc8c78ae admin admin] Validating token access rules against request {{(pid=92146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 20:12:58.851881 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee882a97-0f4f-48b8-aec1-0d421f0639c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394b43cef91f4990b4707cb7a6798068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '400421f9ccc6478783fa6bbc822b0687', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 20:12:58.852534 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee882a97-0f4f-48b8-aec1-0d421f0639c1 service placement] REQUEST_METHOD: `GET` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 20:12:58.852852 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee882a97-0f4f-48b8-aec1-0d421f0639c1 service placement] SCRIPT_NAME: `/identity` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 20:12:58.853139 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee882a97-0f4f-48b8-aec1-0d421f0639c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 20:12:58.854956 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.fernet_utils [None req-ee882a97-0f4f-48b8-aec1-0d421f0639c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 20:12:58.866616 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee882a97-0f4f-48b8-aec1-0d421f0639c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 20:12:58.868191 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee882a97-0f4f-48b8-aec1-0d421f0639c1 service placement] RBAC: Authorization granted {{(pid=92146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 20:12:58.878075 dv-cinder-839793-12-smb devstack@keystone.service[92146]: [pid: 92146|app: 0|req: 1441/2914] 10.222.0.15 () {60 vars in 1365 bytes} [Fri May 27 20:12:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 20:13:08.873761 dv-cinder-839793-12-smb devstack@keystone.service[92146]: DEBUG dbcounter [-] [92146] Writing DB stats keystone:SELECT=67 {{(pid=92146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}